Jul 09 15:24:06.878328 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 15:24:06.878339 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 15:24:06.878347 ip-10-0-138-133 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 15:24:06.878642 ip-10-0-138-133 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 15:24:17.095409 ip-10-0-138-133 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 15:24:17.095429 ip-10-0-138-133 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 710c6a4014634ff8a1d8a84d0ebdc77c -- Jul 09 15:26:18.605992 ip-10-0-138-133 systemd[1]: Starting Kubernetes Kubelet... Jul 09 15:26:19.006424 ip-10-0-138-133 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:19.006424 ip-10-0-138-133 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 15:26:19.006424 ip-10-0-138-133 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:19.006424 ip-10-0-138-133 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 15:26:19.006424 ip-10-0-138-133 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:19.007580 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.007491 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 15:26:19.011423 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011407 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:19.011423 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011424 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011429 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011432 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011435 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011438 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011441 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011443 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011447 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011451 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011459 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011462 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011465 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011467 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011470 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011472 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011475 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011478 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011480 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:19.011490 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011482 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011485 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011487 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011490 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011493 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011496 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011498 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011501 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011504 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011507 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011509 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011512 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011514 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011516 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011519 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011521 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011524 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011527 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011530 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011532 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:19.011942 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011534 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011537 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011539 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011541 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011544 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011546 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011548 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011551 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011554 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011556 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011558 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011561 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011563 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011566 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011569 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011572 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011574 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011577 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011579 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011583 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:19.012442 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011586 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011589 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011592 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011594 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011596 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011599 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011601 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011603 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011607 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011609 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011612 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011615 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011617 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011620 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011623 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011626 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011628 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011631 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011633 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011635 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:19.012974 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011638 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011640 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011643 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011645 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011647 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011650 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011653 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011656 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011658 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011661 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011664 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011666 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011669 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011671 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011673 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011676 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011678 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011680 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011684 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:19.013699 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.011687 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012408 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012417 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012420 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012425 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012429 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012432 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012435 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012438 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012441 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012444 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012447 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012450 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012452 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012455 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012457 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012460 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012462 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012465 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012468 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:19.014361 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012470 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012473 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012475 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012478 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012480 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012483 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012485 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012488 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012490 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012493 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012495 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012498 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012500 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012502 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012505 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012508 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012510 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012513 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012516 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012518 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:19.014934 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012520 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012523 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012526 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012528 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012530 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012533 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012535 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012538 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012540 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012543 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012545 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012548 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012553 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012556 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012560 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012563 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012565 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012568 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012570 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:19.015425 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012573 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012575 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012578 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012580 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012583 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012585 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012587 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012590 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012593 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012596 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012598 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012601 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012604 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012607 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012609 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012612 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012614 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012616 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012619 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012621 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:19.015915 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012624 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012626 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012629 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012631 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012634 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012637 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012639 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012642 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012644 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012647 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012649 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012652 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012654 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012656 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012659 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012661 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012664 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012666 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012669 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012671 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:19.016394 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.012674 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014698 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014727 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014733 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014736 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014739 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014742 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014745 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014748 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014750 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014753 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014755 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014758 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014761 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014763 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014766 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014768 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014770 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014773 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:19.016901 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014776 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014778 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014780 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014783 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014785 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014788 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014790 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014792 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014800 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014803 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014806 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014808 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014811 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014813 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014816 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014819 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014822 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014824 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014827 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014830 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:19.017359 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014832 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014834 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014837 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014840 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014842 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014845 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014848 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014852 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014855 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014858 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014861 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014863 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014866 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014868 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014870 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014873 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014875 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014877 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014880 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014883 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:19.017944 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014885 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014888 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014890 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014892 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014895 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014897 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014901 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014906 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014909 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014911 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014914 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014917 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014919 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014922 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014924 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014926 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014929 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014932 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014934 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:19.018432 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014937 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014939 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014942 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014944 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014948 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014951 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014955 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014957 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014960 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014962 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014964 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014967 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014969 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014972 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014974 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014976 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014979 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014982 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014984 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014986 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:19.018905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014989 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.014992 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015061 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015068 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015074 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015078 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015083 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015086 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015090 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015094 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015097 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015100 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015103 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015106 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015109 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015112 2566 flags.go:64] FLAG: --cgroup-root="" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015114 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015117 2566 flags.go:64] FLAG: --client-ca-file="" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015120 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015123 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015128 2566 flags.go:64] FLAG: --cluster-domain="" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015131 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015134 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015137 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 15:26:19.019383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015140 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015147 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015150 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015153 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015156 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015159 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015161 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015164 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015167 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015170 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015174 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015177 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015180 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015183 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015185 2566 flags.go:64] FLAG: --enable-server="true" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015188 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015192 2566 flags.go:64] FLAG: --event-burst="100" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015195 2566 flags.go:64] FLAG: --event-qps="50" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015198 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015201 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015204 2566 flags.go:64] FLAG: --eviction-hard="" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015207 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015209 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015212 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015215 2566 flags.go:64] FLAG: --eviction-soft="" Jul 09 15:26:19.020005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015218 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015221 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015223 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015227 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015230 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015232 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015235 2566 flags.go:64] FLAG: --feature-gates="" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015239 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015242 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015244 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015247 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015250 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015253 2566 flags.go:64] FLAG: --help="false" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015256 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015259 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015262 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015265 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015269 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015272 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015275 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015278 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015280 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015283 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 15:26:19.020598 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015286 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015289 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015291 2566 flags.go:64] FLAG: --kube-reserved="" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015294 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015297 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015299 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015302 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015305 2566 flags.go:64] FLAG: --lock-file="" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015307 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015310 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015313 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015318 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015321 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015324 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015327 2566 flags.go:64] FLAG: --logging-format="text" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015330 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015333 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015335 2566 flags.go:64] FLAG: --manifest-url="" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015338 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015343 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015346 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015349 2566 flags.go:64] FLAG: --max-pods="110" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015352 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015355 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015359 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 15:26:19.021179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015362 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015365 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015368 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015371 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015378 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015381 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015383 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015386 2566 flags.go:64] FLAG: --pod-cidr="" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015389 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015395 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015397 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015400 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015403 2566 flags.go:64] FLAG: --port="10250" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015406 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015409 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03d3484e5d0000ed1" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015412 2566 flags.go:64] FLAG: --qos-reserved="" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015416 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015419 2566 flags.go:64] FLAG: --register-node="true" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015422 2566 flags.go:64] FLAG: --register-with-taints="" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015425 2566 flags.go:64] FLAG: --registry-burst="10" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015428 2566 flags.go:64] FLAG: --registry-qps="5" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015432 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015434 2566 flags.go:64] FLAG: --reserved-memory="" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015438 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015441 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 15:26:19.021794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015444 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015447 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015449 2566 flags.go:64] FLAG: --runonce="false" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015452 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015455 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015458 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015462 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015465 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015467 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015470 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015473 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015476 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015479 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015481 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015484 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015487 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015490 2566 flags.go:64] FLAG: --system-cgroups="" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015493 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015498 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015501 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015503 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015508 2566 flags.go:64] FLAG: --tls-min-version="" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015510 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015515 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015517 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 15:26:19.022749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015520 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015523 2566 flags.go:64] FLAG: --v="2" Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015527 2566 flags.go:64] FLAG: --version="false" Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015532 2566 flags.go:64] FLAG: --vmodule="" Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015536 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.015539 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015651 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015655 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015658 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015661 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015663 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015666 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015668 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015673 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015676 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015678 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015681 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015683 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015686 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015688 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015690 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:19.023897 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015693 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015695 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015698 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015700 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015719 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015722 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015725 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015727 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015730 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015733 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015736 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015739 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015741 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015744 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015746 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015749 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015753 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015755 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015758 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015760 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:19.024866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015763 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015765 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015768 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015770 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015774 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015777 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015779 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015782 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015784 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015787 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015789 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015792 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015794 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015796 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015799 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015801 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015805 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015809 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015811 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:19.025739 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015814 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015816 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015820 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015823 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015825 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015828 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015830 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015833 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015841 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015844 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015847 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015849 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015851 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015854 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015856 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015858 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015861 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015864 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015867 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015870 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:19.026291 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015874 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015877 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015879 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015881 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015884 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015886 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015889 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015891 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015894 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015897 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015901 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015904 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015907 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015910 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015913 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015917 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015919 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015922 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015924 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015927 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:19.027040 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015930 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015932 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015935 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015938 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.015940 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.016568 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.024316 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.024338 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.024365 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.024379 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024468 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024477 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024483 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024488 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:19.027905 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024494 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024499 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024503 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024508 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024513 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024518 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024522 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024527 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024531 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024536 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024540 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024544 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024549 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024553 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024558 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024562 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024566 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024570 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024574 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024578 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:19.028288 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024583 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024587 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024591 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024595 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024600 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024606 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024611 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024615 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024619 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024623 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024627 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024632 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024636 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024641 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024645 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024649 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024653 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024658 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024662 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024666 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:19.028976 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024670 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024674 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024678 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024682 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024687 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024691 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024695 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024699 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024724 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024729 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024734 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024738 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024744 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024750 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024757 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024764 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024768 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024773 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024779 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:19.029522 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024783 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024788 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024792 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024796 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024800 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024804 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024808 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024812 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024816 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024820 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024824 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024828 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024833 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024838 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024842 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024846 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024850 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024854 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024858 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:19.030015 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024862 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024867 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024874 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024878 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024882 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024886 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024890 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024894 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024898 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024902 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024907 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024912 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024916 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024921 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024926 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024930 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:19.030542 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.024934 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.024942 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025122 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025129 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025134 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025138 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025143 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025148 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025152 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025157 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025161 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025165 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025169 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025173 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:19.030958 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025177 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025181 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025185 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025189 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025193 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025198 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025202 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025206 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025210 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025214 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025219 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025223 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025227 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025231 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025235 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025240 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025245 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025249 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025254 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025258 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:19.031357 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025262 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025266 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025270 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025274 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025278 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025283 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025287 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025291 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025295 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025299 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025303 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025307 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025312 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025319 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025323 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025327 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025332 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025336 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025340 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:19.031889 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025344 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025348 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025352 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025356 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025360 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025364 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025368 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025373 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025377 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025381 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025386 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025390 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025394 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025398 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025402 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025406 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025410 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025414 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025418 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025422 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:19.032348 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025426 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025430 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025434 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025438 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025442 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025446 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025450 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025455 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025458 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025463 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025467 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025471 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025475 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025479 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025483 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025487 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025491 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025495 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025499 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025503 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:19.032866 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025507 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025511 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025515 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025520 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025527 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025532 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025537 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:19.025542 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.025551 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.025736 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.028667 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.030149 2566 server.go:1019] "Starting client certificate rotation" Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.030261 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:26:19.033356 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.030960 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:26:19.034301 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.034281 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:26:19.035521 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.035504 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:26:19.046335 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.046299 2566 log.go:25] "Validated CRI v1 runtime API" Jul 09 15:26:19.050232 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.050214 2566 log.go:25] "Validated CRI v1 image API" Jul 09 15:26:19.051091 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.051075 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 15:26:19.055215 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.055195 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 9af97ea0-6202-4ccb-80b3-67211e127519:/dev/nvme0n1p4 a6d4720d-d1c9-4b33-842f-899709cde6fb:/dev/nvme0n1p3] Jul 09 15:26:19.055294 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.055215 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 15:26:19.060700 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.060571 2566 manager.go:216] Machine: {Timestamp:2026-07-09 15:26:19.058889924 +0000 UTC m=+0.338266476 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100179 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276c71e144c0e4fa37605be1c2b09b SystemUUID:ec276c71-e144-c0e4-fa37-605be1c2b09b BootID:710c6a40-1463-4ff8-a1d8-a84d0ebdc77c Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:53:cc:57:b0:85 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:53:cc:57:b0:85 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:49:31:16:ed:9f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 15:26:19.060700 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.060692 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 15:26:19.060831 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.060788 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 15:26:19.063518 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.063503 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:26:19.064963 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.064935 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 15:26:19.065106 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.064967 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-133.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 15:26:19.065652 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.065643 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 15:26:19.065685 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.065655 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 15:26:19.065685 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.065662 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:26:19.066334 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.066322 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:26:19.067756 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.067746 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 15:26:19.070867 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.070856 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:26:19.071010 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.071001 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 15:26:19.071047 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.071030 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 09 15:26:19.071047 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.071039 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 15:26:19.071098 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.071050 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 15:26:19.071098 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.071059 2566 kubelet.go:398] "Adding apiserver pod source" Jul 09 15:26:19.071098 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.071068 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 15:26:19.071419 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.071407 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:26:19.071453 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.071426 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:26:19.074479 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.074464 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 15:26:19.076312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.076299 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 15:26:19.076357 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.076329 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 15:26:19.077039 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077026 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 15:26:19.077075 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077049 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 15:26:19.077075 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077055 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 15:26:19.077075 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077061 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 15:26:19.077075 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077071 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 15:26:19.077180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077080 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 15:26:19.077180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077088 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 15:26:19.077180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077095 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 15:26:19.077180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077101 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 15:26:19.077180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077107 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 15:26:19.077180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077122 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 15:26:19.077180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077128 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 15:26:19.077848 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077836 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 15:26:19.077848 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.077847 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 15:26:19.081394 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.081379 2566 server.go:1268] "Started kubelet" Jul 09 15:26:19.081538 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.081486 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 15:26:19.081591 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.081569 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 15:26:19.081591 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.081571 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 15:26:19.082736 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.082674 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 15:26:19.082818 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.082766 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-133.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 15:26:19.083018 ip-10-0-138-133 systemd[1]: Started Kubernetes Kubelet. Jul 09 15:26:19.083174 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.083062 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 15:26:19.084200 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.084188 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 09 15:26:19.088397 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.088374 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 15:26:19.088581 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.088562 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 15:26:19.090135 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.090117 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 15:26:19.090179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.090119 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 15:26:19.090379 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.090356 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.090870 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.090827 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 15:26:19.090870 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.090836 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 15:26:19.090870 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.090852 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 15:26:19.091045 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.090904 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ghfdm" Jul 09 15:26:19.091045 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.090998 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 09 15:26:19.091045 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.091006 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 09 15:26:19.091326 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.091258 2566 factory.go:55] Registering systemd factory Jul 09 15:26:19.091326 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.091290 2566 factory.go:223] Registration of the systemd container factory successfully Jul 09 15:26:19.091570 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.091554 2566 factory.go:153] Registering CRI-O factory Jul 09 15:26:19.091660 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.091579 2566 factory.go:223] Registration of the crio container factory successfully Jul 09 15:26:19.091660 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.088158 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-133.ec2.internal.18c0a88db8b3ab5b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-133.ec2.internal,UID:ip-10-0-138-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-133.ec2.internal,},FirstTimestamp:2026-07-09 15:26:19.081354075 +0000 UTC m=+0.360730627,LastTimestamp:2026-07-09 15:26:19.081354075 +0000 UTC m=+0.360730627,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-133.ec2.internal,}" Jul 09 15:26:19.091660 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.091631 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 15:26:19.091838 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.091675 2566 factory.go:103] Registering Raw factory Jul 09 15:26:19.091838 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.091687 2566 manager.go:1196] Started watching for new ooms in manager Jul 09 15:26:19.092810 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.092795 2566 manager.go:349] Starting recovery of all containers Jul 09 15:26:19.093520 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.093450 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-133.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 15:26:19.093731 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.093561 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 15:26:19.096765 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.096739 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ghfdm" Jul 09 15:26:19.103170 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.103065 2566 manager.go:354] Recovery completed Jul 09 15:26:19.107165 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.107152 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:19.109088 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.109068 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:19.109159 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.109100 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:19.109159 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.109111 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:19.109592 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.109581 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 15:26:19.109592 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.109592 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 15:26:19.109684 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.109607 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:26:19.109684 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.109585 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:19.110411 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.110398 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:19.110455 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.110422 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:19.110455 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.110432 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:19.110765 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.110746 2566 policy_none.go:49] "None policy: Start" Jul 09 15:26:19.110809 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.110766 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 15:26:19.110809 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.110777 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 15:26:19.111459 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.111387 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-133.ec2.internal.18c0a88dba5ad99c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-133.ec2.internal,UID:ip-10-0-138-133.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-133.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-133.ec2.internal,},FirstTimestamp:2026-07-09 15:26:19.109087644 +0000 UTC m=+0.388464199,LastTimestamp:2026-07-09 15:26:19.109087644 +0000 UTC m=+0.388464199,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-133.ec2.internal,}" Jul 09 15:26:19.112059 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.112045 2566 policy_none.go:47] "Start" Jul 09 15:26:19.151267 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.151251 2566 manager.go:337] "Starting Device Plugin manager" Jul 09 15:26:19.151359 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.151289 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 15:26:19.151359 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.151300 2566 server.go:87] "Starting device plugin registration server" Jul 09 15:26:19.151575 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.151561 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 15:26:19.151635 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.151577 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 15:26:19.151678 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.151648 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 15:26:19.152126 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.151963 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 15:26:19.152126 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.151978 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 15:26:19.152406 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.152391 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 15:26:19.152478 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.152435 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.252026 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.251996 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:19.253234 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.253212 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:19.253338 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.253246 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:19.253338 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.253256 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:19.253338 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.253282 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.256671 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.256622 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 15:26:19.257886 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.257871 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 15:26:19.257970 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.257903 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 15:26:19.257970 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.257921 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 15:26:19.257970 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.257950 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 15:26:19.260647 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.260625 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:19.261509 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.261493 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.261572 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.261517 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-133.ec2.internal\": node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.307820 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.307801 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.359013 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.358972 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal"] Jul 09 15:26:19.359086 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.359052 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:19.359971 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.359953 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:19.360046 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.359984 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:19.360046 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.359993 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:19.362693 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.362673 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:19.362846 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.362819 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.362909 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.362867 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:19.363461 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.363444 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:19.363533 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.363451 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:19.363533 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.363492 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:19.363533 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.363502 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:19.363652 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.363475 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:19.363652 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.363561 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:19.364773 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.364759 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.364837 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.364783 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:19.365477 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.365463 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:19.365553 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.365494 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:19.365553 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.365507 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:19.392350 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.392327 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-133.ec2.internal\" not found" node="ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.394787 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.394762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a2d22ef15630c0bcf868989aaec4f613-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"a2d22ef15630c0bcf868989aaec4f613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.394887 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.394801 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2d22ef15630c0bcf868989aaec4f613-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"a2d22ef15630c0bcf868989aaec4f613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.394887 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.394855 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dca3604df6062d18799a8c635a695b55-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"dca3604df6062d18799a8c635a695b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.396697 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.396681 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-133.ec2.internal\" not found" node="ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.408652 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.408632 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.495140 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.495117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a2d22ef15630c0bcf868989aaec4f613-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"a2d22ef15630c0bcf868989aaec4f613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.495243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.495146 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2d22ef15630c0bcf868989aaec4f613-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"a2d22ef15630c0bcf868989aaec4f613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.495243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.495164 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dca3604df6062d18799a8c635a695b55-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"dca3604df6062d18799a8c635a695b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.495243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.495211 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dca3604df6062d18799a8c635a695b55-config\") pod \"kube-apiserver-proxy-ip-10-0-138-133.ec2.internal\" (UID: \"dca3604df6062d18799a8c635a695b55\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.495243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.495225 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a2d22ef15630c0bcf868989aaec4f613-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"a2d22ef15630c0bcf868989aaec4f613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.495243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.495227 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a2d22ef15630c0bcf868989aaec4f613-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal\" (UID: \"a2d22ef15630c0bcf868989aaec4f613\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.509273 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.509224 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.610020 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.609976 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.694417 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.694397 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.699352 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.699315 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jul 09 15:26:19.711040 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.711019 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.811596 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.811517 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.911911 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:19.911880 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:19.916269 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:19.916249 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:20.012935 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:20.012909 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:20.029029 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.029004 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 15:26:20.029146 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.029127 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 15:26:20.029212 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.029162 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 15:26:20.101376 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.101302 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 15:21:19 +0000 UTC" deadline="2028-04-19 02:09:18.695462878 +0000 UTC" Jul 09 15:26:20.101376 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.101335 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15586h42m58.594132644s" Jul 09 15:26:20.113252 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:20.113229 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-133.ec2.internal\" not found" Jul 09 15:26:20.127172 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.127149 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:20.191331 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.191301 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" Jul 09 15:26:20.203083 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.203063 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:26:20.203997 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.203983 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" Jul 09 15:26:20.211046 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.211026 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:26:20.278273 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:20.278231 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2d22ef15630c0bcf868989aaec4f613.slice/crio-ce83aa854bf2464cc3a2817d534103a94c09edb2ccd2f4ead73145afea564ac9 WatchSource:0}: Error finding container ce83aa854bf2464cc3a2817d534103a94c09edb2ccd2f4ead73145afea564ac9: Status 404 returned error can't find the container with id ce83aa854bf2464cc3a2817d534103a94c09edb2ccd2f4ead73145afea564ac9 Jul 09 15:26:20.278685 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:20.278646 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca3604df6062d18799a8c635a695b55.slice/crio-e61f7947736f5f0ef618024f3aa03349a5ec8b2b40af85ca7b66c66fa82a335f WatchSource:0}: Error finding container e61f7947736f5f0ef618024f3aa03349a5ec8b2b40af85ca7b66c66fa82a335f: Status 404 returned error can't find the container with id e61f7947736f5f0ef618024f3aa03349a5ec8b2b40af85ca7b66c66fa82a335f Jul 09 15:26:20.282529 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.282513 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:26:20.408980 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:20.408907 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:21.072658 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.072623 2566 apiserver.go:52] "Watching apiserver" Jul 09 15:26:21.079924 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.079899 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 15:26:21.081086 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.081061 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-xwb2t","openshift-multus/multus-additional-cni-plugins-zwhpx","openshift-multus/multus-klq7h","openshift-network-diagnostics/network-check-target-wrzr5","openshift-network-operator/iptables-alerter-pwlbp","kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p","openshift-cluster-node-tuning-operator/tuned-vqvwm","openshift-image-registry/node-ca-m94j4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal","openshift-multus/network-metrics-daemon-mxqzz","openshift-ovn-kubernetes/ovnkube-node-zp7dp","kube-system/global-pull-secret-syncer-px6xd","kube-system/konnectivity-agent-qfmvb"] Jul 09 15:26:21.082834 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.082811 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.083892 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.083868 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.083990 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.083954 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:21.085201 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.085139 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.085729 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.085705 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fh2sh\"" Jul 09 15:26:21.085729 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.085713 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 15:26:21.085729 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.085738 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 15:26:21.086038 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.085820 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 15:26:21.086134 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.086118 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:21.086217 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.086193 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:21.088084 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.088051 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.089713 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.089670 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 15:26:21.089833 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.089799 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 15:26:21.091815 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.090268 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 15:26:21.091815 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.090414 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gmsq9\"" Jul 09 15:26:21.091815 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.090604 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 15:26:21.091815 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.090847 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 15:26:21.091815 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.091660 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:26:21.092464 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.092439 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zhk49\"" Jul 09 15:26:21.092720 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.092444 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 15:26:21.092822 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.092731 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 15:26:21.095078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.095058 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:21.096479 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.096453 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.097419 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.097400 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 15:26:21.097820 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.097775 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 15:26:21.098084 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.098050 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n6lpn\"" Jul 09 15:26:21.098312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.098293 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.099026 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.099006 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 15:26:21.099117 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.099076 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vnz7t\"" Jul 09 15:26:21.099117 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.099095 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.099232 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.099148 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 15:26:21.099289 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.099232 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 15:26:21.100560 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.100536 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.101615 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.101486 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-28k6k\"" Jul 09 15:26:21.101615 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.101550 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 15:26:21.102475 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.102456 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:21.102567 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.102532 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:21.103055 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.103031 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 15:26:21.103150 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.103131 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 15:26:21.103268 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.103249 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:26:21.103369 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.103345 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 15:26:21.103516 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.103497 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2zffs\"" Jul 09 15:26:21.103583 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.103534 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 15:26:21.103643 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.103625 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fk9hw\"" Jul 09 15:26:21.104402 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.104380 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.105677 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.105654 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:26:21.106581 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106554 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-socket-dir-parent\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.106676 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106595 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-conf-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.106676 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106626 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad43bf83-0c58-427c-90a9-efae74ce39ba-host-slash\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.106676 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106650 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021-agent-certs\") pod \"konnectivity-agent-qfmvb\" (UID: \"cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021\") " pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:21.106867 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-cnibin\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.106867 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106718 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-k8s-cni-cncf-io\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.106867 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106744 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-kubelet\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.106867 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106857 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:21.107074 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106905 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-netns\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.107074 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106964 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-socket-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.107074 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106970 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 15:26:21.107074 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.106992 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-registration-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.107074 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107029 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-sys-fs\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.107074 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107055 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b15963b-50f4-442b-8872-8858281ab6a4-dbus\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.107383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ad43bf83-0c58-427c-90a9-efae74ce39ba-iptables-alerter-script\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.107383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107102 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b15963b-50f4-442b-8872-8858281ab6a4-kubelet-config\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.107383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107140 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.107383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107166 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-device-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.107383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107232 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-system-cni-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.107383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107260 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 15:26:21.107691 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107262 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-multus-certs\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.107691 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107433 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.107691 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107557 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bqdq8\"" Jul 09 15:26:21.107691 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107573 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 15:26:21.107915 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107775 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 15:26:21.107915 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107873 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 15:26:21.108019 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107547 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.108019 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.107989 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 15:26:21.108120 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108002 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e360b86c-8026-44a4-975f-00e1bffa4e71-cni-binary-copy\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108120 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-cni-bin\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108120 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108061 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-cni-multus\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108120 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-hostroot\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108120 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-etc-kubernetes\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108120 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7b4h\" (UniqueName: \"kubernetes.io/projected/e360b86c-8026-44a4-975f-00e1bffa4e71-kube-api-access-m7b4h\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108310 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-cni-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108310 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-os-release\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108310 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108202 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-daemon-config\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.108310 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26d9x\" (UniqueName: \"kubernetes.io/projected/ad43bf83-0c58-427c-90a9-efae74ce39ba-kube-api-access-26d9x\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.108310 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108253 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021-konnectivity-ca\") pod \"konnectivity-agent-qfmvb\" (UID: \"cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021\") " pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:21.108310 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.108281 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9rl8\" (UniqueName: \"kubernetes.io/projected/e8289334-1a66-48d2-8034-a7c788e3ec08-kube-api-access-h9rl8\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.140674 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.140649 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zvbmk" Jul 09 15:26:21.148012 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.147989 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zvbmk" Jul 09 15:26:21.191694 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.191673 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 15:26:21.208920 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.208891 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-run\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.209021 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.208933 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4vz6\" (UniqueName: \"kubernetes.io/projected/92a43d1c-7093-48d7-9318-89f33464a781-kube-api-access-d4vz6\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.209021 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.208955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-etc-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.209021 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.208973 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-ovn\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.209190 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209023 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-daemon-config\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.209190 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26d9x\" (UniqueName: \"kubernetes.io/projected/ad43bf83-0c58-427c-90a9-efae74ce39ba-kube-api-access-26d9x\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.209292 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209206 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021-konnectivity-ca\") pod \"konnectivity-agent-qfmvb\" (UID: \"cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021\") " pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:21.209292 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209273 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-tmp-dir\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.209404 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-ovnkube-script-lib\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.209404 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209375 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysctl-conf\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.209506 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209408 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad43bf83-0c58-427c-90a9-efae74ce39ba-host-slash\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.209506 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209425 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021-agent-certs\") pod \"konnectivity-agent-qfmvb\" (UID: \"cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021\") " pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:21.209506 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209445 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cnibin\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.209506 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209472 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-cnibin\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.209506 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209497 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ad43bf83-0c58-427c-90a9-efae74ce39ba-host-slash\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.209764 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209536 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-cnibin\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.209764 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209590 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-k8s-cni-cncf-io\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.209764 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209633 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:21.209764 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209659 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-k8s-cni-cncf-io\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.209764 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.209764 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209694 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-var-lib-kubelet\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.209764 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209713 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-daemon-config\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.210063 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209853 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 15:26:21.210063 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209866 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021-konnectivity-ca\") pod \"konnectivity-agent-qfmvb\" (UID: \"cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021\") " pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:21.210063 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.209998 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-run-netns\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.210063 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-cni-bin\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.210063 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-registration-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210063 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-sys-fs\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210079 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-systemd\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210097 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-kubelet\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b15963b-50f4-442b-8872-8858281ab6a4-dbus\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ad43bf83-0c58-427c-90a9-efae74ce39ba-iptables-alerter-script\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210144 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-sys-fs\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-kubernetes\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-host\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210196 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-registration-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210206 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b15963b-50f4-442b-8872-8858281ab6a4-kubelet-config\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210235 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-device-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210264 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvxf5\" (UniqueName: \"kubernetes.io/projected/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-kube-api-access-vvxf5\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6b15963b-50f4-442b-8872-8858281ab6a4-dbus\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6b15963b-50f4-442b-8872-8858281ab6a4-kubelet-config\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-sys\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.210298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210299 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-device-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210314 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-cni-netd\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-multus-certs\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210358 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210395 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-multus-certs\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210426 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhhr2\" (UniqueName: \"kubernetes.io/projected/1e002460-a3d1-4ad7-b248-0122b661f22b-kube-api-access-mhhr2\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210447 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210449 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls4k5\" (UniqueName: \"kubernetes.io/projected/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-kube-api-access-ls4k5\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210476 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-etc-selinux\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210571 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6zsp\" (UniqueName: \"kubernetes.io/projected/12b20f1c-d297-4a7e-bc1c-2817359a7d21-kube-api-access-g6zsp\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210605 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-cni-bin\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210639 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ad43bf83-0c58-427c-90a9-efae74ce39ba-iptables-alerter-script\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-cni-multus\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-lib-modules\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210686 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-cni-bin\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.210919 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-slash\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210719 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-systemd\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210678 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-cni-multus\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210742 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-node-log\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-log-socket\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210805 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-run-ovn-kubernetes\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-cni-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210911 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-os-release\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210940 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9rl8\" (UniqueName: \"kubernetes.io/projected/e8289334-1a66-48d2-8034-a7c788e3ec08-kube-api-access-h9rl8\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210970 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e002460-a3d1-4ad7-b248-0122b661f22b-host\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210985 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-cni-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.210995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92a43d1c-7093-48d7-9318-89f33464a781-etc-tuned\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211010 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-os-release\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc5626e8-ee87-4703-b99f-64122274104f-ovn-node-metrics-cert\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysconfig\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211132 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-socket-dir-parent\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-conf-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.211525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e002460-a3d1-4ad7-b248-0122b661f22b-serviceca\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211210 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-conf-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211222 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-multus-socket-dir-parent\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211240 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92a43d1c-7093-48d7-9318-89f33464a781-tmp\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-kubelet\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211323 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-system-cni-dir\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211346 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211354 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-var-lib-kubelet\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211363 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-modprobe-d\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211380 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-netns\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211401 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-socket-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211425 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-hosts-file\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211432 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-host-run-netns\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211455 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysctl-d\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-ovnkube-config\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.212131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211503 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-os-release\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211531 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211540 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8289334-1a66-48d2-8034-a7c788e3ec08-socket-dir\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211560 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-var-lib-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211583 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211614 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-env-overrides\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211638 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-system-cni-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-systemd-units\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z2m9\" (UniqueName: \"kubernetes.io/projected/dc5626e8-ee87-4703-b99f-64122274104f-kube-api-access-7z2m9\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211699 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e360b86c-8026-44a4-975f-00e1bffa4e71-cni-binary-copy\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.211682 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211780 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-hostroot\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211721 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-hostroot\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211780 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-system-cni-dir\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.211815 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret podName:6b15963b-50f4-442b-8872-8858281ab6a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.711777487 +0000 UTC m=+2.991154045 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret") pod "global-pull-secret-syncer-px6xd" (UID: "6b15963b-50f4-442b-8872-8858281ab6a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211840 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-etc-kubernetes\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.212649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211861 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7b4h\" (UniqueName: \"kubernetes.io/projected/e360b86c-8026-44a4-975f-00e1bffa4e71-kube-api-access-m7b4h\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.213314 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.211918 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e360b86c-8026-44a4-975f-00e1bffa4e71-etc-kubernetes\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.213314 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.212178 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e360b86c-8026-44a4-975f-00e1bffa4e71-cni-binary-copy\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.213902 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.213883 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021-agent-certs\") pod \"konnectivity-agent-qfmvb\" (UID: \"cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021\") " pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:21.215450 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.215432 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:21.215541 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.215457 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:21.215541 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.215471 2566 projected.go:196] Error preparing data for projected volume kube-api-access-b4r7m for pod openshift-network-diagnostics/network-check-target-wrzr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:21.215661 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.215547 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m podName:47d67b1f-0722-4d14-9ed1-73fbb50aec95 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.715529277 +0000 UTC m=+2.994905846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b4r7m" (UniqueName: "kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m") pod "network-check-target-wrzr5" (UID: "47d67b1f-0722-4d14-9ed1-73fbb50aec95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:21.219050 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.219026 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26d9x\" (UniqueName: \"kubernetes.io/projected/ad43bf83-0c58-427c-90a9-efae74ce39ba-kube-api-access-26d9x\") pod \"iptables-alerter-pwlbp\" (UID: \"ad43bf83-0c58-427c-90a9-efae74ce39ba\") " pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.219667 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.219642 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9rl8\" (UniqueName: \"kubernetes.io/projected/e8289334-1a66-48d2-8034-a7c788e3ec08-kube-api-access-h9rl8\") pod \"aws-ebs-csi-driver-node-gqd5p\" (UID: \"e8289334-1a66-48d2-8034-a7c788e3ec08\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.220560 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.220535 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7b4h\" (UniqueName: \"kubernetes.io/projected/e360b86c-8026-44a4-975f-00e1bffa4e71-kube-api-access-m7b4h\") pod \"multus-klq7h\" (UID: \"e360b86c-8026-44a4-975f-00e1bffa4e71\") " pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.263469 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.263414 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"a2d22ef15630c0bcf868989aaec4f613","Type":"ContainerStarted","Data":"ce83aa854bf2464cc3a2817d534103a94c09edb2ccd2f4ead73145afea564ac9"} Jul 09 15:26:21.264821 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.264785 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" event={"ID":"dca3604df6062d18799a8c635a695b55","Type":"ContainerStarted","Data":"e61f7947736f5f0ef618024f3aa03349a5ec8b2b40af85ca7b66c66fa82a335f"} Jul 09 15:26:21.312378 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312350 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-tmp-dir\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.312524 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312393 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-ovnkube-script-lib\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.312524 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysctl-conf\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.312687 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312553 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysctl-conf\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.312820 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312791 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-tmp-dir\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.312924 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cnibin\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.312924 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312910 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.313026 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312942 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-var-lib-kubelet\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313026 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312969 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-run-netns\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313026 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.312993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-cni-bin\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313144 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-systemd\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313144 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313057 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-kubelet\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313144 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313090 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-kubernetes\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313144 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313100 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-ovnkube-script-lib\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313144 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313113 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-host\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvxf5\" (UniqueName: \"kubernetes.io/projected/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-kube-api-access-vvxf5\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-sys\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313174 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-host\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313195 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-cni-netd\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313219 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cnibin\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhhr2\" (UniqueName: \"kubernetes.io/projected/1e002460-a3d1-4ad7-b248-0122b661f22b-kube-api-access-mhhr2\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313260 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls4k5\" (UniqueName: \"kubernetes.io/projected/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-kube-api-access-ls4k5\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313280 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6zsp\" (UniqueName: \"kubernetes.io/projected/12b20f1c-d297-4a7e-bc1c-2817359a7d21-kube-api-access-g6zsp\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-lib-modules\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313340 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313330 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-slash\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313347 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-systemd\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313362 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-node-log\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-log-socket\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313413 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-run-ovn-kubernetes\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e002460-a3d1-4ad7-b248-0122b661f22b-host\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313475 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92a43d1c-7093-48d7-9318-89f33464a781-etc-tuned\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc5626e8-ee87-4703-b99f-64122274104f-ovn-node-metrics-cert\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313520 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysconfig\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313537 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e002460-a3d1-4ad7-b248-0122b661f22b-serviceca\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313554 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92a43d1c-7093-48d7-9318-89f33464a781-tmp\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313604 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-system-cni-dir\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313636 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-modprobe-d\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313662 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-hosts-file\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.313749 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313697 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysctl-d\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313712 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cni-binary-copy\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-ovnkube-config\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313777 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-var-lib-kubelet\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313813 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-systemd\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313813 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e002460-a3d1-4ad7-b248-0122b661f22b-host\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313820 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-os-release\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313878 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-os-release\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313879 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313926 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-cni-bin\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313937 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-sys\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313942 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-slash\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.313960 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313967 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-kubelet\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.313880 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-run-netns\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314012 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-systemd\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314017 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-run-ovn-kubernetes\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314034 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.314725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314049 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-node-log\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314072 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysconfig\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.314106 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.814087216 +0000 UTC m=+3.093463763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314148 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-lib-modules\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314277 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-hosts-file\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314284 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-kubernetes\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314316 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-system-cni-dir\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314462 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314471 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314498 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e002460-a3d1-4ad7-b248-0122b661f22b-serviceca\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314594 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-modprobe-d\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314644 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-host-cni-netd\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314687 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-var-lib-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314730 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314777 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-ovnkube-config\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314779 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-env-overrides\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314804 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-var-lib-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.315481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-systemd-units\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314832 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314874 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-log-socket\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314895 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-etc-sysctl-d\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314916 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z2m9\" (UniqueName: \"kubernetes.io/projected/dc5626e8-ee87-4703-b99f-64122274104f-kube-api-access-7z2m9\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314959 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-systemd-units\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.314978 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.315142 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-run\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.315190 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc5626e8-ee87-4703-b99f-64122274104f-env-overrides\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.315230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4vz6\" (UniqueName: \"kubernetes.io/projected/92a43d1c-7093-48d7-9318-89f33464a781-kube-api-access-d4vz6\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.315260 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/92a43d1c-7093-48d7-9318-89f33464a781-run\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.315318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-etc-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.315360 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-ovn\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.315387 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-etc-openvswitch\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.316123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.315482 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc5626e8-ee87-4703-b99f-64122274104f-run-ovn\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.317481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.317442 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc5626e8-ee87-4703-b99f-64122274104f-ovn-node-metrics-cert\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.317585 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.317491 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/92a43d1c-7093-48d7-9318-89f33464a781-etc-tuned\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.317706 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.317684 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92a43d1c-7093-48d7-9318-89f33464a781-tmp\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.326334 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.326267 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvxf5\" (UniqueName: \"kubernetes.io/projected/bfcbc1be-8b62-4992-b7a6-afb5cefd4663-kube-api-access-vvxf5\") pod \"node-resolver-xwb2t\" (UID: \"bfcbc1be-8b62-4992-b7a6-afb5cefd4663\") " pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.327481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.327057 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls4k5\" (UniqueName: \"kubernetes.io/projected/c5c4e04a-9b0d-40f9-9a15-d600e6334fcc-kube-api-access-ls4k5\") pod \"multus-additional-cni-plugins-zwhpx\" (UID: \"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc\") " pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.327481 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.327450 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6zsp\" (UniqueName: \"kubernetes.io/projected/12b20f1c-d297-4a7e-bc1c-2817359a7d21-kube-api-access-g6zsp\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:21.329480 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.329455 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z2m9\" (UniqueName: \"kubernetes.io/projected/dc5626e8-ee87-4703-b99f-64122274104f-kube-api-access-7z2m9\") pod \"ovnkube-node-zp7dp\" (UID: \"dc5626e8-ee87-4703-b99f-64122274104f\") " pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.330124 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.330098 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhhr2\" (UniqueName: \"kubernetes.io/projected/1e002460-a3d1-4ad7-b248-0122b661f22b-kube-api-access-mhhr2\") pod \"node-ca-m94j4\" (UID: \"1e002460-a3d1-4ad7-b248-0122b661f22b\") " pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.330239 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.330163 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4vz6\" (UniqueName: \"kubernetes.io/projected/92a43d1c-7093-48d7-9318-89f33464a781-kube-api-access-d4vz6\") pod \"tuned-vqvwm\" (UID: \"92a43d1c-7093-48d7-9318-89f33464a781\") " pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.356858 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.356829 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:21.398349 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.398109 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" Jul 09 15:26:21.408294 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.408272 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-klq7h" Jul 09 15:26:21.424594 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.424566 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xwb2t" Jul 09 15:26:21.430426 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.430406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pwlbp" Jul 09 15:26:21.437033 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.437012 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:21.448517 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.448496 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-m94j4" Jul 09 15:26:21.455249 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.455228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" Jul 09 15:26:21.475003 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.474980 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" Jul 09 15:26:21.476160 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.476144 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:21.718970 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.718882 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:21.719110 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.718983 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:21.719110 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.719078 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:21.719110 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.719100 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:21.719110 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.719104 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:21.719110 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.719111 2566 projected.go:196] Error preparing data for projected volume kube-api-access-b4r7m for pod openshift-network-diagnostics/network-check-target-wrzr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:21.719330 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.719169 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m podName:47d67b1f-0722-4d14-9ed1-73fbb50aec95 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:22.719153626 +0000 UTC m=+3.998530167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4r7m" (UniqueName: "kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m") pod "network-check-target-wrzr5" (UID: "47d67b1f-0722-4d14-9ed1-73fbb50aec95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:21.719330 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.719185 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret podName:6b15963b-50f4-442b-8872-8858281ab6a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:22.719178921 +0000 UTC m=+3.998555461 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret") pod "global-pull-secret-syncer-px6xd" (UID: "6b15963b-50f4-442b-8872-8858281ab6a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:21.739286 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.739262 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:21.820278 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:21.820225 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:21.820451 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.820390 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:21.820501 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:21.820469 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:22.820446598 +0000 UTC m=+4.099823139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:22.151897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:22.151810 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:21:21 +0000 UTC" deadline="2028-01-31 13:39:15.653286494 +0000 UTC" Jul 09 15:26:22.151897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:22.151886 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13702h12m53.501403678s" Jul 09 15:26:22.296056 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:22.296021 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc5626e8_ee87_4703_b99f_64122274104f.slice/crio-c3041c63a03faba19983c64c236f9882d18dc91740076303267683ba9a338b34 WatchSource:0}: Error finding container c3041c63a03faba19983c64c236f9882d18dc91740076303267683ba9a338b34: Status 404 returned error can't find the container with id c3041c63a03faba19983c64c236f9882d18dc91740076303267683ba9a338b34 Jul 09 15:26:22.299861 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:22.299736 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c4e04a_9b0d_40f9_9a15_d600e6334fcc.slice/crio-044edfaf71b6786be730158ec114ee993021705a6d46484ff15b27260545f20e WatchSource:0}: Error finding container 044edfaf71b6786be730158ec114ee993021705a6d46484ff15b27260545f20e: Status 404 returned error can't find the container with id 044edfaf71b6786be730158ec114ee993021705a6d46484ff15b27260545f20e Jul 09 15:26:22.305669 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:22.305649 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e002460_a3d1_4ad7_b248_0122b661f22b.slice/crio-8c63ced1d42f09c6405291233d948a655b6cb1e54fee46b16ee96e22e905e3d5 WatchSource:0}: Error finding container 8c63ced1d42f09c6405291233d948a655b6cb1e54fee46b16ee96e22e905e3d5: Status 404 returned error can't find the container with id 8c63ced1d42f09c6405291233d948a655b6cb1e54fee46b16ee96e22e905e3d5 Jul 09 15:26:22.307006 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:22.306983 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode360b86c_8026_44a4_975f_00e1bffa4e71.slice/crio-07684481842da7906e5caaa5d14d9312b8207fdb7ad51697ff9aac77c4b06b2c WatchSource:0}: Error finding container 07684481842da7906e5caaa5d14d9312b8207fdb7ad51697ff9aac77c4b06b2c: Status 404 returned error can't find the container with id 07684481842da7906e5caaa5d14d9312b8207fdb7ad51697ff9aac77c4b06b2c Jul 09 15:26:22.307940 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:22.307913 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfcbc1be_8b62_4992_b7a6_afb5cefd4663.slice/crio-ee26451c643851a7c014fb0af2652e06634ea424f4bf0808acfc5921c73fa671 WatchSource:0}: Error finding container ee26451c643851a7c014fb0af2652e06634ea424f4bf0808acfc5921c73fa671: Status 404 returned error can't find the container with id ee26451c643851a7c014fb0af2652e06634ea424f4bf0808acfc5921c73fa671 Jul 09 15:26:22.314461 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:22.314111 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad43bf83_0c58_427c_90a9_efae74ce39ba.slice/crio-6bd3d85efd4ca47467c97ac984b5b2c89a0ddbe9b2b2814a567051be5c8328dd WatchSource:0}: Error finding container 6bd3d85efd4ca47467c97ac984b5b2c89a0ddbe9b2b2814a567051be5c8328dd: Status 404 returned error can't find the container with id 6bd3d85efd4ca47467c97ac984b5b2c89a0ddbe9b2b2814a567051be5c8328dd Jul 09 15:26:22.727443 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:22.727403 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:22.727611 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:22.727463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:22.727611 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:22.727583 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:22.727611 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:22.727582 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:22.727611 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:22.727598 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:22.727859 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:22.727617 2566 projected.go:196] Error preparing data for projected volume kube-api-access-b4r7m for pod openshift-network-diagnostics/network-check-target-wrzr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:22.727859 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:22.727671 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret podName:6b15963b-50f4-442b-8872-8858281ab6a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:24.72764667 +0000 UTC m=+6.007023226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret") pod "global-pull-secret-syncer-px6xd" (UID: "6b15963b-50f4-442b-8872-8858281ab6a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:22.727859 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:22.727692 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m podName:47d67b1f-0722-4d14-9ed1-73fbb50aec95 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:24.727681314 +0000 UTC m=+6.007057869 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4r7m" (UniqueName: "kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m") pod "network-check-target-wrzr5" (UID: "47d67b1f-0722-4d14-9ed1-73fbb50aec95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:22.828396 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:22.828315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:22.828572 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:22.828492 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:22.828644 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:22.828602 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:24.828554999 +0000 UTC m=+6.107931543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:23.152959 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.152829 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:21:21 +0000 UTC" deadline="2028-03-26 14:56:19.037350122 +0000 UTC" Jul 09 15:26:23.152959 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.152873 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15023h29m55.88448306s" Jul 09 15:26:23.261584 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.260974 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:23.261584 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.261027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:23.261584 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:23.261120 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:23.261584 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.261197 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:23.261584 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:23.261310 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:23.261584 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:23.261388 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:23.299875 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.299836 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"c3041c63a03faba19983c64c236f9882d18dc91740076303267683ba9a338b34"} Jul 09 15:26:23.304935 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.304888 2566 generic.go:356] "Generic (PLEG): container finished" podID="a2d22ef15630c0bcf868989aaec4f613" containerID="76257f6c0d6defdc96a250aed9d77094feb83d508f0fe839687dcabc64cbbc1d" exitCode=0 Jul 09 15:26:23.305504 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.305478 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"a2d22ef15630c0bcf868989aaec4f613","Type":"ContainerDied","Data":"76257f6c0d6defdc96a250aed9d77094feb83d508f0fe839687dcabc64cbbc1d"} Jul 09 15:26:23.312605 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.312575 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" event={"ID":"e8289334-1a66-48d2-8034-a7c788e3ec08","Type":"ContainerStarted","Data":"490478da30bf91b26189b9478cacbcc87b10e3e1db729d27eb09637fdd62b19c"} Jul 09 15:26:23.325652 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.325588 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qfmvb" event={"ID":"cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021","Type":"ContainerStarted","Data":"322912497a99a74b42d41e3013525de0e13b6726dd1a1620ba0771af33ea2891"} Jul 09 15:26:23.338983 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.338906 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pwlbp" event={"ID":"ad43bf83-0c58-427c-90a9-efae74ce39ba","Type":"ContainerStarted","Data":"6bd3d85efd4ca47467c97ac984b5b2c89a0ddbe9b2b2814a567051be5c8328dd"} Jul 09 15:26:23.348728 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.348691 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" event={"ID":"92a43d1c-7093-48d7-9318-89f33464a781","Type":"ContainerStarted","Data":"a1b5fef17a91317a36e39c87e9c976172d310b8be91f9ef48feb0e56f6b776a3"} Jul 09 15:26:23.358291 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.358264 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xwb2t" event={"ID":"bfcbc1be-8b62-4992-b7a6-afb5cefd4663","Type":"ContainerStarted","Data":"ee26451c643851a7c014fb0af2652e06634ea424f4bf0808acfc5921c73fa671"} Jul 09 15:26:23.373818 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.373777 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-klq7h" event={"ID":"e360b86c-8026-44a4-975f-00e1bffa4e71","Type":"ContainerStarted","Data":"07684481842da7906e5caaa5d14d9312b8207fdb7ad51697ff9aac77c4b06b2c"} Jul 09 15:26:23.378146 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.377986 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m94j4" event={"ID":"1e002460-a3d1-4ad7-b248-0122b661f22b","Type":"ContainerStarted","Data":"8c63ced1d42f09c6405291233d948a655b6cb1e54fee46b16ee96e22e905e3d5"} Jul 09 15:26:23.380460 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.380349 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" event={"ID":"dca3604df6062d18799a8c635a695b55","Type":"ContainerStarted","Data":"6bfb22866178c59cb688ab447a5f173816f4c0357eb9a258b6a6c32a939d6638"} Jul 09 15:26:23.387851 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:23.387824 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" event={"ID":"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc","Type":"ContainerStarted","Data":"044edfaf71b6786be730158ec114ee993021705a6d46484ff15b27260545f20e"} Jul 09 15:26:24.399901 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:24.399860 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" event={"ID":"a2d22ef15630c0bcf868989aaec4f613","Type":"ContainerStarted","Data":"f68a66665054ca5388a19f87633938779c1eec75cc653c5ea9e19f5ce48e4676"} Jul 09 15:26:24.417111 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:24.417047 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-133.ec2.internal" podStartSLOduration=4.417024503 podStartE2EDuration="4.417024503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:24.416606318 +0000 UTC m=+5.695982897" watchObservedRunningTime="2026-07-09 15:26:24.417024503 +0000 UTC m=+5.696401072" Jul 09 15:26:24.418199 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:24.418047 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-133.ec2.internal" podStartSLOduration=4.418034003 podStartE2EDuration="4.418034003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:23.39715646 +0000 UTC m=+4.676533027" watchObservedRunningTime="2026-07-09 15:26:24.418034003 +0000 UTC m=+5.697410570" Jul 09 15:26:24.746968 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:24.746876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:24.746968 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:24.746947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:24.747216 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:24.747109 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:24.747216 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:24.747126 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:24.747216 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:24.747135 2566 projected.go:196] Error preparing data for projected volume kube-api-access-b4r7m for pod openshift-network-diagnostics/network-check-target-wrzr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:24.747216 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:24.747182 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m podName:47d67b1f-0722-4d14-9ed1-73fbb50aec95 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:28.747169013 +0000 UTC m=+10.026545568 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4r7m" (UniqueName: "kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m") pod "network-check-target-wrzr5" (UID: "47d67b1f-0722-4d14-9ed1-73fbb50aec95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:24.747543 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:24.747524 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:24.747599 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:24.747582 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret podName:6b15963b-50f4-442b-8872-8858281ab6a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:28.747566676 +0000 UTC m=+10.026943232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret") pod "global-pull-secret-syncer-px6xd" (UID: "6b15963b-50f4-442b-8872-8858281ab6a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:24.849670 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:24.849625 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:24.849889 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:24.849874 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:24.849956 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:24.849945 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:28.849924668 +0000 UTC m=+10.129301214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:25.258570 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:25.258534 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:25.258801 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:25.258685 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:25.258897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:25.258826 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:25.258955 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:25.258923 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:25.259008 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:25.258979 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:25.259089 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:25.259071 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:27.259950 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:27.259899 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:27.259950 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:27.259943 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:27.260584 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:27.260017 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:27.260584 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:27.259910 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:27.260584 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:27.260157 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:27.260584 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:27.260250 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:28.783874 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:28.783835 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:28.784311 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:28.783910 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:28.784311 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:28.784034 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:28.784311 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:28.784095 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret podName:6b15963b-50f4-442b-8872-8858281ab6a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:36.784077562 +0000 UTC m=+18.063454117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret") pod "global-pull-secret-syncer-px6xd" (UID: "6b15963b-50f4-442b-8872-8858281ab6a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:28.784311 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:28.784183 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:28.784311 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:28.784201 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:28.784311 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:28.784213 2566 projected.go:196] Error preparing data for projected volume kube-api-access-b4r7m for pod openshift-network-diagnostics/network-check-target-wrzr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:28.784311 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:28.784246 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m podName:47d67b1f-0722-4d14-9ed1-73fbb50aec95 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:36.784236572 +0000 UTC m=+18.063613117 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4r7m" (UniqueName: "kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m") pod "network-check-target-wrzr5" (UID: "47d67b1f-0722-4d14-9ed1-73fbb50aec95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:28.884982 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:28.884945 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:28.885151 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:28.885092 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:28.885200 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:28.885161 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:36.88514122 +0000 UTC m=+18.164517764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:29.259853 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:29.259772 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:29.260024 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:29.259902 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:29.260339 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:29.260321 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:29.260443 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:29.260424 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:29.260603 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:29.260574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:29.260740 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:29.260689 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:31.258673 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:31.258639 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:31.259280 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:31.258785 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:31.259479 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:31.259460 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:31.259573 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:31.259554 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:31.259743 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:31.259638 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:31.259887 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:31.259743 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:33.258845 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:33.258809 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:33.258845 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:33.258832 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:33.259357 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:33.258959 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:33.259357 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:33.258973 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:33.259357 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:33.259077 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:33.259357 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:33.259172 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:35.258462 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:35.258428 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:35.258462 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:35.258451 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:35.258880 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:35.258558 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:35.258880 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:35.258613 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:35.258880 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:35.258651 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:35.258880 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:35.258766 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:36.845982 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:36.845947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:36.846413 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:36.846010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:36.846413 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:36.846116 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:36.846413 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:36.846169 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:36.846413 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:36.846189 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:36.846413 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:36.846203 2566 projected.go:196] Error preparing data for projected volume kube-api-access-b4r7m for pod openshift-network-diagnostics/network-check-target-wrzr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:36.846413 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:36.846192 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret podName:6b15963b-50f4-442b-8872-8858281ab6a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:52.846171435 +0000 UTC m=+34.125547979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret") pod "global-pull-secret-syncer-px6xd" (UID: "6b15963b-50f4-442b-8872-8858281ab6a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:36.846413 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:36.846261 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m podName:47d67b1f-0722-4d14-9ed1-73fbb50aec95 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:52.846245015 +0000 UTC m=+34.125621556 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4r7m" (UniqueName: "kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m") pod "network-check-target-wrzr5" (UID: "47d67b1f-0722-4d14-9ed1-73fbb50aec95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:36.946508 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:36.946468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:36.946680 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:36.946612 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:36.946680 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:36.946680 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:52.946656727 +0000 UTC m=+34.226033266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:37.258498 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:37.258408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:37.258498 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:37.258427 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:37.258733 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:37.258408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:37.258733 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:37.258508 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:37.258733 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:37.258574 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:37.258733 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:37.258661 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:39.260274 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:39.259838 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:39.260274 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:39.259945 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:39.260274 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:39.260048 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:39.260274 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:39.260083 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:39.260274 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:39.260173 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:39.260274 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:39.260263 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:41.258137 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:41.258115 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:41.258406 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:41.258115 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:41.258406 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:41.258226 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:41.258406 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:41.258313 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:41.258406 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:41.258115 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:41.258544 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:41.258426 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:42.442081 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.441635 2566 generic.go:356] "Generic (PLEG): container finished" podID="c5c4e04a-9b0d-40f9-9a15-d600e6334fcc" containerID="7e148383546c36e8ca3bc4c3a63332d45aa644290f8506e98f3e16378e90f7fe" exitCode=0 Jul 09 15:26:42.442081 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.441735 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" event={"ID":"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc","Type":"ContainerDied","Data":"7e148383546c36e8ca3bc4c3a63332d45aa644290f8506e98f3e16378e90f7fe"} Jul 09 15:26:42.444979 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.444959 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:26:42.445324 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.445295 2566 generic.go:356] "Generic (PLEG): container finished" podID="dc5626e8-ee87-4703-b99f-64122274104f" containerID="3159a15accc6b369997dc0b6d7a67248984f2abc93154ecfeb8324f96be4dcac" exitCode=1 Jul 09 15:26:42.445396 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.445360 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"c6af3d35681432857335d842aee253bbb3810ad97938716b8f6a70493c43e210"} Jul 09 15:26:42.445451 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.445428 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"b7476e66c23199879529edf82c9dbe56021cbeab64a568b707562a4197e2f0d7"} Jul 09 15:26:42.445502 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.445461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"84ad63011d3f76c0df0849c4b38b0aca485bb178dc7afe3bd51eae21d18fd634"} Jul 09 15:26:42.445502 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.445498 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"60918293f681ba63e154d1dffc3248b095ee7aed23a810442c0eba20db7c4af0"} Jul 09 15:26:42.445594 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.445538 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerDied","Data":"3159a15accc6b369997dc0b6d7a67248984f2abc93154ecfeb8324f96be4dcac"} Jul 09 15:26:42.445594 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.445574 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"4c3539eba831e8f787aced7011261c959b609c21ba4fd2fd2e18618d7ef55626"} Jul 09 15:26:42.446734 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.446696 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" event={"ID":"e8289334-1a66-48d2-8034-a7c788e3ec08","Type":"ContainerStarted","Data":"624e19be949aa75b47f4796091a0be589867ba8b13663e4685fc0151ad9ea7e4"} Jul 09 15:26:42.448236 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.448209 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qfmvb" event={"ID":"cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021","Type":"ContainerStarted","Data":"ba7f4fb5f296b531786af7cfe8bfd459fe2779e30f411fcf63e568a73981121c"} Jul 09 15:26:42.449605 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.449579 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" event={"ID":"92a43d1c-7093-48d7-9318-89f33464a781","Type":"ContainerStarted","Data":"a27e6aea2cbf7ef7c28025fd03f9c41542e8ef1f1da3ec0b106516a41cd47287"} Jul 09 15:26:42.450833 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.450812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xwb2t" event={"ID":"bfcbc1be-8b62-4992-b7a6-afb5cefd4663","Type":"ContainerStarted","Data":"ee69fdb38ac7b28bbc165faf0a82f5fe11866f9104d74b0aec73f8bb56582493"} Jul 09 15:26:42.452165 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.452146 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-klq7h" event={"ID":"e360b86c-8026-44a4-975f-00e1bffa4e71","Type":"ContainerStarted","Data":"a518098fc60a3039a8661cc45d0f0c498c44564c36f5b813c7e774d534c8b9ce"} Jul 09 15:26:42.453405 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.453389 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-m94j4" event={"ID":"1e002460-a3d1-4ad7-b248-0122b661f22b","Type":"ContainerStarted","Data":"54e2a6108ea02ada44b0a760e614a868bb09e84db3c6cfa01288d35104182c70"} Jul 09 15:26:42.478465 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.478422 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qfmvb" podStartSLOduration=4.402471627 podStartE2EDuration="23.478407621s" totalImagesPullingTime="19.075935994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:42.478156386 +0000 UTC m=+23.757532947" watchObservedRunningTime="2026-07-09 15:26:42.478407621 +0000 UTC m=+23.757784181" Jul 09 15:26:42.506395 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.506359 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-m94j4" podStartSLOduration=4.419101617 podStartE2EDuration="23.506346357s" totalImagesPullingTime="19.08724474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:42.492265395 +0000 UTC m=+23.771641957" watchObservedRunningTime="2026-07-09 15:26:42.506346357 +0000 UTC m=+23.785722918" Jul 09 15:26:42.506627 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.506609 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xwb2t" podStartSLOduration=4.380748083 podStartE2EDuration="23.506604519s" totalImagesPullingTime="19.125856436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:42.506089996 +0000 UTC m=+23.785466556" watchObservedRunningTime="2026-07-09 15:26:42.506604519 +0000 UTC m=+23.785981078" Jul 09 15:26:42.521575 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.521541 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vqvwm" podStartSLOduration=4.442066637 podStartE2EDuration="23.521528835s" totalImagesPullingTime="19.079462198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:42.521456509 +0000 UTC m=+23.800833084" watchObservedRunningTime="2026-07-09 15:26:42.521528835 +0000 UTC m=+23.800905395" Jul 09 15:26:42.705439 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.705397 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:42.715435 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.715414 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 15:26:42.776866 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.776839 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:42.876579 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:42.876550 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:43.164625 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.164513 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T15:26:42.715429223Z","UUID":"c599c182-00ba-4932-b60b-260f6c99da43","Handler":null,"Name":"","Endpoint":""} Jul 09 15:26:43.167897 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.167869 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 15:26:43.168025 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.167914 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 15:26:43.259638 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.259609 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:43.259829 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.259695 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:43.259829 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:43.259811 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:43.259911 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.259850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:43.259953 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:43.259923 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:43.260348 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:43.260322 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:43.392660 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.392622 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:43.448320 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.448238 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:43.459083 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.459049 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" event={"ID":"e8289334-1a66-48d2-8034-a7c788e3ec08","Type":"ContainerStarted","Data":"cb3c0752e816f320f1edc0b338690f009233cfc68db591b9cd9c5412b39ee878"} Jul 09 15:26:43.460884 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.460847 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pwlbp" event={"ID":"ad43bf83-0c58-427c-90a9-efae74ce39ba","Type":"ContainerStarted","Data":"08884c1499d5ec361f7acc07a9a1306d11efbdb8b66ff799d67af52ef732124c"} Jul 09 15:26:43.478781 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.478730 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-klq7h" podStartSLOduration=5.3193354809999995 podStartE2EDuration="24.478694103s" totalImagesPullingTime="19.159358622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:42.547380097 +0000 UTC m=+23.826756657" watchObservedRunningTime="2026-07-09 15:26:43.478694103 +0000 UTC m=+24.758070665" Jul 09 15:26:43.549622 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.549582 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:43.649663 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:43.649628 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:44.011673 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.011639 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:44.066269 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.066243 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:44.285600 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.285573 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:44.387376 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.387333 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:44.465494 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.465459 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" event={"ID":"e8289334-1a66-48d2-8034-a7c788e3ec08","Type":"ContainerStarted","Data":"ee3074768bf2c7fc620f6fc160b4c0827c9577846caa2f9adbf34440f890afdf"} Jul 09 15:26:44.468569 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.468544 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:26:44.468907 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.468889 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"835bd1770dc677aaeff93091bcec3a6e7b0c83645430f15531071c45880749a6"} Jul 09 15:26:44.489309 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.489264 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pwlbp" podStartSLOduration=6.370948761 podStartE2EDuration="25.489251003s" totalImagesPullingTime="19.118302242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:43.479138706 +0000 UTC m=+24.758515267" watchObservedRunningTime="2026-07-09 15:26:44.489251003 +0000 UTC m=+25.768627563" Jul 09 15:26:44.489445 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.489371 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gqd5p" podStartSLOduration=4.442947738 podStartE2EDuration="25.489363051s" totalImagesPullingTime="21.046415313s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:44.488506132 +0000 UTC m=+25.767882715" watchObservedRunningTime="2026-07-09 15:26:44.489363051 +0000 UTC m=+25.768739611" Jul 09 15:26:44.824012 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.823974 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:44.899624 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.899590 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:44.922530 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.922500 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:44.923052 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:44.923031 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:45.220492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.220259 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:45.258411 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.258385 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:45.258593 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.258385 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:45.258593 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:45.258501 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:45.258593 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.258385 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:45.258593 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:45.258581 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:45.258828 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:45.258632 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:45.322010 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.321975 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:45.444559 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.444524 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:45.471619 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.471511 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:45.472225 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.472206 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qfmvb" Jul 09 15:26:45.545829 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.545798 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:45.648770 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:45.648736 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:46.017640 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:46.017596 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:46.396058 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:46.396028 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:46.459595 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:46.459526 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:47.258267 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:47.258089 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:47.258904 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:47.258098 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:47.258904 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:47.258348 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:47.258904 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:47.258430 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:47.258904 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:47.258158 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:47.258904 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:47.258509 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:47.476335 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:47.476256 2566 generic.go:356] "Generic (PLEG): container finished" podID="c5c4e04a-9b0d-40f9-9a15-d600e6334fcc" containerID="251e57f5578d1809debb753ade5f9e4e6da4033ce4f402985dc3fda395f1b7ff" exitCode=0 Jul 09 15:26:47.476335 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:47.476301 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" event={"ID":"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc","Type":"ContainerDied","Data":"251e57f5578d1809debb753ade5f9e4e6da4033ce4f402985dc3fda395f1b7ff"} Jul 09 15:26:47.479777 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:47.479759 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:26:47.480306 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:47.480222 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"7393da6f305d86d6a3452f7f5a1fb09755fa010894a35640018dd2fe630b524d"} Jul 09 15:26:47.480643 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:47.480628 2566 scope.go:117] "RemoveContainer" containerID="3159a15accc6b369997dc0b6d7a67248984f2abc93154ecfeb8324f96be4dcac" Jul 09 15:26:48.486243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.486218 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:26:48.486672 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.486580 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" event={"ID":"dc5626e8-ee87-4703-b99f-64122274104f","Type":"ContainerStarted","Data":"8f3522c5af5c380b77c5d2bc15d7e2851759dfa22887f145528f6d085ab9abe6"} Jul 09 15:26:48.486841 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.486819 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:48.486997 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.486983 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:48.487050 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.487035 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:48.502205 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.502179 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:48.502350 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.502317 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:26:48.522631 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.522586 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" podStartSLOduration=10.365424288 podStartE2EDuration="29.522572109s" totalImagesPullingTime="19.157147821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:48.520786008 +0000 UTC m=+29.800162586" watchObservedRunningTime="2026-07-09 15:26:48.522572109 +0000 UTC m=+29.801948669" Jul 09 15:26:48.891918 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.891885 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-px6xd"] Jul 09 15:26:48.892125 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.891990 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:48.892125 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:48.892082 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:48.895290 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.895256 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxqzz"] Jul 09 15:26:48.895423 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.895381 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:48.895511 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:48.895493 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:48.895947 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.895924 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrzr5"] Jul 09 15:26:48.896039 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:48.896027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:48.896125 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:48.896104 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:49.490854 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:49.490821 2566 generic.go:356] "Generic (PLEG): container finished" podID="c5c4e04a-9b0d-40f9-9a15-d600e6334fcc" containerID="ba148d77b324d4b455b7904afb74f2ae763ff6cf8a0bb52c51a572df27f8a16e" exitCode=0 Jul 09 15:26:49.491414 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:49.490913 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" event={"ID":"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc","Type":"ContainerDied","Data":"ba148d77b324d4b455b7904afb74f2ae763ff6cf8a0bb52c51a572df27f8a16e"} Jul 09 15:26:50.258527 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:50.258502 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:50.258625 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:50.258532 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:50.258625 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:50.258537 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:50.258625 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:50.258595 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:50.258796 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:50.258722 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:50.258849 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:50.258823 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:50.495627 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:50.495593 2566 generic.go:356] "Generic (PLEG): container finished" podID="c5c4e04a-9b0d-40f9-9a15-d600e6334fcc" containerID="5d5a972263ace18e9fd5d70ead4de7f15689ff7235c1fd6d7aa0ae4b85a8739b" exitCode=0 Jul 09 15:26:50.496025 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:50.495684 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" event={"ID":"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc","Type":"ContainerDied","Data":"5d5a972263ace18e9fd5d70ead4de7f15689ff7235c1fd6d7aa0ae4b85a8739b"} Jul 09 15:26:52.258739 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:52.258690 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:52.258739 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:52.258758 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:52.259412 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:52.258820 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:52.259412 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.258837 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:52.259412 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.258893 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:52.259412 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.258980 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:52.859958 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:52.859920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:52.860151 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:52.859984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:52.860151 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.860088 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:52.860151 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.860146 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:52.860315 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.860165 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:52.860315 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.860176 2566 projected.go:196] Error preparing data for projected volume kube-api-access-b4r7m for pod openshift-network-diagnostics/network-check-target-wrzr5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:52.860315 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.860165 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret podName:6b15963b-50f4-442b-8872-8858281ab6a4 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:24.860144589 +0000 UTC m=+66.139521142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret") pod "global-pull-secret-syncer-px6xd" (UID: "6b15963b-50f4-442b-8872-8858281ab6a4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:52.860315 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.860236 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m podName:47d67b1f-0722-4d14-9ed1-73fbb50aec95 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:24.860220923 +0000 UTC m=+66.139597462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b4r7m" (UniqueName: "kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m") pod "network-check-target-wrzr5" (UID: "47d67b1f-0722-4d14-9ed1-73fbb50aec95") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:52.960864 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:52.960829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:52.961041 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.960995 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:52.961105 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:52.961064 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:24.961046488 +0000 UTC m=+66.240423054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:54.259080 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.259046 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:54.259080 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.259065 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:54.259080 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.259052 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:54.259660 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:54.259172 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wrzr5" podUID="47d67b1f-0722-4d14-9ed1-73fbb50aec95" Jul 09 15:26:54.259660 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:54.259215 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:26:54.259660 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:54.259292 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-px6xd" podUID="6b15963b-50f4-442b-8872-8858281ab6a4" Jul 09 15:26:54.533318 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.533297 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-133.ec2.internal" event="NodeReady" Jul 09 15:26:54.533438 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.533426 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 15:26:54.584606 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.584582 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xzvk5"] Jul 09 15:26:54.587881 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.587866 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rp5sk"] Jul 09 15:26:54.588032 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.588012 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.590076 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.590058 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rp5sk" Jul 09 15:26:54.590523 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.590508 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 15:26:54.590613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.590525 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 15:26:54.590613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.590585 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fhd5m\"" Jul 09 15:26:54.592209 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.592187 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 15:26:54.592335 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.592312 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 15:26:54.593825 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.593775 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rb4ng\"" Jul 09 15:26:54.593974 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.593835 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 15:26:54.597315 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.597294 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xzvk5"] Jul 09 15:26:54.598025 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.598004 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rp5sk"] Jul 09 15:26:54.674096 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.674076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-tmp-dir\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.674180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.674125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6111a94-30ad-4ecb-89b2-774cc73e7282-cert\") pod \"ingress-canary-rp5sk\" (UID: \"a6111a94-30ad-4ecb-89b2-774cc73e7282\") " pod="openshift-ingress-canary/ingress-canary-rp5sk" Jul 09 15:26:54.674180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.674145 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h99k\" (UniqueName: \"kubernetes.io/projected/a6111a94-30ad-4ecb-89b2-774cc73e7282-kube-api-access-7h99k\") pod \"ingress-canary-rp5sk\" (UID: \"a6111a94-30ad-4ecb-89b2-774cc73e7282\") " pod="openshift-ingress-canary/ingress-canary-rp5sk" Jul 09 15:26:54.674323 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.674298 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9g4w\" (UniqueName: \"kubernetes.io/projected/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-kube-api-access-n9g4w\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.674358 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.674341 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-config-volume\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.674397 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.674384 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.714150 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.714113 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:54.774740 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.774667 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.774740 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.774726 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-tmp-dir\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.774927 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.774776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6111a94-30ad-4ecb-89b2-774cc73e7282-cert\") pod \"ingress-canary-rp5sk\" (UID: \"a6111a94-30ad-4ecb-89b2-774cc73e7282\") " pod="openshift-ingress-canary/ingress-canary-rp5sk" Jul 09 15:26:54.774927 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.774795 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h99k\" (UniqueName: \"kubernetes.io/projected/a6111a94-30ad-4ecb-89b2-774cc73e7282-kube-api-access-7h99k\") pod \"ingress-canary-rp5sk\" (UID: \"a6111a94-30ad-4ecb-89b2-774cc73e7282\") " pod="openshift-ingress-canary/ingress-canary-rp5sk" Jul 09 15:26:54.774927 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:54.774844 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:54.774927 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.774856 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9g4w\" (UniqueName: \"kubernetes.io/projected/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-kube-api-access-n9g4w\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.774927 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.774875 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-config-volume\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.774927 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:54.774904 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:26:55.274885951 +0000 UTC m=+36.554262490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:26:54.775213 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.775118 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-tmp-dir\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.775393 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.775369 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-config-volume\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.775504 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.775365 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:54.779079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.779057 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6111a94-30ad-4ecb-89b2-774cc73e7282-cert\") pod \"ingress-canary-rp5sk\" (UID: \"a6111a94-30ad-4ecb-89b2-774cc73e7282\") " pod="openshift-ingress-canary/ingress-canary-rp5sk" Jul 09 15:26:54.783758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.783733 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9g4w\" (UniqueName: \"kubernetes.io/projected/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-kube-api-access-n9g4w\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:54.783915 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.783898 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h99k\" (UniqueName: \"kubernetes.io/projected/a6111a94-30ad-4ecb-89b2-774cc73e7282-kube-api-access-7h99k\") pod \"ingress-canary-rp5sk\" (UID: \"a6111a94-30ad-4ecb-89b2-774cc73e7282\") " pod="openshift-ingress-canary/ingress-canary-rp5sk" Jul 09 15:26:54.905780 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:54.905747 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rp5sk" Jul 09 15:26:55.087972 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:55.087807 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rp5sk"] Jul 09 15:26:55.091647 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:26:55.091620 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6111a94_30ad_4ecb_89b2_774cc73e7282.slice/crio-40afd0b95647ebd5c54972518c6fbcba4b294d953479cdd9e90d8c987df88b8a WatchSource:0}: Error finding container 40afd0b95647ebd5c54972518c6fbcba4b294d953479cdd9e90d8c987df88b8a: Status 404 returned error can't find the container with id 40afd0b95647ebd5c54972518c6fbcba4b294d953479cdd9e90d8c987df88b8a Jul 09 15:26:55.279179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:55.279151 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:55.279674 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:55.279302 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:55.279674 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:55.279366 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:26:56.279347434 +0000 UTC m=+37.558723973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:26:55.509627 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:55.509598 2566 generic.go:356] "Generic (PLEG): container finished" podID="c5c4e04a-9b0d-40f9-9a15-d600e6334fcc" containerID="8110baa94c7021d352a4bda7a71353f3654648589597530fc01997a7f387420a" exitCode=0 Jul 09 15:26:55.509837 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:55.509686 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" event={"ID":"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc","Type":"ContainerDied","Data":"8110baa94c7021d352a4bda7a71353f3654648589597530fc01997a7f387420a"} Jul 09 15:26:55.510785 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:55.510766 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rp5sk" event={"ID":"a6111a94-30ad-4ecb-89b2-774cc73e7282","Type":"ContainerStarted","Data":"40afd0b95647ebd5c54972518c6fbcba4b294d953479cdd9e90d8c987df88b8a"} Jul 09 15:26:56.130845 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.130809 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:56.192544 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.192513 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:56.258763 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.258729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:26:56.258763 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.258757 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:26:56.259016 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.258762 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:26:56.261659 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.261638 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:26:56.264002 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.263697 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:26:56.264002 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.263790 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sq7lb\"" Jul 09 15:26:56.264002 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.263892 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:26:56.264170 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.264073 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5gmbc\"" Jul 09 15:26:56.264262 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.264247 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:26:56.287388 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.287366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:56.287699 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:56.287506 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:56.287699 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:56.287561 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:26:58.287546617 +0000 UTC m=+39.566923159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:26:56.516567 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.516531 2566 generic.go:356] "Generic (PLEG): container finished" podID="c5c4e04a-9b0d-40f9-9a15-d600e6334fcc" containerID="84f457da8797f24e4400857a1c3da857f1730c2bdc53ce4f747590729be853dd" exitCode=0 Jul 09 15:26:56.516778 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:56.516579 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" event={"ID":"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc","Type":"ContainerDied","Data":"84f457da8797f24e4400857a1c3da857f1730c2bdc53ce4f747590729be853dd"} Jul 09 15:26:57.523562 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:57.523528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" event={"ID":"c5c4e04a-9b0d-40f9-9a15-d600e6334fcc","Type":"ContainerStarted","Data":"d55a550585eea2fa6e10becd1c8b9b0125d4d957894c9cbaa5a1f489d46a7194"} Jul 09 15:26:57.550938 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:57.550878 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zwhpx" podStartSLOduration=8.909274205 podStartE2EDuration="38.550862383s" totalImagesPullingTime="29.641588178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:57.549116265 +0000 UTC m=+38.828492850" watchObservedRunningTime="2026-07-09 15:26:57.550862383 +0000 UTC m=+38.830238934" Jul 09 15:26:57.680144 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:57.680110 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:57.780080 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:57.780004 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:58.304801 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:58.304601 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:26:58.304934 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:58.304768 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:58.304968 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:26:58.304936 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:27:02.304919207 +0000 UTC m=+43.584295767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:26:58.527769 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:58.527738 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rp5sk" event={"ID":"a6111a94-30ad-4ecb-89b2-774cc73e7282","Type":"ContainerStarted","Data":"7d06d6d7bf5fef0eef02a0d53b4720f8a091e4df463a579abb7ef21ef744e10b"} Jul 09 15:26:58.549306 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:58.549253 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rp5sk" podStartSLOduration=1.831022692 podStartE2EDuration="4.549237095s" totalImagesPullingTime="2.718214403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:58.548479224 +0000 UTC m=+39.827855809" watchObservedRunningTime="2026-07-09 15:26:58.549237095 +0000 UTC m=+39.828613686" Jul 09 15:26:59.512649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:59.512617 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:26:59.612382 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:26:59.612355 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:00.237964 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:00.237935 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:00.338251 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:00.338223 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:00.606812 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:00.606781 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:00.706827 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:00.706802 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:02.335911 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:02.335865 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:27:02.336380 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:02.336057 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:02.336380 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:02.336144 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:27:10.336122154 +0000 UTC m=+51.615498696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:27:06.069700 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:06.069667 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:06.170058 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:06.170026 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:10.393136 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:10.393100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:27:10.393523 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:10.393270 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:10.393523 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:10.393346 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:27:26.393331041 +0000 UTC m=+67.672707580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:27:20.506297 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:20.506270 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zp7dp" Jul 09 15:27:20.669540 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:20.669507 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:20.727344 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:20.727313 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:21.459157 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:21.459125 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:21.518792 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:21.518683 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:21.580005 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:21.579961 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:24.893415 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.893378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:27:24.893809 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.893451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:27:24.895931 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.895910 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:27:24.896021 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.896004 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:27:24.906510 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.906491 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:27:24.908019 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.908000 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6b15963b-50f4-442b-8872-8858281ab6a4-original-pull-secret\") pod \"global-pull-secret-syncer-px6xd\" (UID: \"6b15963b-50f4-442b-8872-8858281ab6a4\") " pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:27:24.917332 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.917309 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4r7m\" (UniqueName: \"kubernetes.io/projected/47d67b1f-0722-4d14-9ed1-73fbb50aec95-kube-api-access-b4r7m\") pod \"network-check-target-wrzr5\" (UID: \"47d67b1f-0722-4d14-9ed1-73fbb50aec95\") " pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:27:24.994424 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.994399 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:27:24.996891 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:24.996874 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:27:25.004899 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:25.004885 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 15:27:25.004965 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:25.004955 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:28:29.00493572 +0000 UTC m=+130.284312276 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : secret "metrics-daemon-secret" not found Jul 09 15:27:25.073129 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:25.073109 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5gmbc\"" Jul 09 15:27:25.081123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:25.081102 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:27:25.083407 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:25.083392 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-px6xd" Jul 09 15:27:25.242883 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:25.242847 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wrzr5"] Jul 09 15:27:25.246169 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:27:25.246148 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d67b1f_0722_4d14_9ed1_73fbb50aec95.slice/crio-093e60ac3189873071db7c4ed13e5690316b8f58e4c14a60aeb18a12a604b497 WatchSource:0}: Error finding container 093e60ac3189873071db7c4ed13e5690316b8f58e4c14a60aeb18a12a604b497: Status 404 returned error can't find the container with id 093e60ac3189873071db7c4ed13e5690316b8f58e4c14a60aeb18a12a604b497 Jul 09 15:27:25.257586 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:25.257558 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-px6xd"] Jul 09 15:27:25.262830 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:27:25.262802 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b15963b_50f4_442b_8872_8858281ab6a4.slice/crio-9b21c7b1dd0e35c7e2347a79007d41d32aba4b0380f8c9989963f84eb7b0507c WatchSource:0}: Error finding container 9b21c7b1dd0e35c7e2347a79007d41d32aba4b0380f8c9989963f84eb7b0507c: Status 404 returned error can't find the container with id 9b21c7b1dd0e35c7e2347a79007d41d32aba4b0380f8c9989963f84eb7b0507c Jul 09 15:27:25.594405 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:25.594370 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-px6xd" event={"ID":"6b15963b-50f4-442b-8872-8858281ab6a4","Type":"ContainerStarted","Data":"9b21c7b1dd0e35c7e2347a79007d41d32aba4b0380f8c9989963f84eb7b0507c"} Jul 09 15:27:25.595522 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:25.595500 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrzr5" event={"ID":"47d67b1f-0722-4d14-9ed1-73fbb50aec95","Type":"ContainerStarted","Data":"093e60ac3189873071db7c4ed13e5690316b8f58e4c14a60aeb18a12a604b497"} Jul 09 15:27:26.403579 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:26.403540 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:27:26.404056 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:26.403735 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:26.404056 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:26.403834 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:27:58.403812671 +0000 UTC m=+99.683189224 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:27:28.605791 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:28.605752 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wrzr5" event={"ID":"47d67b1f-0722-4d14-9ed1-73fbb50aec95","Type":"ContainerStarted","Data":"b62c361cb8aa88afe100d8ad8053a806f95eb526d8ef1fdb95215b1caa2c44b5"} Jul 09 15:27:28.606179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:28.605898 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:27:30.612670 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:30.612633 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-px6xd" event={"ID":"6b15963b-50f4-442b-8872-8858281ab6a4","Type":"ContainerStarted","Data":"7265c56905cfc80a10ef6a35437931c3cd0c1b37638c6cd5efd5186fcbeeb97d"} Jul 09 15:27:30.628876 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:30.628823 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-px6xd" podStartSLOduration=66.886272953 podStartE2EDuration="1m11.628804751s" totalImagesPullingTime="4.742531798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:30.62859622 +0000 UTC m=+71.907972793" watchObservedRunningTime="2026-07-09 15:27:30.628804751 +0000 UTC m=+71.908181309" Jul 09 15:27:30.629098 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:30.629075 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wrzr5" podStartSLOduration=68.438854587 podStartE2EDuration="1m11.629066326s" totalImagesPullingTime="3.190211739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:28.622808338 +0000 UTC m=+69.902184911" watchObservedRunningTime="2026-07-09 15:27:30.629066326 +0000 UTC m=+71.908442886" Jul 09 15:27:35.293806 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:35.293777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:27:58.421262 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:58.421220 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:27:58.421652 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:58.421345 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:58.421652 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:27:58.421405 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:29:02.42138913 +0000 UTC m=+163.700765669 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:27:59.611348 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:27:59.611312 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wrzr5" Jul 09 15:28:29.018142 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:28:29.018111 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:28:29.018591 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:28:29.018245 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 15:28:29.018591 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:28:29.018311 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs podName:12b20f1c-d297-4a7e-bc1c-2817359a7d21 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:31.018294875 +0000 UTC m=+252.297671421 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs") pod "network-metrics-daemon-mxqzz" (UID: "12b20f1c-d297-4a7e-bc1c-2817359a7d21") : secret "metrics-daemon-secret" not found Jul 09 15:28:57.598945 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:28:57.598895 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xzvk5" podUID="ff2dedf4-d7c0-42c7-a274-7d13ac2fffae" Jul 09 15:28:57.820526 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:28:57.820498 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzvk5" Jul 09 15:28:59.277417 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:28:59.277381 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mxqzz" podUID="12b20f1c-d297-4a7e-bc1c-2817359a7d21" Jul 09 15:29:02.437790 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:29:02.437733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:29:02.438264 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:29:02.437893 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:29:02.438264 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:29:02.437964 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls podName:ff2dedf4-d7c0-42c7-a274-7d13ac2fffae nodeName:}" failed. No retries permitted until 2026-07-09 15:31:04.43794811 +0000 UTC m=+285.717324650 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls") pod "dns-default-xzvk5" (UID: "ff2dedf4-d7c0-42c7-a274-7d13ac2fffae") : secret "dns-default-metrics-tls" not found Jul 09 15:29:13.261235 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:29:13.261159 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:29:16.125124 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:29:16.125088 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:29:22.179075 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:29:22.179020 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:10.066066 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.066031 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf"] Jul 09 15:30:10.068011 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.067989 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-mc4kb"] Jul 09 15:30:10.068133 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.068102 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf" Jul 09 15:30:10.069507 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.069490 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7957579588-skgs8"] Jul 09 15:30:10.069637 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.069620 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.070474 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.070452 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-frllw\"" Jul 09 15:30:10.070569 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.070546 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 15:30:10.070874 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.070859 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:10.071191 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.071173 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.072467 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.072452 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 15:30:10.072758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.072745 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:10.073441 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.073424 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 15:30:10.073574 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.073435 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w7x96\"" Jul 09 15:30:10.073644 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.073474 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 15:30:10.073644 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.073520 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 15:30:10.073776 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.073666 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gfwf2\"" Jul 09 15:30:10.073835 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.073817 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 15:30:10.075334 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.075149 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 15:30:10.081030 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.081002 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 15:30:10.084680 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.084658 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf"] Jul 09 15:30:10.085524 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.085505 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mc4kb"] Jul 09 15:30:10.087080 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.087061 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 15:30:10.088940 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.088894 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7957579588-skgs8"] Jul 09 15:30:10.157120 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.157088 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6"] Jul 09 15:30:10.159029 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.159013 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.163069 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.163039 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 15:30:10.163069 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.163063 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:10.163270 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.163092 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-75xcq\"" Jul 09 15:30:10.163270 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.163121 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 15:30:10.163270 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.163235 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 15:30:10.168306 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.168286 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-596f7d568b-gv49z"] Jul 09 15:30:10.170127 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.170113 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.172557 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.172535 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6"] Jul 09 15:30:10.175140 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.175121 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 09 15:30:10.175329 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.175126 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 09 15:30:10.175420 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.175228 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 09 15:30:10.175490 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.175310 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 09 15:30:10.175614 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.175598 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 15:30:10.175743 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.175650 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 15:30:10.176231 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.176188 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p529s\"" Jul 09 15:30:10.176868 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.176850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9df66703-4718-4815-9965-a29acaa970c6-trusted-ca\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.176967 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.176874 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.176967 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.176890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d77tm\" (UniqueName: \"kubernetes.io/projected/da174c21-04fa-4b77-98ac-1f7c7ed2de80-kube-api-access-d77tm\") pod \"volume-data-source-validator-78495597f6-t8wvf\" (UID: \"da174c21-04fa-4b77-98ac-1f7c7ed2de80\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf" Jul 09 15:30:10.176967 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.176955 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9df66703-4718-4815-9965-a29acaa970c6-config\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.177092 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9df66703-4718-4815-9965-a29acaa970c6-serving-cert\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.177092 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177034 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98829171-73ea-410b-a9de-1bee8a53a3a5-ca-trust-extracted\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.177092 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177053 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-certificates\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.177092 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177078 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5r5v\" (UniqueName: \"kubernetes.io/projected/9df66703-4718-4815-9965-a29acaa970c6-kube-api-access-q5r5v\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.177303 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grwg7\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-kube-api-access-grwg7\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.177303 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e707eba-5a8c-4086-9a05-cbb66791b425-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.177303 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177193 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-installation-pull-secrets\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.177303 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177224 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-image-registry-private-configuration\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.177303 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdz2v\" (UniqueName: \"kubernetes.io/projected/2e707eba-5a8c-4086-9a05-cbb66791b425-kube-api-access-fdz2v\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.177303 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177286 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e707eba-5a8c-4086-9a05-cbb66791b425-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.177579 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177312 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-trusted-ca\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.177579 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.177337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-bound-sa-token\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.193843 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.193822 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-596f7d568b-gv49z"] Jul 09 15:30:10.277573 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-bound-sa-token\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.277669 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277579 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9df66703-4718-4815-9965-a29acaa970c6-trusted-ca\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.277669 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d77tm\" (UniqueName: \"kubernetes.io/projected/da174c21-04fa-4b77-98ac-1f7c7ed2de80-kube-api-access-d77tm\") pod \"volume-data-source-validator-78495597f6-t8wvf\" (UID: \"da174c21-04fa-4b77-98ac-1f7c7ed2de80\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf" Jul 09 15:30:10.277669 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277630 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-default-certificate\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.277854 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277696 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-installation-pull-secrets\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.277854 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9df66703-4718-4815-9965-a29acaa970c6-config\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.277854 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277789 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5r5v\" (UniqueName: \"kubernetes.io/projected/9df66703-4718-4815-9965-a29acaa970c6-kube-api-access-q5r5v\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.277854 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98829171-73ea-410b-a9de-1bee8a53a3a5-ca-trust-extracted\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.277854 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grwg7\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-kube-api-access-grwg7\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277886 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdz2v\" (UniqueName: \"kubernetes.io/projected/2e707eba-5a8c-4086-9a05-cbb66791b425-kube-api-access-fdz2v\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277919 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-trusted-ca\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277949 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5crfc\" (UniqueName: \"kubernetes.io/projected/6928f790-cc79-4d08-bbf4-3a48557d079d-kube-api-access-5crfc\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.277976 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278000 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-stats-auth\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278032 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278059 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-certificates\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278084 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.278143 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9df66703-4718-4815-9965-a29acaa970c6-serving-cert\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.278581 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e707eba-5a8c-4086-9a05-cbb66791b425-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.278581 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278215 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98829171-73ea-410b-a9de-1bee8a53a3a5-ca-trust-extracted\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.278581 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278296 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-image-registry-private-configuration\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.278581 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278476 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9df66703-4718-4815-9965-a29acaa970c6-config\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.278581 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278547 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e707eba-5a8c-4086-9a05-cbb66791b425-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.278849 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278681 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9df66703-4718-4815-9965-a29acaa970c6-trusted-ca\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.278849 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.278696 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2e707eba-5a8c-4086-9a05-cbb66791b425-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.278849 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.278789 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:10.278849 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.278802 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957579588-skgs8: secret "image-registry-tls" not found Jul 09 15:30:10.279081 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.278855 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls podName:98829171-73ea-410b-a9de-1bee8a53a3a5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:10.778839105 +0000 UTC m=+232.058215646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls") pod "image-registry-7957579588-skgs8" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5") : secret "image-registry-tls" not found Jul 09 15:30:10.279331 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.279210 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-certificates\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.279430 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.279353 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-trusted-ca\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.280623 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.280604 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-installation-pull-secrets\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.280801 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.280784 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9df66703-4718-4815-9965-a29acaa970c6-serving-cert\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.281285 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.281264 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2e707eba-5a8c-4086-9a05-cbb66791b425-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.281474 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.281456 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-image-registry-private-configuration\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.289211 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.289178 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-bound-sa-token\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.289582 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.289562 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d77tm\" (UniqueName: \"kubernetes.io/projected/da174c21-04fa-4b77-98ac-1f7c7ed2de80-kube-api-access-d77tm\") pod \"volume-data-source-validator-78495597f6-t8wvf\" (UID: \"da174c21-04fa-4b77-98ac-1f7c7ed2de80\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf" Jul 09 15:30:10.289649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.289583 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5r5v\" (UniqueName: \"kubernetes.io/projected/9df66703-4718-4815-9965-a29acaa970c6-kube-api-access-q5r5v\") pod \"console-operator-7866497494-mc4kb\" (UID: \"9df66703-4718-4815-9965-a29acaa970c6\") " pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.289649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.289586 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grwg7\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-kube-api-access-grwg7\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.289784 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.289767 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdz2v\" (UniqueName: \"kubernetes.io/projected/2e707eba-5a8c-4086-9a05-cbb66791b425-kube-api-access-fdz2v\") pod \"kube-storage-version-migrator-operator-799cb7f958-s7qk6\" (UID: \"2e707eba-5a8c-4086-9a05-cbb66791b425\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.378175 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.378119 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf" Jul 09 15:30:10.379342 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.379322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-default-certificate\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.379406 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.379391 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5crfc\" (UniqueName: \"kubernetes.io/projected/6928f790-cc79-4d08-bbf4-3a48557d079d-kube-api-access-5crfc\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.379441 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.379430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-stats-auth\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.379477 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.379457 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.379592 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.379481 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.379592 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.379586 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:10.379737 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.379596 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:10.879578545 +0000 UTC m=+232.158955100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:10.379737 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.379681 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:10.879630154 +0000 UTC m=+232.159006713 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : secret "router-metrics-certs-default" not found Jul 09 15:30:10.381696 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.381673 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-default-certificate\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.381793 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.381766 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-stats-auth\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.386587 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.386557 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:10.389888 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.389869 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5crfc\" (UniqueName: \"kubernetes.io/projected/6928f790-cc79-4d08-bbf4-3a48557d079d-kube-api-access-5crfc\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.467722 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.467430 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" Jul 09 15:30:10.509903 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.509871 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf"] Jul 09 15:30:10.513314 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:10.513284 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda174c21_04fa_4b77_98ac_1f7c7ed2de80.slice/crio-3e0a6fe7b28d532169d499f1d79828600e6c3068adcd474f9550d05a9a94d50e WatchSource:0}: Error finding container 3e0a6fe7b28d532169d499f1d79828600e6c3068adcd474f9550d05a9a94d50e: Status 404 returned error can't find the container with id 3e0a6fe7b28d532169d499f1d79828600e6c3068adcd474f9550d05a9a94d50e Jul 09 15:30:10.533649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.533625 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-mc4kb"] Jul 09 15:30:10.537482 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:10.537453 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df66703_4718_4815_9965_a29acaa970c6.slice/crio-098ba4589f0c20c0c01bfd4b6891ed0407d6d8a64201ee5b031de2fd0dd0c536 WatchSource:0}: Error finding container 098ba4589f0c20c0c01bfd4b6891ed0407d6d8a64201ee5b031de2fd0dd0c536: Status 404 returned error can't find the container with id 098ba4589f0c20c0c01bfd4b6891ed0407d6d8a64201ee5b031de2fd0dd0c536 Jul 09 15:30:10.593544 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.593525 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6"] Jul 09 15:30:10.595697 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:10.595673 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e707eba_5a8c_4086_9a05_cbb66791b425.slice/crio-16379fe2d00784f5f1f1160fe1f0cac053570c14a8cc9f2a4703abf8173b4b70 WatchSource:0}: Error finding container 16379fe2d00784f5f1f1160fe1f0cac053570c14a8cc9f2a4703abf8173b4b70: Status 404 returned error can't find the container with id 16379fe2d00784f5f1f1160fe1f0cac053570c14a8cc9f2a4703abf8173b4b70 Jul 09 15:30:10.782398 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.782368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:10.782549 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.782489 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:10.782549 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.782501 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957579588-skgs8: secret "image-registry-tls" not found Jul 09 15:30:10.782627 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.782551 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls podName:98829171-73ea-410b-a9de-1bee8a53a3a5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:11.782536777 +0000 UTC m=+233.061913316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls") pod "image-registry-7957579588-skgs8" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5") : secret "image-registry-tls" not found Jul 09 15:30:10.883224 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.883192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.883224 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.883227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:10.883407 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.883387 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:11.883373237 +0000 UTC m=+233.162749776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:10.883498 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.883467 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:10.883532 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:10.883525 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:11.8835125 +0000 UTC m=+233.162889041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : secret "router-metrics-certs-default" not found Jul 09 15:30:10.942956 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.942924 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:10.988699 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.988668 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" event={"ID":"2e707eba-5a8c-4086-9a05-cbb66791b425","Type":"ContainerStarted","Data":"16379fe2d00784f5f1f1160fe1f0cac053570c14a8cc9f2a4703abf8173b4b70"} Jul 09 15:30:10.989702 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.989684 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mc4kb" event={"ID":"9df66703-4718-4815-9965-a29acaa970c6","Type":"ContainerStarted","Data":"098ba4589f0c20c0c01bfd4b6891ed0407d6d8a64201ee5b031de2fd0dd0c536"} Jul 09 15:30:10.990690 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:10.990673 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf" event={"ID":"da174c21-04fa-4b77-98ac-1f7c7ed2de80","Type":"ContainerStarted","Data":"3e0a6fe7b28d532169d499f1d79828600e6c3068adcd474f9550d05a9a94d50e"} Jul 09 15:30:11.042619 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:11.042557 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:11.790585 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:11.790551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:11.790993 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:11.790671 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:11.790993 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:11.790682 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957579588-skgs8: secret "image-registry-tls" not found Jul 09 15:30:11.790993 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:11.790758 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls podName:98829171-73ea-410b-a9de-1bee8a53a3a5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:13.790739615 +0000 UTC m=+235.070116160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls") pod "image-registry-7957579588-skgs8" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5") : secret "image-registry-tls" not found Jul 09 15:30:11.891469 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:11.891430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:11.891653 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:11.891485 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:11.891653 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:11.891634 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:11.891795 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:11.891685 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:13.891663773 +0000 UTC m=+235.171040321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:11.891795 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:11.891737 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:13.891702594 +0000 UTC m=+235.171079140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : secret "router-metrics-certs-default" not found Jul 09 15:30:12.999315 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:12.999275 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" event={"ID":"2e707eba-5a8c-4086-9a05-cbb66791b425","Type":"ContainerStarted","Data":"a3932ef0e81f6d6cb7c3f69d5fc0058fbd5d1ad67a588df77f3ae66744c44dc8"} Jul 09 15:30:13.000766 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:13.000740 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf" event={"ID":"da174c21-04fa-4b77-98ac-1f7c7ed2de80","Type":"ContainerStarted","Data":"e9076a3e816ee58256271778dc5b5dcf3a51e6b13fb0b12121d84d30ab4828d0"} Jul 09 15:30:13.018093 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:13.018040 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" podStartSLOduration=0.816587856 podStartE2EDuration="3.018021939s" totalImagesPullingTime="2.201434083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:13.01638136 +0000 UTC m=+234.295757920" watchObservedRunningTime="2026-07-09 15:30:13.018021939 +0000 UTC m=+234.297398503" Jul 09 15:30:13.032860 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:13.032815 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t8wvf" podStartSLOduration=0.754658966 podStartE2EDuration="3.032796952s" totalImagesPullingTime="2.278137986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:13.031685449 +0000 UTC m=+234.311062028" watchObservedRunningTime="2026-07-09 15:30:13.032796952 +0000 UTC m=+234.312173517" Jul 09 15:30:13.120894 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:13.120798 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:13.184204 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:13.184175 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:13.805281 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:13.805245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:13.805451 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:13.805416 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:13.805451 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:13.805439 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957579588-skgs8: secret "image-registry-tls" not found Jul 09 15:30:13.805572 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:13.805506 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls podName:98829171-73ea-410b-a9de-1bee8a53a3a5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:17.805485896 +0000 UTC m=+239.084862437 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls") pod "image-registry-7957579588-skgs8" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5") : secret "image-registry-tls" not found Jul 09 15:30:13.905880 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:13.905845 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:13.905880 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:13.905893 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:13.906121 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:13.906029 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:17.906007585 +0000 UTC m=+239.185384130 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:13.906121 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:13.906053 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:13.906121 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:13.906108 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:17.906092707 +0000 UTC m=+239.185469251 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : secret "router-metrics-certs-default" not found Jul 09 15:30:14.194097 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.194016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:14.323087 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.323052 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:14.342414 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.342382 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h5ng6"] Jul 09 15:30:14.344448 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.344433 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.347010 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.346989 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4n8v\"" Jul 09 15:30:14.347232 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.347212 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 15:30:14.347905 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.347880 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 15:30:14.348002 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.347921 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 15:30:14.348002 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.347955 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 15:30:14.357311 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.357290 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h5ng6"] Jul 09 15:30:14.396037 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.396004 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:14.412419 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.412380 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-data-volume\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.412552 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.412435 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-crio-socket\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.412552 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.412523 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.412664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.412609 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.412750 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.412663 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxkmt\" (UniqueName: \"kubernetes.io/projected/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-api-access-rxkmt\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.513471 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.513436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.513638 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.513503 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxkmt\" (UniqueName: \"kubernetes.io/projected/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-api-access-rxkmt\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.513638 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:14.513594 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:14.513638 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.513599 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-data-volume\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.513638 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.513628 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-crio-socket\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.513881 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:14.513661 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.013643225 +0000 UTC m=+236.293019789 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : configmap "kube-rbac-proxy" not found Jul 09 15:30:14.513881 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.513680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.513881 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.513701 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-crio-socket\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.513881 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:14.513798 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:14.513881 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:14.513827 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.013818893 +0000 UTC m=+236.293195433 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:14.514146 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.514068 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-data-volume\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.523575 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.523551 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxkmt\" (UniqueName: \"kubernetes.io/projected/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-api-access-rxkmt\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:14.637310 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.637230 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:14.717943 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.717898 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:14.901203 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:14.901117 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:15.000909 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:15.000878 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:15.018006 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:15.017979 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:15.018122 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:15.018101 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:15.018185 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:15.018116 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:15.018185 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:15.018170 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:16.018150108 +0000 UTC m=+237.297526650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : configmap "kube-rbac-proxy" not found Jul 09 15:30:15.018273 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:15.018243 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:15.018313 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:15.018297 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:16.018281734 +0000 UTC m=+237.297658291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:15.333452 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:15.333423 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:15.433441 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:15.433404 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:16.012100 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.012075 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/0.log" Jul 09 15:30:16.012293 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.012110 2566 generic.go:356] "Generic (PLEG): container finished" podID="9df66703-4718-4815-9965-a29acaa970c6" containerID="ba75d081210be51b223a368326eb98ad63ee369121f6ee494f0bf6e1b8819d70" exitCode=255 Jul 09 15:30:16.012293 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.012163 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mc4kb" event={"ID":"9df66703-4718-4815-9965-a29acaa970c6","Type":"ContainerDied","Data":"ba75d081210be51b223a368326eb98ad63ee369121f6ee494f0bf6e1b8819d70"} Jul 09 15:30:16.012443 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.012425 2566 scope.go:117] "RemoveContainer" containerID="ba75d081210be51b223a368326eb98ad63ee369121f6ee494f0bf6e1b8819d70" Jul 09 15:30:16.027183 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.027150 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:16.027275 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.027216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:16.027364 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:16.027289 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:16.027364 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:16.027317 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:16.027364 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:16.027344 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:18.027326772 +0000 UTC m=+239.306703313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : configmap "kube-rbac-proxy" not found Jul 09 15:30:16.027528 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:16.027374 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:18.027356723 +0000 UTC m=+239.306733277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:16.502693 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.502662 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hzfvm"] Jul 09 15:30:16.504991 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.504976 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.507379 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.507361 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 15:30:16.507509 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.507490 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 15:30:16.508373 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.508357 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 15:30:16.508439 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.508357 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pgdwm\"" Jul 09 15:30:16.508439 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.508413 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 15:30:16.514254 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.514232 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hzfvm"] Jul 09 15:30:16.517774 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.517757 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xwb2t_bfcbc1be-8b62-4992-b7a6-afb5cefd4663/dns-node-resolver/0.log" Jul 09 15:30:16.531144 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.531125 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2791f5d2-aad5-44e3-962f-af73fc653fd6-signing-key\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.531257 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.531214 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2pl\" (UniqueName: \"kubernetes.io/projected/2791f5d2-aad5-44e3-962f-af73fc653fd6-kube-api-access-ls2pl\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.531319 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.531301 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2791f5d2-aad5-44e3-962f-af73fc653fd6-signing-cabundle\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.544625 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.544599 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:16.612215 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.612188 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:16.632209 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.632190 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2pl\" (UniqueName: \"kubernetes.io/projected/2791f5d2-aad5-44e3-962f-af73fc653fd6-kube-api-access-ls2pl\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.632295 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.632243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2791f5d2-aad5-44e3-962f-af73fc653fd6-signing-cabundle\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.632295 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.632276 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2791f5d2-aad5-44e3-962f-af73fc653fd6-signing-key\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.632909 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.632893 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2791f5d2-aad5-44e3-962f-af73fc653fd6-signing-cabundle\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.634681 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.634663 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2791f5d2-aad5-44e3-962f-af73fc653fd6-signing-key\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.641645 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.641620 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2pl\" (UniqueName: \"kubernetes.io/projected/2791f5d2-aad5-44e3-962f-af73fc653fd6-kube-api-access-ls2pl\") pod \"service-ca-79f68b9f4f-hzfvm\" (UID: \"2791f5d2-aad5-44e3-962f-af73fc653fd6\") " pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.813615 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.813521 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" Jul 09 15:30:16.931424 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:16.931395 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-hzfvm"] Jul 09 15:30:16.934164 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:16.934138 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2791f5d2_aad5_44e3_962f_af73fc653fd6.slice/crio-a424ce4740eb40ccd24e2c5edda4f4e12e6993ebec9d1e2c52b70e197e73a464 WatchSource:0}: Error finding container a424ce4740eb40ccd24e2c5edda4f4e12e6993ebec9d1e2c52b70e197e73a464: Status 404 returned error can't find the container with id a424ce4740eb40ccd24e2c5edda4f4e12e6993ebec9d1e2c52b70e197e73a464 Jul 09 15:30:17.016625 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.016599 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/1.log" Jul 09 15:30:17.017035 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.017019 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/0.log" Jul 09 15:30:17.017090 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.017054 2566 generic.go:356] "Generic (PLEG): container finished" podID="9df66703-4718-4815-9965-a29acaa970c6" containerID="11e5fbe3dc9c7207fc8201d1edd4b368ab6466ea981a580e49f5d1fb5fdd58f4" exitCode=255 Jul 09 15:30:17.017148 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.017133 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mc4kb" event={"ID":"9df66703-4718-4815-9965-a29acaa970c6","Type":"ContainerDied","Data":"11e5fbe3dc9c7207fc8201d1edd4b368ab6466ea981a580e49f5d1fb5fdd58f4"} Jul 09 15:30:17.017194 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.017183 2566 scope.go:117] "RemoveContainer" containerID="ba75d081210be51b223a368326eb98ad63ee369121f6ee494f0bf6e1b8819d70" Jul 09 15:30:17.017384 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.017363 2566 scope.go:117] "RemoveContainer" containerID="11e5fbe3dc9c7207fc8201d1edd4b368ab6466ea981a580e49f5d1fb5fdd58f4" Jul 09 15:30:17.017569 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:17.017541 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mc4kb_openshift-console-operator(9df66703-4718-4815-9965-a29acaa970c6)\"" pod="openshift-console-operator/console-operator-7866497494-mc4kb" podUID="9df66703-4718-4815-9965-a29acaa970c6" Jul 09 15:30:17.018491 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.018267 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" event={"ID":"2791f5d2-aad5-44e3-962f-af73fc653fd6","Type":"ContainerStarted","Data":"a424ce4740eb40ccd24e2c5edda4f4e12e6993ebec9d1e2c52b70e197e73a464"} Jul 09 15:30:17.315284 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.315254 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m94j4_1e002460-a3d1-4ad7-b248-0122b661f22b/node-ca/0.log" Jul 09 15:30:17.479874 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.479844 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:17.842784 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.842751 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:17.843256 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:17.842922 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:30:17.843256 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:17.842947 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7957579588-skgs8: secret "image-registry-tls" not found Jul 09 15:30:17.843256 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:17.843012 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls podName:98829171-73ea-410b-a9de-1bee8a53a3a5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:25.842993461 +0000 UTC m=+247.122370010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls") pod "image-registry-7957579588-skgs8" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5") : secret "image-registry-tls" not found Jul 09 15:30:17.943098 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.943066 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:17.943098 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:17.943100 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:17.943267 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:17.943224 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:25.943207409 +0000 UTC m=+247.222583951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:17.943267 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:17.943228 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:17.943339 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:17.943271 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:25.943260449 +0000 UTC m=+247.222636988 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : secret "router-metrics-certs-default" not found Jul 09 15:30:18.022344 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:18.022319 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/1.log" Jul 09 15:30:18.022642 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:18.022624 2566 scope.go:117] "RemoveContainer" containerID="11e5fbe3dc9c7207fc8201d1edd4b368ab6466ea981a580e49f5d1fb5fdd58f4" Jul 09 15:30:18.022805 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:18.022787 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mc4kb_openshift-console-operator(9df66703-4718-4815-9965-a29acaa970c6)\"" pod="openshift-console-operator/console-operator-7866497494-mc4kb" podUID="9df66703-4718-4815-9965-a29acaa970c6" Jul 09 15:30:18.044227 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:18.044202 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:18.044330 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:18.044247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:18.044366 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:18.044339 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:18.044403 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:18.044387 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:22.044373804 +0000 UTC m=+243.323750343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:18.044440 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:18.044341 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:18.044472 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:18.044466 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:22.044454653 +0000 UTC m=+243.323831194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : configmap "kube-rbac-proxy" not found Jul 09 15:30:18.315892 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:18.315861 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rp5sk_a6111a94-30ad-4ecb-89b2-774cc73e7282/serve-healthcheck-canary/0.log" Jul 09 15:30:20.029401 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:20.029365 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" event={"ID":"2791f5d2-aad5-44e3-962f-af73fc653fd6","Type":"ContainerStarted","Data":"630ca6685743fbe3c24c4a944dc78db612d32b11ef48b13f2a52f81d7ade36d4"} Jul 09 15:30:20.386890 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:20.386804 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:20.386890 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:20.386867 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:20.387199 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:20.387186 2566 scope.go:117] "RemoveContainer" containerID="11e5fbe3dc9c7207fc8201d1edd4b368ab6466ea981a580e49f5d1fb5fdd58f4" Jul 09 15:30:20.387356 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:20.387338 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-mc4kb_openshift-console-operator(9df66703-4718-4815-9965-a29acaa970c6)\"" pod="openshift-console-operator/console-operator-7866497494-mc4kb" podUID="9df66703-4718-4815-9965-a29acaa970c6" Jul 09 15:30:20.992794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:20.992733 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:21.813035 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:21.812987 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:22.014069 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:22.014039 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:22.080577 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:22.080495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:22.080831 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:22.080676 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:22.080924 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:22.080821 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:22.080999 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:22.080918 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:30.080896871 +0000 UTC m=+251.360273413 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:22.081154 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:22.080961 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:22.081275 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:22.081267 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:30.081249873 +0000 UTC m=+251.360626426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : configmap "kube-rbac-proxy" not found Jul 09 15:30:22.116091 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:22.116060 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:22.404215 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:22.404114 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:22.504403 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:22.504368 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:22.573927 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:22.573899 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:24.303114 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:24.303083 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:24.390323 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:24.390290 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:24.721040 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:24.720962 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:25.118576 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:25.118541 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:25.717926 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:25.717892 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:25.817914 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:25.817886 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:25.913609 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:25.913570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:25.916353 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:25.916327 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"image-registry-7957579588-skgs8\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:25.919041 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:25.919016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:25.995750 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:25.995635 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-w7x96\"" Jul 09 15:30:26.003926 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:26.003904 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:26.014551 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:26.014526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:26.014650 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:26.014566 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:26.014729 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:26.014695 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 09 15:30:26.014800 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:26.014743 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:42.014720502 +0000 UTC m=+263.294097055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : configmap references non-existent config key: service-ca.crt Jul 09 15:30:26.014862 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:26.014836 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs podName:6928f790-cc79-4d08-bbf4-3a48557d079d nodeName:}" failed. No retries permitted until 2026-07-09 15:30:42.014802849 +0000 UTC m=+263.294179388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs") pod "router-default-596f7d568b-gv49z" (UID: "6928f790-cc79-4d08-bbf4-3a48557d079d") : secret "router-metrics-certs-default" not found Jul 09 15:30:26.133913 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:26.133854 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-hzfvm" podStartSLOduration=7.515984946 podStartE2EDuration="10.133831601s" totalImagesPullingTime="2.617846655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:20.045731678 +0000 UTC m=+241.325108243" watchObservedRunningTime="2026-07-09 15:30:26.133831601 +0000 UTC m=+247.413208163" Jul 09 15:30:26.134079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:26.134021 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7957579588-skgs8"] Jul 09 15:30:26.137410 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:26.137388 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98829171_73ea_410b_a9de_1bee8a53a3a5.slice/crio-58957cea35403982406dcc1d7f3be2f5234f34720dd9bde84f112eaa6ab164b7 WatchSource:0}: Error finding container 58957cea35403982406dcc1d7f3be2f5234f34720dd9bde84f112eaa6ab164b7: Status 404 returned error can't find the container with id 58957cea35403982406dcc1d7f3be2f5234f34720dd9bde84f112eaa6ab164b7 Jul 09 15:30:26.315307 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:26.315271 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:26.605194 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:26.605113 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:26.729304 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:26.729269 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:27.056080 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:27.056050 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957579588-skgs8" event={"ID":"98829171-73ea-410b-a9de-1bee8a53a3a5","Type":"ContainerStarted","Data":"0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a"} Jul 09 15:30:27.056242 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:27.056097 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957579588-skgs8" event={"ID":"98829171-73ea-410b-a9de-1bee8a53a3a5","Type":"ContainerStarted","Data":"58957cea35403982406dcc1d7f3be2f5234f34720dd9bde84f112eaa6ab164b7"} Jul 09 15:30:27.056242 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:27.056174 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:30:27.076220 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:27.076174 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7957579588-skgs8" podStartSLOduration=17.076161892 podStartE2EDuration="17.076161892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:27.07564587 +0000 UTC m=+248.355022431" watchObservedRunningTime="2026-07-09 15:30:27.076161892 +0000 UTC m=+248.355538431" Jul 09 15:30:29.447986 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:29.447902 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:29.549169 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:29.549138 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:30.123744 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:30.123691 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:30.146823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:30.146791 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:30.146928 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:30.146862 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:30.146967 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:30.146936 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:30.147008 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:30.146997 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls podName:0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:46.146981599 +0000 UTC m=+267.426358138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-h5ng6" (UID: "0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:30.147467 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:30.147447 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:30.316509 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:30.316472 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:30.518199 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:30.518162 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:30.716754 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:30.716720 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:30.920661 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:30.920569 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:31.054227 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:31.054185 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:30:31.056607 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:31.056588 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12b20f1c-d297-4a7e-bc1c-2817359a7d21-metrics-certs\") pod \"network-metrics-daemon-mxqzz\" (UID: \"12b20f1c-d297-4a7e-bc1c-2817359a7d21\") " pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:30:31.264029 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:31.264000 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sq7lb\"" Jul 09 15:30:31.271837 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:31.271819 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxqzz" Jul 09 15:30:31.400114 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:31.400083 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxqzz"] Jul 09 15:30:31.402987 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:31.402958 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12b20f1c_d297_4a7e_bc1c_2817359a7d21.slice/crio-d3d77d24ae4a6e53e593122a7174017248b1f40471ac2e86673d88dc414a4a84 WatchSource:0}: Error finding container d3d77d24ae4a6e53e593122a7174017248b1f40471ac2e86673d88dc414a4a84: Status 404 returned error can't find the container with id d3d77d24ae4a6e53e593122a7174017248b1f40471ac2e86673d88dc414a4a84 Jul 09 15:30:31.930636 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:31.930598 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:32.071617 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:32.071582 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxqzz" event={"ID":"12b20f1c-d297-4a7e-bc1c-2817359a7d21","Type":"ContainerStarted","Data":"d3d77d24ae4a6e53e593122a7174017248b1f40471ac2e86673d88dc414a4a84"} Jul 09 15:30:32.114808 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:32.114777 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:32.258847 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:32.258824 2566 scope.go:117] "RemoveContainer" containerID="11e5fbe3dc9c7207fc8201d1edd4b368ab6466ea981a580e49f5d1fb5fdd58f4" Jul 09 15:30:32.314747 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:32.314696 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:32.508666 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:32.508632 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:33.075910 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:33.075883 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:30:33.076360 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:33.076336 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/1.log" Jul 09 15:30:33.076425 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:33.076375 2566 generic.go:356] "Generic (PLEG): container finished" podID="9df66703-4718-4815-9965-a29acaa970c6" containerID="bdd7265e5e741fdb6cef185e748958b52af155b6462a1fa12212336249c70810" exitCode=255 Jul 09 15:30:33.076425 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:33.076408 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mc4kb" event={"ID":"9df66703-4718-4815-9965-a29acaa970c6","Type":"ContainerDied","Data":"bdd7265e5e741fdb6cef185e748958b52af155b6462a1fa12212336249c70810"} Jul 09 15:30:33.076520 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:33.076450 2566 scope.go:117] "RemoveContainer" containerID="11e5fbe3dc9c7207fc8201d1edd4b368ab6466ea981a580e49f5d1fb5fdd58f4" Jul 09 15:30:33.076796 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:33.076777 2566 scope.go:117] "RemoveContainer" containerID="bdd7265e5e741fdb6cef185e748958b52af155b6462a1fa12212336249c70810" Jul 09 15:30:33.076969 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:33.076949 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-mc4kb_openshift-console-operator(9df66703-4718-4815-9965-a29acaa970c6)\"" pod="openshift-console-operator/console-operator-7866497494-mc4kb" podUID="9df66703-4718-4815-9965-a29acaa970c6" Jul 09 15:30:34.080231 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:34.080203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:30:35.084405 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:35.084368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxqzz" event={"ID":"12b20f1c-d297-4a7e-bc1c-2817359a7d21","Type":"ContainerStarted","Data":"0309a0d23819b3e435ec85f32be5d77e9cd8403033f4f113aeb32ac0d0ef5f0d"} Jul 09 15:30:35.084771 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:35.084420 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxqzz" event={"ID":"12b20f1c-d297-4a7e-bc1c-2817359a7d21","Type":"ContainerStarted","Data":"6f2b480c1c2e65cafd8d0eabf5ca5e6f7daae869b20fa90a9ac7cce3ed13ac77"} Jul 09 15:30:35.102985 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:35.102940 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mxqzz" podStartSLOduration=252.822028386 podStartE2EDuration="4m16.102923321s" totalImagesPullingTime="3.280894935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:35.102615865 +0000 UTC m=+256.381992445" watchObservedRunningTime="2026-07-09 15:30:35.102923321 +0000 UTC m=+256.382299883" Jul 09 15:30:36.745279 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:36.745247 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7957579588-skgs8"] Jul 09 15:30:36.856628 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:36.856589 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:36.954004 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:36.953973 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:40.386879 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:40.386803 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:40.386879 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:40.386849 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:40.387290 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:40.387109 2566 scope.go:117] "RemoveContainer" containerID="bdd7265e5e741fdb6cef185e748958b52af155b6462a1fa12212336249c70810" Jul 09 15:30:40.387290 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:40.387242 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-mc4kb_openshift-console-operator(9df66703-4718-4815-9965-a29acaa970c6)\"" pod="openshift-console-operator/console-operator-7866497494-mc4kb" podUID="9df66703-4718-4815-9965-a29acaa970c6" Jul 09 15:30:42.035800 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:42.035766 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:42.036243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:42.035862 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:42.036436 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:42.036413 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6928f790-cc79-4d08-bbf4-3a48557d079d-service-ca-bundle\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:42.038273 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:42.038254 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6928f790-cc79-4d08-bbf4-3a48557d079d-metrics-certs\") pod \"router-default-596f7d568b-gv49z\" (UID: \"6928f790-cc79-4d08-bbf4-3a48557d079d\") " pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:42.281773 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:42.281741 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p529s\"" Jul 09 15:30:42.289676 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:42.289635 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:42.418187 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:42.418161 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-596f7d568b-gv49z"] Jul 09 15:30:42.423597 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:42.423568 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6928f790_cc79_4d08_bbf4_3a48557d079d.slice/crio-ebb1f06c41b44fb25efdae388ce18a4b1601d526e8f34d0c1a12717e72136913 WatchSource:0}: Error finding container ebb1f06c41b44fb25efdae388ce18a4b1601d526e8f34d0c1a12717e72136913: Status 404 returned error can't find the container with id ebb1f06c41b44fb25efdae388ce18a4b1601d526e8f34d0c1a12717e72136913 Jul 09 15:30:43.109286 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:43.109254 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-596f7d568b-gv49z" event={"ID":"6928f790-cc79-4d08-bbf4-3a48557d079d","Type":"ContainerStarted","Data":"c690d19a46df92737003f6084778c27733933c1b3486f774507ce8f8e0460202"} Jul 09 15:30:43.109637 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:43.109301 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-596f7d568b-gv49z" event={"ID":"6928f790-cc79-4d08-bbf4-3a48557d079d","Type":"ContainerStarted","Data":"ebb1f06c41b44fb25efdae388ce18a4b1601d526e8f34d0c1a12717e72136913"} Jul 09 15:30:43.132240 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:43.132200 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-596f7d568b-gv49z" podStartSLOduration=33.132184643 podStartE2EDuration="33.132184643s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:43.131339692 +0000 UTC m=+264.410716253" watchObservedRunningTime="2026-07-09 15:30:43.132184643 +0000 UTC m=+264.411561204" Jul 09 15:30:43.290283 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:43.290251 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:43.293270 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:43.293250 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:44.057932 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:44.057899 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:44.113231 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:44.113195 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:44.114504 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:44.114482 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-596f7d568b-gv49z" Jul 09 15:30:44.117949 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:44.117927 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:45.169241 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.169207 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:45.266068 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.266040 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:45.345581 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.345553 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7"] Jul 09 15:30:45.347917 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.347897 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" Jul 09 15:30:45.349072 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.349039 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:45.350384 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.350365 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 15:30:45.350490 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.350434 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lx7fh\"" Jul 09 15:30:45.359052 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.359034 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7"] Jul 09 15:30:45.459995 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.459927 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a235d6ad-9ca2-4793-9a60-9f7e0a407c02-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x45n7\" (UID: \"a235d6ad-9ca2-4793-9a60-9f7e0a407c02\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" Jul 09 15:30:45.561168 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.561131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a235d6ad-9ca2-4793-9a60-9f7e0a407c02-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x45n7\" (UID: \"a235d6ad-9ca2-4793-9a60-9f7e0a407c02\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" Jul 09 15:30:45.561283 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:45.561264 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 09 15:30:45.561346 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:45.561336 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a235d6ad-9ca2-4793-9a60-9f7e0a407c02-tls-certificates podName:a235d6ad-9ca2-4793-9a60-9f7e0a407c02 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:46.061317189 +0000 UTC m=+267.340693743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a235d6ad-9ca2-4793-9a60-9f7e0a407c02-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-x45n7" (UID: "a235d6ad-9ca2-4793-9a60-9f7e0a407c02") : secret "prometheus-operator-admission-webhook-tls" not found Jul 09 15:30:45.894871 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:45.894841 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:46.063476 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.063445 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a235d6ad-9ca2-4793-9a60-9f7e0a407c02-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x45n7\" (UID: \"a235d6ad-9ca2-4793-9a60-9f7e0a407c02\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" Jul 09 15:30:46.065998 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.065973 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a235d6ad-9ca2-4793-9a60-9f7e0a407c02-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-x45n7\" (UID: \"a235d6ad-9ca2-4793-9a60-9f7e0a407c02\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" Jul 09 15:30:46.163779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.163698 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:46.165915 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.165897 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h5ng6\" (UID: \"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5\") " pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:46.258059 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.258015 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" Jul 09 15:30:46.380312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.380283 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7"] Jul 09 15:30:46.383491 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:46.383462 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda235d6ad_9ca2_4793_9a60_9f7e0a407c02.slice/crio-72dca97b48b78dcb4ab1b054b4822fe4198a3db1f74858cd4e452b7fd38f5a89 WatchSource:0}: Error finding container 72dca97b48b78dcb4ab1b054b4822fe4198a3db1f74858cd4e452b7fd38f5a89: Status 404 returned error can't find the container with id 72dca97b48b78dcb4ab1b054b4822fe4198a3db1f74858cd4e452b7fd38f5a89 Jul 09 15:30:46.454972 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.454890 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s4n8v\"" Jul 09 15:30:46.463672 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.463656 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h5ng6" Jul 09 15:30:46.606121 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.606094 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h5ng6"] Jul 09 15:30:46.607814 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:46.607783 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e45c8ae_01ca_4fc6_a6bc_7d9fa2d43cb5.slice/crio-b6268436dc75241e7db0436f0032c96065d409b68cab374bba213bff3e63ece5 WatchSource:0}: Error finding container b6268436dc75241e7db0436f0032c96065d409b68cab374bba213bff3e63ece5: Status 404 returned error can't find the container with id b6268436dc75241e7db0436f0032c96065d409b68cab374bba213bff3e63ece5 Jul 09 15:30:46.750959 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.750925 2566 patch_prober.go:28] interesting pod/image-registry-7957579588-skgs8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:30:46.751107 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:46.750977 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7957579588-skgs8" podUID="98829171-73ea-410b-a9de-1bee8a53a3a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:47.128148 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:47.128051 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5ng6" event={"ID":"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5","Type":"ContainerStarted","Data":"b6268436dc75241e7db0436f0032c96065d409b68cab374bba213bff3e63ece5"} Jul 09 15:30:47.130282 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:47.130222 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" event={"ID":"a235d6ad-9ca2-4793-9a60-9f7e0a407c02","Type":"ContainerStarted","Data":"72dca97b48b78dcb4ab1b054b4822fe4198a3db1f74858cd4e452b7fd38f5a89"} Jul 09 15:30:48.135491 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:48.135453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" event={"ID":"a235d6ad-9ca2-4793-9a60-9f7e0a407c02","Type":"ContainerStarted","Data":"ab8fd207c0f48d4058d1c2585d7046ceb5a5827785da1e5e48b6445dec31ee91"} Jul 09 15:30:48.135941 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:48.135677 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" Jul 09 15:30:48.140995 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:48.140971 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" Jul 09 15:30:48.152975 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:48.152745 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-x45n7" podStartSLOduration=2.00886202 podStartE2EDuration="3.15272505s" totalImagesPullingTime="1.14386303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:48.152663461 +0000 UTC m=+269.432040023" watchObservedRunningTime="2026-07-09 15:30:48.15272505 +0000 UTC m=+269.432101609" Jul 09 15:30:48.373729 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:48.373680 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:48.476922 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:48.476841 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:48.696817 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:48.696772 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:51.146359 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:51.146331 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5ng6" event={"ID":"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5","Type":"ContainerStarted","Data":"8ff13cc4d3cf0412b615d02e978719f3db1654231d6fb35d3703bc1f0d55cb2f"} Jul 09 15:30:51.146668 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:51.146384 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5ng6" event={"ID":"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5","Type":"ContainerStarted","Data":"d3cf729215735c44667e47765b1cafa1daa8a9aba559c7937dc71b0698e3f0b0"} Jul 09 15:30:51.901841 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:51.901802 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:53.527184 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:53.527153 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:53.666157 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:53.666079 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:54.159161 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:54.159121 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h5ng6" event={"ID":"0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5","Type":"ContainerStarted","Data":"cee955ce677c57799f6194c2ff70b7561c64435da4638fa4d62c6b2520019af2"} Jul 09 15:30:54.178764 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:54.178701 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h5ng6" podStartSLOduration=33.506562627 podStartE2EDuration="40.178687604s" totalImagesPullingTime="6.672124977s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:30:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:54.177785041 +0000 UTC m=+275.457161620" watchObservedRunningTime="2026-07-09 15:30:54.178687604 +0000 UTC m=+275.458064164" Jul 09 15:30:55.259171 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.259146 2566 scope.go:117] "RemoveContainer" containerID="bdd7265e5e741fdb6cef185e748958b52af155b6462a1fa12212336249c70810" Jul 09 15:30:55.861360 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.861323 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-sgr6r"] Jul 09 15:30:55.863641 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.863624 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-sgr6r" Jul 09 15:30:55.866908 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.866885 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 15:30:55.867030 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.866959 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 15:30:55.867311 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.867296 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-s2t7c\"" Jul 09 15:30:55.880978 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.880959 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-sgr6r"] Jul 09 15:30:55.891630 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.891597 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:55.981930 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:55.981877 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:56.039575 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.039552 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbf2n\" (UniqueName: \"kubernetes.io/projected/d9914449-833f-41ac-bbe4-c9a70c0bdbec-kube-api-access-lbf2n\") pod \"downloads-68c9cbb497-sgr6r\" (UID: \"d9914449-833f-41ac-bbe4-c9a70c0bdbec\") " pod="openshift-console/downloads-68c9cbb497-sgr6r" Jul 09 15:30:56.139953 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.139892 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbf2n\" (UniqueName: \"kubernetes.io/projected/d9914449-833f-41ac-bbe4-c9a70c0bdbec-kube-api-access-lbf2n\") pod \"downloads-68c9cbb497-sgr6r\" (UID: \"d9914449-833f-41ac-bbe4-c9a70c0bdbec\") " pod="openshift-console/downloads-68c9cbb497-sgr6r" Jul 09 15:30:56.148442 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.148416 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbf2n\" (UniqueName: \"kubernetes.io/projected/d9914449-833f-41ac-bbe4-c9a70c0bdbec-kube-api-access-lbf2n\") pod \"downloads-68c9cbb497-sgr6r\" (UID: \"d9914449-833f-41ac-bbe4-c9a70c0bdbec\") " pod="openshift-console/downloads-68c9cbb497-sgr6r" Jul 09 15:30:56.168561 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.168540 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:30:56.168637 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.168585 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-mc4kb" event={"ID":"9df66703-4718-4815-9965-a29acaa970c6","Type":"ContainerStarted","Data":"60c3da736cf24cb7e865fade125bc56a69d95c37084c2f363aa51ee12cc2729d"} Jul 09 15:30:56.168899 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.168876 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:56.172216 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.172199 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-sgr6r" Jul 09 15:30:56.173654 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.173637 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-mc4kb" Jul 09 15:30:56.186942 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.186921 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:56.203634 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.203583 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-mc4kb" podStartSLOduration=41.735961917 podStartE2EDuration="46.203563729s" totalImagesPullingTime="4.467601812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:56.18511294 +0000 UTC m=+277.464489526" watchObservedRunningTime="2026-07-09 15:30:56.203563729 +0000 UTC m=+277.482940291" Jul 09 15:30:56.299438 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.299165 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-sgr6r"] Jul 09 15:30:56.301882 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:56.301859 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9914449_833f_41ac_bbe4_c9a70c0bdbec.slice/crio-59531d4730684055c0ab442c714b6b83d34808e11d2193c146d1178259de880e WatchSource:0}: Error finding container 59531d4730684055c0ab442c714b6b83d34808e11d2193c146d1178259de880e: Status 404 returned error can't find the container with id 59531d4730684055c0ab442c714b6b83d34808e11d2193c146d1178259de880e Jul 09 15:30:56.545048 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.545016 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:56.608419 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.608386 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:56.749567 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.749538 2566 patch_prober.go:28] interesting pod/image-registry-7957579588-skgs8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:30:56.749758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.749584 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7957579588-skgs8" podUID="98829171-73ea-410b-a9de-1bee8a53a3a5" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:30:56.751847 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.751825 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:56.945002 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:56.944924 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:57.010184 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:57.010157 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:57.173271 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:57.173247 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-sgr6r" event={"ID":"d9914449-833f-41ac-bbe4-c9a70c0bdbec","Type":"ContainerStarted","Data":"59531d4730684055c0ab442c714b6b83d34808e11d2193c146d1178259de880e"} Jul 09 15:30:57.368114 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:57.368081 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:57.568187 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:57.568156 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:57.809580 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:57.809539 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:58.549230 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.549196 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:58.709613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.709577 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:58.731930 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.731895 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-p9ggs"] Jul 09 15:30:58.734673 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.734646 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.738058 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.738034 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 15:30:58.738190 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.738075 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 15:30:58.738190 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.738100 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 15:30:58.738395 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.738307 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 15:30:58.738395 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.738334 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-c2ghs\"" Jul 09 15:30:58.738996 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.738980 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 15:30:58.739074 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.739034 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 15:30:58.746225 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.746203 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-p9ggs"] Jul 09 15:30:58.766019 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.765989 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4hf8r"] Jul 09 15:30:58.768042 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.768028 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.770180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.770160 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 15:30:58.770286 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.770182 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 15:30:58.770661 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.770641 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7n2gn\"" Jul 09 15:30:58.770786 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.770752 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 15:30:58.804102 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.804038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:58.861176 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.861176 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861151 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-textfile\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861372 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-sys\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861372 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861227 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46d444eb-9e95-46c7-8995-e3121819bd70-metrics-client-ca\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861372 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861251 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-tls\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861372 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.861561 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.861561 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.861561 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861440 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-root\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861561 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861495 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smmbc\" (UniqueName: \"kubernetes.io/projected/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-api-access-smmbc\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.861561 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861527 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861561 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861556 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861859 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861580 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4ccx\" (UniqueName: \"kubernetes.io/projected/46d444eb-9e95-46c7-8995-e3121819bd70-kube-api-access-d4ccx\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861859 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861609 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-wtmp\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.861859 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.861670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.952719 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.952683 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:30:58.962651 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962624 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.962813 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962674 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.962813 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.962813 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-root\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.962813 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962784 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smmbc\" (UniqueName: \"kubernetes.io/projected/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-api-access-smmbc\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.963011 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962858 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-root\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963011 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962915 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963011 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963011 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.962982 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4ccx\" (UniqueName: \"kubernetes.io/projected/46d444eb-9e95-46c7-8995-e3121819bd70-kube-api-access-d4ccx\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963202 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-wtmp\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963202 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963064 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.963202 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963070 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.963202 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963134 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.963202 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-textfile\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963202 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-sys\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46d444eb-9e95-46c7-8995-e3121819bd70-metrics-client-ca\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963248 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-tls\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963492 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:58.963369 2566 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 15:30:58.963492 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:58.963419 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-tls podName:46d444eb-9e95-46c7-8995-e3121819bd70 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:59.463403304 +0000 UTC m=+280.742779843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-tls") pod "node-exporter-4hf8r" (UID: "46d444eb-9e95-46c7-8995-e3121819bd70") : secret "node-exporter-tls" not found Jul 09 15:30:58.963492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963453 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-wtmp\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963474 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.963492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963493 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/46d444eb-9e95-46c7-8995-e3121819bd70-sys\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.963900 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963636 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-accelerators-collector-config\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.964007 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963978 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-textfile\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.964007 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.963990 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46d444eb-9e95-46c7-8995-e3121819bd70-metrics-client-ca\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.964151 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.964110 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.965973 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.965943 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.966083 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.965992 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.966231 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.966211 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:58.974162 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.974138 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4ccx\" (UniqueName: \"kubernetes.io/projected/46d444eb-9e95-46c7-8995-e3121819bd70-kube-api-access-d4ccx\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:58.974360 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:58.974343 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smmbc\" (UniqueName: \"kubernetes.io/projected/a64fa3a3-e1c7-440a-bf08-1da983e2d1fd-kube-api-access-smmbc\") pod \"kube-state-metrics-785778ff74-p9ggs\" (UID: \"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:59.047197 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.047162 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" Jul 09 15:30:59.196789 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.196491 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-p9ggs"] Jul 09 15:30:59.199768 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:59.199736 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64fa3a3_e1c7_440a_bf08_1da983e2d1fd.slice/crio-eeacf6db57beba541fc7538a4a5a0ac8eb3db1b2b2262510abb529e72e5b62e6 WatchSource:0}: Error finding container eeacf6db57beba541fc7538a4a5a0ac8eb3db1b2b2262510abb529e72e5b62e6: Status 404 returned error can't find the container with id eeacf6db57beba541fc7538a4a5a0ac8eb3db1b2b2262510abb529e72e5b62e6 Jul 09 15:30:59.467616 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.467535 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-tls\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:59.469938 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.469913 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/46d444eb-9e95-46c7-8995-e3121819bd70-node-exporter-tls\") pod \"node-exporter-4hf8r\" (UID: \"46d444eb-9e95-46c7-8995-e3121819bd70\") " pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:59.677338 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.677306 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4hf8r" Jul 09 15:30:59.687078 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:30:59.687056 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46d444eb_9e95_46c7_8995_e3121819bd70.slice/crio-6afcd1a606c1d4bf24b5d69cfa25067c1fb5627dcb4f760a14f24be63bc09f26 WatchSource:0}: Error finding container 6afcd1a606c1d4bf24b5d69cfa25067c1fb5627dcb4f760a14f24be63bc09f26: Status 404 returned error can't find the container with id 6afcd1a606c1d4bf24b5d69cfa25067c1fb5627dcb4f760a14f24be63bc09f26 Jul 09 15:30:59.749193 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.749160 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:30:59.752781 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.752760 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.755445 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.755406 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 15:30:59.755679 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.755648 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 15:30:59.755679 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.755665 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 15:30:59.755679 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.755665 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 15:30:59.755951 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.755936 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 15:30:59.756016 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.755965 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 15:30:59.756078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.756056 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 15:30:59.756123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.755970 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 15:30:59.756171 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.756124 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dlbfr\"" Jul 09 15:30:59.756865 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.756796 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 15:30:59.767446 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.767417 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:30:59.871294 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871265 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871294 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871297 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871547 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-web-config\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871547 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871402 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871547 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871460 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871547 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871494 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871776 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871551 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871776 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871583 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-config-volume\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871776 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871599 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871776 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871776 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871664 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-config-out\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871776 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871699 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gll4\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-kube-api-access-9gll4\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.871776 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.871747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.972262 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972227 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.972440 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-config-volume\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.972440 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972301 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.972440 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972324 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972681 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-config-out\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gll4\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-kube-api-access-9gll4\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972862 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972888 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972951 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-web-config\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.972987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.973017 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973079 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.973041 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973779 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:59.973104 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle podName:31399442-55b8-44be-b04d-f3473019560d nodeName:}" failed. No retries permitted until 2026-07-09 15:31:00.473077557 +0000 UTC m=+281.752454109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "31399442-55b8-44be-b04d-f3473019560d") : configmap references non-existent config key: ca-bundle.crt Jul 09 15:30:59.973779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.973283 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.973758 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.973940 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:59.973853 2566 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 15:30:59.973940 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:30:59.973914 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls podName:31399442-55b8-44be-b04d-f3473019560d nodeName:}" failed. No retries permitted until 2026-07-09 15:31:00.473898568 +0000 UTC m=+281.753275112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "31399442-55b8-44be-b04d-f3473019560d") : secret "alertmanager-main-tls" not found Jul 09 15:30:59.979793 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.976346 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-config-volume\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.979793 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.976925 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.979793 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.977375 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.979793 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.978004 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-web-config\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.979793 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.978133 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-config-out\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.979793 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.978905 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.979793 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.979348 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.980200 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.979847 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:59.983949 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:30:59.983916 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gll4\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-kube-api-access-9gll4\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:31:00.187686 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.187603 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hf8r" event={"ID":"46d444eb-9e95-46c7-8995-e3121819bd70","Type":"ContainerStarted","Data":"6afcd1a606c1d4bf24b5d69cfa25067c1fb5627dcb4f760a14f24be63bc09f26"} Jul 09 15:31:00.189190 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.189159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" event={"ID":"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd","Type":"ContainerStarted","Data":"eeacf6db57beba541fc7538a4a5a0ac8eb3db1b2b2262510abb529e72e5b62e6"} Jul 09 15:31:00.478358 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.478263 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:31:00.478358 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.478348 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:31:00.479495 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.479467 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:31:00.481627 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.481598 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:31:00.670756 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.670700 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:31:00.681834 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.679969 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5f9978c7cd-wslhw"] Jul 09 15:31:00.684078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.683108 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.686336 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.685696 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 15:31:00.686336 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.685960 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 15:31:00.686336 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.686178 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 15:31:00.686336 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.686227 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xqztp\"" Jul 09 15:31:00.686617 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.686414 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 15:31:00.686617 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.686613 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 15:31:00.686877 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.686178 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bev0nts0v83m9\"" Jul 09 15:31:00.696899 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.696394 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f9978c7cd-wslhw"] Jul 09 15:31:00.782459 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.782418 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.782642 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.782529 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.782642 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.782568 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.782642 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.782598 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-grpc-tls\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.782642 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.782629 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-metrics-client-ca\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.782914 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.782661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfp87\" (UniqueName: \"kubernetes.io/projected/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-kube-api-access-wfp87\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.782914 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.782697 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.782914 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.782745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-tls\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.821968 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:31:00.821924 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xzvk5" podUID="ff2dedf4-d7c0-42c7-a274-7d13ac2fffae" Jul 09 15:31:00.883210 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.883166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.883400 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.883228 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.883400 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.883262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-grpc-tls\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.883400 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.883286 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-metrics-client-ca\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.883400 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.883306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfp87\" (UniqueName: \"kubernetes.io/projected/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-kube-api-access-wfp87\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.883400 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.883324 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.883400 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.883352 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-tls\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.883400 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.883382 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.884347 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.884315 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-metrics-client-ca\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.886744 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.886701 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.887702 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.887650 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-grpc-tls\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.887952 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.887928 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.891405 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.891375 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.892541 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.892513 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.893474 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.893449 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-secret-thanos-querier-tls\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.894357 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.894318 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfp87\" (UniqueName: \"kubernetes.io/projected/52b3daa1-09af-4f56-ab7c-8b8b57258d0d-kube-api-access-wfp87\") pod \"thanos-querier-5f9978c7cd-wslhw\" (UID: \"52b3daa1-09af-4f56-ab7c-8b8b57258d0d\") " pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:00.999229 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:00.999201 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:01.094670 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:01.094590 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:31:01.193030 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:01.192998 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzvk5" Jul 09 15:31:01.241283 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:31:01.241249 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-163113957e22c80d8332e6009682e370ca06003ca04ffda719039c988c5802c4 WatchSource:0}: Error finding container 163113957e22c80d8332e6009682e370ca06003ca04ffda719039c988c5802c4: Status 404 returned error can't find the container with id 163113957e22c80d8332e6009682e370ca06003ca04ffda719039c988c5802c4 Jul 09 15:31:01.417476 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:01.417427 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5f9978c7cd-wslhw"] Jul 09 15:31:01.766318 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:01.766274 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7957579588-skgs8" podUID="98829171-73ea-410b-a9de-1bee8a53a3a5" containerName="registry" containerID="cri-o://0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a" gracePeriod=30 Jul 09 15:31:02.024501 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.024404 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:02.061295 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.061261 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:31:02.082773 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.082721 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:02.092588 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.092537 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-installation-pull-secrets\") pod \"98829171-73ea-410b-a9de-1bee8a53a3a5\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " Jul 09 15:31:02.092746 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.092603 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-trusted-ca\") pod \"98829171-73ea-410b-a9de-1bee8a53a3a5\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " Jul 09 15:31:02.092746 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.092654 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") pod \"98829171-73ea-410b-a9de-1bee8a53a3a5\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " Jul 09 15:31:02.092746 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.092690 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98829171-73ea-410b-a9de-1bee8a53a3a5-ca-trust-extracted\") pod \"98829171-73ea-410b-a9de-1bee8a53a3a5\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " Jul 09 15:31:02.092923 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.092755 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-image-registry-private-configuration\") pod \"98829171-73ea-410b-a9de-1bee8a53a3a5\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " Jul 09 15:31:02.092923 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.092784 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-bound-sa-token\") pod \"98829171-73ea-410b-a9de-1bee8a53a3a5\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " Jul 09 15:31:02.092923 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.092823 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grwg7\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-kube-api-access-grwg7\") pod \"98829171-73ea-410b-a9de-1bee8a53a3a5\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " Jul 09 15:31:02.092923 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.092856 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-certificates\") pod \"98829171-73ea-410b-a9de-1bee8a53a3a5\" (UID: \"98829171-73ea-410b-a9de-1bee8a53a3a5\") " Jul 09 15:31:02.093877 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.093666 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "98829171-73ea-410b-a9de-1bee8a53a3a5" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:02.094823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.094796 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "98829171-73ea-410b-a9de-1bee8a53a3a5" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:02.098903 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.098855 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "98829171-73ea-410b-a9de-1bee8a53a3a5" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:02.107985 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.107947 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-kube-api-access-grwg7" (OuterVolumeSpecName: "kube-api-access-grwg7") pod "98829171-73ea-410b-a9de-1bee8a53a3a5" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5"). InnerVolumeSpecName "kube-api-access-grwg7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:02.107985 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.107969 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "98829171-73ea-410b-a9de-1bee8a53a3a5" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:02.108138 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.108110 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "98829171-73ea-410b-a9de-1bee8a53a3a5" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:02.109831 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.109807 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98829171-73ea-410b-a9de-1bee8a53a3a5-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "98829171-73ea-410b-a9de-1bee8a53a3a5" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:31:02.110296 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.110263 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "98829171-73ea-410b-a9de-1bee8a53a3a5" (UID: "98829171-73ea-410b-a9de-1bee8a53a3a5"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:02.168633 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.168502 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:02.193514 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.193478 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-certificates\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:02.193514 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.193516 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-installation-pull-secrets\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:02.193758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.193532 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/98829171-73ea-410b-a9de-1bee8a53a3a5-trusted-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:02.193758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.193542 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-registry-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:02.193758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.193551 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/98829171-73ea-410b-a9de-1bee8a53a3a5-ca-trust-extracted\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:02.193758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.193561 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/98829171-73ea-410b-a9de-1bee8a53a3a5-image-registry-private-configuration\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:02.193758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.193570 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-bound-sa-token\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:02.193758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.193579 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grwg7\" (UniqueName: \"kubernetes.io/projected/98829171-73ea-410b-a9de-1bee8a53a3a5-kube-api-access-grwg7\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:02.200513 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.200480 2566 generic.go:356] "Generic (PLEG): container finished" podID="98829171-73ea-410b-a9de-1bee8a53a3a5" containerID="0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a" exitCode=0 Jul 09 15:31:02.200632 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.200583 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7957579588-skgs8" Jul 09 15:31:02.200632 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.200602 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957579588-skgs8" event={"ID":"98829171-73ea-410b-a9de-1bee8a53a3a5","Type":"ContainerDied","Data":"0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a"} Jul 09 15:31:02.200720 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.200648 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7957579588-skgs8" event={"ID":"98829171-73ea-410b-a9de-1bee8a53a3a5","Type":"ContainerDied","Data":"58957cea35403982406dcc1d7f3be2f5234f34720dd9bde84f112eaa6ab164b7"} Jul 09 15:31:02.200720 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.200675 2566 scope.go:117] "RemoveContainer" containerID="0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a" Jul 09 15:31:02.203991 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.203945 2566 generic.go:356] "Generic (PLEG): container finished" podID="46d444eb-9e95-46c7-8995-e3121819bd70" containerID="245c209424be184b35aaafe0b98974885b84fd50fcc09dbfdaaecb7312731251" exitCode=0 Jul 09 15:31:02.204131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.204018 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hf8r" event={"ID":"46d444eb-9e95-46c7-8995-e3121819bd70","Type":"ContainerDied","Data":"245c209424be184b35aaafe0b98974885b84fd50fcc09dbfdaaecb7312731251"} Jul 09 15:31:02.208664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.208576 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" event={"ID":"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd","Type":"ContainerStarted","Data":"69096ed296a0ed77a456238956199a1980fbff2a1d7e62eccd35cda2af2dd59e"} Jul 09 15:31:02.208664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.208616 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" event={"ID":"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd","Type":"ContainerStarted","Data":"ce3c1a36c1eabbae60456e2b6613f50e1f5d1c090b3cf7749f665232947d71b8"} Jul 09 15:31:02.208664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.208634 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" event={"ID":"a64fa3a3-e1c7-440a-bf08-1da983e2d1fd","Type":"ContainerStarted","Data":"e592853edce55b796b1418196b7f7150ec2d837dd1955d952028818ceb58abfe"} Jul 09 15:31:02.211010 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.210898 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerStarted","Data":"163113957e22c80d8332e6009682e370ca06003ca04ffda719039c988c5802c4"} Jul 09 15:31:02.212405 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.212378 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" event={"ID":"52b3daa1-09af-4f56-ab7c-8b8b57258d0d","Type":"ContainerStarted","Data":"f14f99df7e708246e35dd763e06729d7a846c7fcff09d04fe14b0e3f09941c92"} Jul 09 15:31:02.236534 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.236502 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7957579588-skgs8"] Jul 09 15:31:02.243243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.243209 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7957579588-skgs8"] Jul 09 15:31:02.263448 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.263395 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-p9ggs" podStartSLOduration=2.5014415469999998 podStartE2EDuration="4.26337697s" totalImagesPullingTime="1.761935423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:02.262115816 +0000 UTC m=+283.541492417" watchObservedRunningTime="2026-07-09 15:31:02.26337697 +0000 UTC m=+283.542753532" Jul 09 15:31:02.473013 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.472985 2566 scope.go:117] "RemoveContainer" containerID="0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a" Jul 09 15:31:02.473417 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:31:02.473387 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a\": container with ID starting with 0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a not found: ID does not exist" containerID="0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a" Jul 09 15:31:02.473589 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.473428 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a"} err="failed to get container status \"0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a\": rpc error: code = NotFound desc = could not find container \"0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a\": container with ID starting with 0f35e1f3f2101a1e90b8e798e87f0450631e180d88c1336ac2db870d0557960a not found: ID does not exist" Jul 09 15:31:02.998623 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.998589 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-c7c5b69db-jvflp"] Jul 09 15:31:02.999106 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.999044 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98829171-73ea-410b-a9de-1bee8a53a3a5" containerName="registry" Jul 09 15:31:02.999106 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.999063 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="98829171-73ea-410b-a9de-1bee8a53a3a5" containerName="registry" Jul 09 15:31:02.999223 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:02.999136 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="98829171-73ea-410b-a9de-1bee8a53a3a5" containerName="registry" Jul 09 15:31:03.001314 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.001290 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.005365 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.004952 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 09 15:31:03.005365 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.005004 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 09 15:31:03.005365 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.005015 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 15:31:03.005365 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.005002 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 09 15:31:03.005365 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.004952 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-r46p2\"" Jul 09 15:31:03.005365 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.005288 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-45jp5f9btbrdu\"" Jul 09 15:31:03.011031 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.011003 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c7c5b69db-jvflp"] Jul 09 15:31:03.100750 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.100698 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-secret-metrics-server-client-certs\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.100941 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.100764 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c74a072-e089-458d-b3c1-23b1641925a1-audit-log\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.100941 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.100797 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-client-ca-bundle\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.100941 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.100860 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-secret-metrics-server-tls\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.100941 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.100878 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7zd4\" (UniqueName: \"kubernetes.io/projected/2c74a072-e089-458d-b3c1-23b1641925a1-kube-api-access-m7zd4\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.100941 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.100902 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c74a072-e089-458d-b3c1-23b1641925a1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.101177 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.100977 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c74a072-e089-458d-b3c1-23b1641925a1-metrics-server-audit-profiles\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202048 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-client-ca-bundle\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202233 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-secret-metrics-server-tls\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202233 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202108 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7zd4\" (UniqueName: \"kubernetes.io/projected/2c74a072-e089-458d-b3c1-23b1641925a1-kube-api-access-m7zd4\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202233 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c74a072-e089-458d-b3c1-23b1641925a1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202233 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202178 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c74a072-e089-458d-b3c1-23b1641925a1-metrics-server-audit-profiles\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202457 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202416 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-secret-metrics-server-client-certs\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202524 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202463 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c74a072-e089-458d-b3c1-23b1641925a1-audit-log\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202946 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202838 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/2c74a072-e089-458d-b3c1-23b1641925a1-audit-log\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.202946 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.202960 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c74a072-e089-458d-b3c1-23b1641925a1-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.203474 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.203447 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/2c74a072-e089-458d-b3c1-23b1641925a1-metrics-server-audit-profiles\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.204915 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.204885 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-secret-metrics-server-client-certs\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.204999 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.204983 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-secret-metrics-server-tls\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.204999 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.204993 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2c74a072-e089-458d-b3c1-23b1641925a1-client-ca-bundle\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.209933 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.209914 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7zd4\" (UniqueName: \"kubernetes.io/projected/2c74a072-e089-458d-b3c1-23b1641925a1-kube-api-access-m7zd4\") pod \"metrics-server-c7c5b69db-jvflp\" (UID: \"2c74a072-e089-458d-b3c1-23b1641925a1\") " pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.220247 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.220221 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hf8r" event={"ID":"46d444eb-9e95-46c7-8995-e3121819bd70","Type":"ContainerStarted","Data":"b39f2f053f17e28c495876eec6ddf3c2830a87e3e39b00d2faf3ddfd9332a55f"} Jul 09 15:31:03.220348 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.220279 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4hf8r" event={"ID":"46d444eb-9e95-46c7-8995-e3121819bd70","Type":"ContainerStarted","Data":"e12082ae95cebd0135f9d0eabff1d34a592af4a9fc78570904a4200fed0c6bc5"} Jul 09 15:31:03.222016 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.221987 2566 generic.go:356] "Generic (PLEG): container finished" podID="31399442-55b8-44be-b04d-f3473019560d" containerID="58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9" exitCode=0 Jul 09 15:31:03.222121 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.222087 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerDied","Data":"58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9"} Jul 09 15:31:03.240186 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.240136 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4hf8r" podStartSLOduration=3.5267407200000003 podStartE2EDuration="5.240116918s" totalImagesPullingTime="1.581773753s" totalInitContainerRuntime="131.602445ms" isStatefulPod=true podCreationTimestamp="2026-07-09 15:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:03.23957075 +0000 UTC m=+284.518947312" watchObservedRunningTime="2026-07-09 15:31:03.240116918 +0000 UTC m=+284.519493483" Jul 09 15:31:03.265822 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.265790 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98829171-73ea-410b-a9de-1bee8a53a3a5" path="/var/lib/kubelet/pods/98829171-73ea-410b-a9de-1bee8a53a3a5/volumes" Jul 09 15:31:03.312361 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.312323 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:03.455599 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.455569 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:03.455940 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.455916 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-c7c5b69db-jvflp"] Jul 09 15:31:03.460668 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:31:03.460640 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c74a072_e089_458d_b3c1_23b1641925a1.slice/crio-b22fa03ae5b68d8cd208414ad0e11f0cc58085e04df95a5ede817d6ec68f4bef WatchSource:0}: Error finding container b22fa03ae5b68d8cd208414ad0e11f0cc58085e04df95a5ede817d6ec68f4bef: Status 404 returned error can't find the container with id b22fa03ae5b68d8cd208414ad0e11f0cc58085e04df95a5ede817d6ec68f4bef Jul 09 15:31:03.470722 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.470671 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb"] Jul 09 15:31:03.474928 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.474855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:03.477375 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.477356 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-qhp5b\"" Jul 09 15:31:03.477878 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.477857 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 15:31:03.484489 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.484430 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb"] Jul 09 15:31:03.506212 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.506157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zllx4\" (UniqueName: \"kubernetes.io/projected/0b6d43a4-c23f-4f09-961e-ed7e29c65772-kube-api-access-zllx4\") pod \"monitoring-plugin-5f68df7f58-qj4nb\" (UID: \"0b6d43a4-c23f-4f09-961e-ed7e29c65772\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:03.506371 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.506225 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b6d43a4-c23f-4f09-961e-ed7e29c65772-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qj4nb\" (UID: \"0b6d43a4-c23f-4f09-961e-ed7e29c65772\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:03.526195 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.526140 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:03.607733 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.607676 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zllx4\" (UniqueName: \"kubernetes.io/projected/0b6d43a4-c23f-4f09-961e-ed7e29c65772-kube-api-access-zllx4\") pod \"monitoring-plugin-5f68df7f58-qj4nb\" (UID: \"0b6d43a4-c23f-4f09-961e-ed7e29c65772\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:03.607915 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.607755 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b6d43a4-c23f-4f09-961e-ed7e29c65772-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qj4nb\" (UID: \"0b6d43a4-c23f-4f09-961e-ed7e29c65772\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:03.607915 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:31:03.607878 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 15:31:03.608033 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:31:03.607937 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b6d43a4-c23f-4f09-961e-ed7e29c65772-monitoring-plugin-cert podName:0b6d43a4-c23f-4f09-961e-ed7e29c65772 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:04.107918979 +0000 UTC m=+285.387295522 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0b6d43a4-c23f-4f09-961e-ed7e29c65772-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-qj4nb" (UID: "0b6d43a4-c23f-4f09-961e-ed7e29c65772") : secret "monitoring-plugin-cert" not found Jul 09 15:31:03.616864 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.616835 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zllx4\" (UniqueName: \"kubernetes.io/projected/0b6d43a4-c23f-4f09-961e-ed7e29c65772-kube-api-access-zllx4\") pod \"monitoring-plugin-5f68df7f58-qj4nb\" (UID: \"0b6d43a4-c23f-4f09-961e-ed7e29c65772\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:03.911555 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.911515 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd"] Jul 09 15:31:03.914615 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.914591 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:03.917100 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.917078 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 15:31:03.917338 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.917315 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 15:31:03.917573 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.917452 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 15:31:03.917573 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.917472 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 15:31:03.917573 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.917547 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 15:31:03.917832 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.917610 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rlshw\"" Jul 09 15:31:03.927816 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.927790 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 15:31:03.932766 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:03.932700 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd"] Jul 09 15:31:04.011200 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.011162 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-telemeter-client-tls\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.011651 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.011207 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-serving-certs-ca-bundle\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.011651 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.011242 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn8gj\" (UniqueName: \"kubernetes.io/projected/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-kube-api-access-dn8gj\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.011651 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.011292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.011651 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.011348 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-secret-telemeter-client\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.011651 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.011364 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-metrics-client-ca\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.011651 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.011392 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-federate-client-tls\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.011651 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.011429 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.048027 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.047989 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112444 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112524 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-secret-telemeter-client\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112553 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-metrics-client-ca\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112595 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-federate-client-tls\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112621 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112657 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b6d43a4-c23f-4f09-961e-ed7e29c65772-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qj4nb\" (UID: \"0b6d43a4-c23f-4f09-961e-ed7e29c65772\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112701 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-telemeter-client-tls\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112763 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-serving-certs-ca-bundle\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.113525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.112797 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn8gj\" (UniqueName: \"kubernetes.io/projected/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-kube-api-access-dn8gj\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.114137 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.113586 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.114639 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.114611 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-metrics-client-ca\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.115230 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.115205 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-serving-certs-ca-bundle\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.118653 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.118625 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-secret-telemeter-client\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.118805 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.118687 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-federate-client-tls\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.120097 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.120067 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.120354 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.120324 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-telemeter-client-tls\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.120461 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.120330 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0b6d43a4-c23f-4f09-961e-ed7e29c65772-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-qj4nb\" (UID: \"0b6d43a4-c23f-4f09-961e-ed7e29c65772\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:04.128859 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.128821 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn8gj\" (UniqueName: \"kubernetes.io/projected/1f21b4c4-907c-4fea-9ca7-33a7e2abadda-kube-api-access-dn8gj\") pod \"telemeter-client-6dc9c55b6f-hl5vd\" (UID: \"1f21b4c4-907c-4fea-9ca7-33a7e2abadda\") " pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.230233 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.230106 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" event={"ID":"2c74a072-e089-458d-b3c1-23b1641925a1","Type":"ContainerStarted","Data":"b22fa03ae5b68d8cd208414ad0e11f0cc58085e04df95a5ede817d6ec68f4bef"} Jul 09 15:31:04.232665 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.232448 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" Jul 09 15:31:04.387535 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.387364 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:04.434824 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.433411 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd"] Jul 09 15:31:04.516643 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.516602 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:31:04.519537 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.519509 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ff2dedf4-d7c0-42c7-a274-7d13ac2fffae-metrics-tls\") pod \"dns-default-xzvk5\" (UID: \"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae\") " pod="openshift-dns/dns-default-xzvk5" Jul 09 15:31:04.797639 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.797379 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fhd5m\"" Jul 09 15:31:04.805006 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.804799 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xzvk5" Jul 09 15:31:04.809981 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:31:04.809949 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f21b4c4_907c_4fea_9ca7_33a7e2abadda.slice/crio-0800f2d255b4870fcab72029fdb99489f92b79afd053862783ba1200f387062a WatchSource:0}: Error finding container 0800f2d255b4870fcab72029fdb99489f92b79afd053862783ba1200f387062a: Status 404 returned error can't find the container with id 0800f2d255b4870fcab72029fdb99489f92b79afd053862783ba1200f387062a Jul 09 15:31:04.894503 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:04.894442 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:05.237625 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:05.237537 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" event={"ID":"1f21b4c4-907c-4fea-9ca7-33a7e2abadda","Type":"ContainerStarted","Data":"0800f2d255b4870fcab72029fdb99489f92b79afd053862783ba1200f387062a"} Jul 09 15:31:05.616329 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:05.614673 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb"] Jul 09 15:31:05.624195 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:31:05.624154 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b6d43a4_c23f_4f09_961e_ed7e29c65772.slice/crio-4cf661d779299519b9f00a95c3555663b3bc76a5878f0048bceaace9942cd45d WatchSource:0}: Error finding container 4cf661d779299519b9f00a95c3555663b3bc76a5878f0048bceaace9942cd45d: Status 404 returned error can't find the container with id 4cf661d779299519b9f00a95c3555663b3bc76a5878f0048bceaace9942cd45d Jul 09 15:31:05.632667 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:05.632544 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xzvk5"] Jul 09 15:31:05.987987 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:05.987914 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:05.995304 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:05.994062 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-695bd4b6d-fp6ql"] Jul 09 15:31:05.998069 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:05.997911 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.001192 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.001169 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 15:31:06.001311 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.001268 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-trsf6\"" Jul 09 15:31:06.001491 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.001471 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 15:31:06.002454 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.002434 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 15:31:06.002779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.002696 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 15:31:06.002947 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.002927 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 15:31:06.009825 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.009336 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-695bd4b6d-fp6ql"] Jul 09 15:31:06.010892 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.010859 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 15:31:06.030798 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.030724 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-serving-cert\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.030967 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.030830 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-oauth-serving-cert\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.030967 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.030881 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8dh5\" (UniqueName: \"kubernetes.io/projected/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-kube-api-access-t8dh5\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.030967 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.030909 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-oauth-config\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.030967 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.030945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-service-ca\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.031167 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.030970 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-trusted-ca-bundle\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.031167 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.031003 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-config\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.054238 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.054151 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:06.131817 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.131775 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-serving-cert\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.131999 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.131869 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-oauth-serving-cert\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.131999 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.131912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8dh5\" (UniqueName: \"kubernetes.io/projected/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-kube-api-access-t8dh5\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.131999 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.131938 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-oauth-config\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.131999 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.131973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-service-ca\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.131999 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.131994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-trusted-ca-bundle\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.132235 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.132049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-config\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.132925 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.132876 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-config\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.133049 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.132951 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-oauth-serving-cert\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.133049 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.133012 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-service-ca\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.133333 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.133300 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-trusted-ca-bundle\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.135643 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.135599 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-serving-cert\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.135779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.135747 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-oauth-config\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.142000 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.141949 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8dh5\" (UniqueName: \"kubernetes.io/projected/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-kube-api-access-t8dh5\") pod \"console-695bd4b6d-fp6ql\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.246552 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.246468 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" event={"ID":"2c74a072-e089-458d-b3c1-23b1641925a1","Type":"ContainerStarted","Data":"1e45fb7393634fef369622925a2c81bb22808ae768070162ce8c94b0d8022ece"} Jul 09 15:31:06.248415 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.248373 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" event={"ID":"0b6d43a4-c23f-4f09-961e-ed7e29c65772","Type":"ContainerStarted","Data":"4cf661d779299519b9f00a95c3555663b3bc76a5878f0048bceaace9942cd45d"} Jul 09 15:31:06.252929 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.252085 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerStarted","Data":"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652"} Jul 09 15:31:06.252929 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.252151 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerStarted","Data":"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f"} Jul 09 15:31:06.252929 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.252190 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerStarted","Data":"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803"} Jul 09 15:31:06.255375 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.255322 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzvk5" event={"ID":"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae","Type":"ContainerStarted","Data":"30e360d040f459fa4835b6582255da1de3c623a52b200e3ec6b70907681bb566"} Jul 09 15:31:06.275791 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.273678 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" podStartSLOduration=2.328152571 podStartE2EDuration="4.273654787s" totalImagesPullingTime="1.945502216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:06.267896775 +0000 UTC m=+287.547273340" watchObservedRunningTime="2026-07-09 15:31:06.273654787 +0000 UTC m=+287.553031349" Jul 09 15:31:06.312455 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.312420 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:06.684390 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:06.684357 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-695bd4b6d-fp6ql"] Jul 09 15:31:06.692552 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:31:06.692525 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4b7b3d_f1df_4541_828b_bbe2c7e5d721.slice/crio-e2c7839b9a139abbcf0c4ab56c3058e0c192c1c0a38aa7d7f8269b8d1d2d138f WatchSource:0}: Error finding container e2c7839b9a139abbcf0c4ab56c3058e0c192c1c0a38aa7d7f8269b8d1d2d138f: Status 404 returned error can't find the container with id e2c7839b9a139abbcf0c4ab56c3058e0c192c1c0a38aa7d7f8269b8d1d2d138f Jul 09 15:31:07.265103 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:07.264817 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" event={"ID":"52b3daa1-09af-4f56-ab7c-8b8b57258d0d","Type":"ContainerStarted","Data":"500ff45c8ecdbd4b9e82eb16a8fabb4d55aa7279946808a5b73f49978f0dd450"} Jul 09 15:31:07.265103 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:07.264902 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" event={"ID":"52b3daa1-09af-4f56-ab7c-8b8b57258d0d","Type":"ContainerStarted","Data":"a95c4012b61e08fb4eccef7479395ab9b7da646ead5f0d31fdd950d25f64ff76"} Jul 09 15:31:07.266311 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:07.266267 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695bd4b6d-fp6ql" event={"ID":"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721","Type":"ContainerStarted","Data":"e2c7839b9a139abbcf0c4ab56c3058e0c192c1c0a38aa7d7f8269b8d1d2d138f"} Jul 09 15:31:07.270982 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:07.270957 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerStarted","Data":"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6"} Jul 09 15:31:07.271096 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:07.271014 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerStarted","Data":"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d"} Jul 09 15:31:09.059489 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.059423 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:09.281459 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.281423 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzvk5" event={"ID":"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae","Type":"ContainerStarted","Data":"8722e14435c5e90030aae189f8e470b660b406f8879e8c839a64442792e1c244"} Jul 09 15:31:09.281650 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.281483 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xzvk5" event={"ID":"ff2dedf4-d7c0-42c7-a274-7d13ac2fffae","Type":"ContainerStarted","Data":"bd8893c9385cfa1b24494261e87803fec394a19e5ae9a66e9b9f41ad599eca03"} Jul 09 15:31:09.281650 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.281567 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xzvk5" Jul 09 15:31:09.283967 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.283936 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" event={"ID":"52b3daa1-09af-4f56-ab7c-8b8b57258d0d","Type":"ContainerStarted","Data":"9f8cf9e14eda2ad75d45bf669a9c3a15a2bba2dff294ba380d24fe991945e8e6"} Jul 09 15:31:09.286136 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.286102 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" event={"ID":"1f21b4c4-907c-4fea-9ca7-33a7e2abadda","Type":"ContainerStarted","Data":"8ba5f0c4bb424ade1b542cd7c1c988599b20894b3a87b659fe6becaea3c17638"} Jul 09 15:31:09.286257 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.286164 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" event={"ID":"1f21b4c4-907c-4fea-9ca7-33a7e2abadda","Type":"ContainerStarted","Data":"03ce97384be04259235f9af3f6f5866b263bbd522ec64dabd272467969dd91d8"} Jul 09 15:31:09.286257 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.286195 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" event={"ID":"1f21b4c4-907c-4fea-9ca7-33a7e2abadda","Type":"ContainerStarted","Data":"7ec955968c56325b4dd7865f0f966bc0fe769fcdb4d92722d32ce21175596f12"} Jul 09 15:31:09.288082 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.288060 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" event={"ID":"0b6d43a4-c23f-4f09-961e-ed7e29c65772","Type":"ContainerStarted","Data":"9419dab35e8f9b877b749b9c38a54f114490f7c40633961579e4bfcb82bcefd3"} Jul 09 15:31:09.288219 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.288203 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:09.291953 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.291927 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerStarted","Data":"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365"} Jul 09 15:31:09.293949 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.293925 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" Jul 09 15:31:09.300055 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.300018 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xzvk5" podStartSLOduration=252.259868754 podStartE2EDuration="4m15.300000595s" totalImagesPullingTime="3.040131841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:09.29808249 +0000 UTC m=+290.577459074" watchObservedRunningTime="2026-07-09 15:31:09.300000595 +0000 UTC m=+290.579377156" Jul 09 15:31:09.314479 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.314390 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-qj4nb" podStartSLOduration=3.452610986 podStartE2EDuration="6.314377936s" totalImagesPullingTime="2.86176695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:09.313068063 +0000 UTC m=+290.592444647" watchObservedRunningTime="2026-07-09 15:31:09.314377936 +0000 UTC m=+290.593754497" Jul 09 15:31:09.334837 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.334795 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6dc9c55b6f-hl5vd" podStartSLOduration=2.661011598 podStartE2EDuration="6.334777817s" totalImagesPullingTime="3.673766219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:09.33227954 +0000 UTC m=+290.611656130" watchObservedRunningTime="2026-07-09 15:31:09.334777817 +0000 UTC m=+290.614154378" Jul 09 15:31:09.358014 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:09.357963 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.888466092 podStartE2EDuration="10.357947628s" totalImagesPullingTime="5.443079505s" totalInitContainerRuntime="26.402031ms" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:09.356432685 +0000 UTC m=+290.635809248" watchObservedRunningTime="2026-07-09 15:31:09.357947628 +0000 UTC m=+290.637324189" Jul 09 15:31:10.303038 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.301855 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" event={"ID":"52b3daa1-09af-4f56-ab7c-8b8b57258d0d","Type":"ContainerStarted","Data":"a17ae72dd1e461e7b9d1c6290bfb13c0391e6cac46e67220c839667c91d51db2"} Jul 09 15:31:10.303038 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.301937 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" event={"ID":"52b3daa1-09af-4f56-ab7c-8b8b57258d0d","Type":"ContainerStarted","Data":"fb638472b4d25440ab9fdee5948acdbb445958c38fd87964307062d64e509afe"} Jul 09 15:31:10.303038 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.301979 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" event={"ID":"52b3daa1-09af-4f56-ab7c-8b8b57258d0d","Type":"ContainerStarted","Data":"a2084373c33b127cfa99f1fcd76e35ed07044308b9f2aedd3fcd6401a78f7730"} Jul 09 15:31:10.328985 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.328930 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" podStartSLOduration=4.377180123 podStartE2EDuration="10.328912884s" totalImagesPullingTime="5.951732761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:10.326293121 +0000 UTC m=+291.605669683" watchObservedRunningTime="2026-07-09 15:31:10.328912884 +0000 UTC m=+291.608289443" Jul 09 15:31:10.371010 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.370960 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57b84cbc54-gt95s"] Jul 09 15:31:10.373876 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.373850 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.386387 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.386358 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b84cbc54-gt95s"] Jul 09 15:31:10.478513 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.478478 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w77zq\" (UniqueName: \"kubernetes.io/projected/43e51913-a19a-46d9-8a80-dff5073ab122-kube-api-access-w77zq\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.478758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.478538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-oauth-config\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.478758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.478563 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-service-ca\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.478758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.478588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-trusted-ca-bundle\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.478758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.478618 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-oauth-serving-cert\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.478758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.478673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-console-config\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.478758 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.478729 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-serving-cert\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.580145 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580054 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-oauth-config\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.580145 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-service-ca\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.580145 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580124 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-trusted-ca-bundle\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.580421 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580156 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-oauth-serving-cert\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.580421 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580217 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-console-config\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.580421 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580249 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-serving-cert\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.580421 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580306 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w77zq\" (UniqueName: \"kubernetes.io/projected/43e51913-a19a-46d9-8a80-dff5073ab122-kube-api-access-w77zq\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.580998 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580966 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-service-ca\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.581117 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.580973 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-console-config\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.581117 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.581025 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-oauth-serving-cert\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.581389 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.581139 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-trusted-ca-bundle\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.582990 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.582965 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-oauth-config\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.583395 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.583373 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-serving-cert\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.588505 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.588483 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w77zq\" (UniqueName: \"kubernetes.io/projected/43e51913-a19a-46d9-8a80-dff5073ab122-kube-api-access-w77zq\") pod \"console-57b84cbc54-gt95s\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:10.641221 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.641185 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:10.685726 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:10.685669 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:11.237255 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:11.237202 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:11.301520 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:11.301488 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:11.307774 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:11.307743 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:11.314870 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:11.314847 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5f9978c7cd-wslhw" Jul 09 15:31:11.582473 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:11.582428 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:11.643973 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:11.643937 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:12.835517 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:12.835483 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:12.937665 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:12.937633 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:14.136318 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:14.136283 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:14.198744 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:14.198688 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:14.296414 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:14.296378 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:14.396511 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:14.396417 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:16.200779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:16.200741 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:16.305796 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:16.305689 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:17.321128 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:17.321106 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57b84cbc54-gt95s"] Jul 09 15:31:17.323925 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:31:17.323898 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e51913_a19a_46d9_8a80_dff5073ab122.slice/crio-120cd9aa2f1a5aaf7562bcdd15c65cd1fceaa0f698d7af00b3a73a7d9a3712dd WatchSource:0}: Error finding container 120cd9aa2f1a5aaf7562bcdd15c65cd1fceaa0f698d7af00b3a73a7d9a3712dd: Status 404 returned error can't find the container with id 120cd9aa2f1a5aaf7562bcdd15c65cd1fceaa0f698d7af00b3a73a7d9a3712dd Jul 09 15:31:17.335640 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:17.335613 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b84cbc54-gt95s" event={"ID":"43e51913-a19a-46d9-8a80-dff5073ab122","Type":"ContainerStarted","Data":"120cd9aa2f1a5aaf7562bcdd15c65cd1fceaa0f698d7af00b3a73a7d9a3712dd"} Jul 09 15:31:18.353656 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:18.353623 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-sgr6r" event={"ID":"d9914449-833f-41ac-bbe4-c9a70c0bdbec","Type":"ContainerStarted","Data":"09616c7eb965340104bbff4da257d110fad17241e484c898e0de1df830befe19"} Jul 09 15:31:18.355069 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:18.355009 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-sgr6r" Jul 09 15:31:18.365166 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:18.365143 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-sgr6r" Jul 09 15:31:18.403166 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:18.403002 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-sgr6r" podStartSLOduration=2.070540351 podStartE2EDuration="23.402978259s" totalImagesPullingTime="21.332437908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:18.377961679 +0000 UTC m=+299.657338243" watchObservedRunningTime="2026-07-09 15:31:18.402978259 +0000 UTC m=+299.682354834" Jul 09 15:31:19.186916 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:19.183884 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:31:19.186916 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:19.184770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:31:19.205055 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:19.205027 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:31:19.208509 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:19.208489 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:31:19.214285 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:19.214227 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 15:31:19.306078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:19.305064 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xzvk5" Jul 09 15:31:20.320836 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:20.320780 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:20.380118 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:20.380022 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:22.377140 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:22.377100 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695bd4b6d-fp6ql" event={"ID":"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721","Type":"ContainerStarted","Data":"069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a"} Jul 09 15:31:22.379037 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:22.379001 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b84cbc54-gt95s" event={"ID":"43e51913-a19a-46d9-8a80-dff5073ab122","Type":"ContainerStarted","Data":"f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef"} Jul 09 15:31:22.397566 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:22.397505 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-695bd4b6d-fp6ql" podStartSLOduration=2.6935118559999998 podStartE2EDuration="17.397484861s" totalImagesPullingTime="14.703973005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:22.396802341 +0000 UTC m=+303.676178903" watchObservedRunningTime="2026-07-09 15:31:22.397484861 +0000 UTC m=+303.676861425" Jul 09 15:31:22.416217 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:22.416153 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57b84cbc54-gt95s" podStartSLOduration=8.166837593 podStartE2EDuration="12.416133277s" totalImagesPullingTime="4.249295684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:31:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:22.415690851 +0000 UTC m=+303.695067412" watchObservedRunningTime="2026-07-09 15:31:22.416133277 +0000 UTC m=+303.695509839" Jul 09 15:31:23.312610 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:23.312575 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:23.312858 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:23.312648 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:25.188345 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:25.188306 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:25.247350 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:25.247314 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:26.313521 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:26.313487 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:26.313988 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:26.313572 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:26.319078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:26.319057 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:26.406527 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:26.406499 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:27.269512 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:27.269469 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:27.335531 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:27.335494 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:27.824049 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:27.824015 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:27.922088 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:27.922052 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:28.590844 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:28.590810 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:28.691574 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:28.691545 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:29.414936 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:29.414905 2566 generic.go:356] "Generic (PLEG): container finished" podID="2e707eba-5a8c-4086-9a05-cbb66791b425" containerID="a3932ef0e81f6d6cb7c3f69d5fc0058fbd5d1ad67a588df77f3ae66744c44dc8" exitCode=0 Jul 09 15:31:29.415100 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:29.414990 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" event={"ID":"2e707eba-5a8c-4086-9a05-cbb66791b425","Type":"ContainerDied","Data":"a3932ef0e81f6d6cb7c3f69d5fc0058fbd5d1ad67a588df77f3ae66744c44dc8"} Jul 09 15:31:29.415350 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:29.415337 2566 scope.go:117] "RemoveContainer" containerID="a3932ef0e81f6d6cb7c3f69d5fc0058fbd5d1ad67a588df77f3ae66744c44dc8" Jul 09 15:31:30.421339 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:30.421307 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-s7qk6" event={"ID":"2e707eba-5a8c-4086-9a05-cbb66791b425","Type":"ContainerStarted","Data":"25181d2f4cb499cc52d7bed2320b80d08f81ef244eb70cd21013b076c70de7f3"} Jul 09 15:31:30.686846 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:30.686766 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:30.686846 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:30.686821 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:30.691644 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:30.691623 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:31.429782 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:31.429751 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:31:31.473226 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:31.473197 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-695bd4b6d-fp6ql"] Jul 09 15:31:31.612792 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:31.612742 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:31.669567 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:31.669534 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:32.609414 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:32.609385 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:36.207266 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:36.207227 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:36.308206 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:36.308178 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:37.691057 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:37.691025 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:37.792494 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:37.792462 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:37.896102 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:37.896073 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:41.821164 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:41.821120 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:41.921817 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:41.921770 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:31:43.317918 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:43.317889 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:43.321581 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:43.321558 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-c7c5b69db-jvflp" Jul 09 15:31:56.501878 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.501840 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-695bd4b6d-fp6ql" podUID="cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" containerName="console" containerID="cri-o://069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a" gracePeriod=15 Jul 09 15:31:56.776024 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.775966 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:56.909961 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.909928 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-oauth-config\") pod \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " Jul 09 15:31:56.910148 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.909972 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-serving-cert\") pod \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " Jul 09 15:31:56.910148 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.909992 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-oauth-serving-cert\") pod \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " Jul 09 15:31:56.910148 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.910013 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-trusted-ca-bundle\") pod \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " Jul 09 15:31:56.910148 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.910044 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-service-ca\") pod \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " Jul 09 15:31:56.910148 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.910087 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8dh5\" (UniqueName: \"kubernetes.io/projected/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-kube-api-access-t8dh5\") pod \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " Jul 09 15:31:56.910148 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.910133 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-config\") pod \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\" (UID: \"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721\") " Jul 09 15:31:56.910555 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.910505 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" (UID: "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:56.910754 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.910547 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" (UID: "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:56.910754 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.910545 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" (UID: "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:56.910754 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.910636 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-config" (OuterVolumeSpecName: "console-config") pod "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" (UID: "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:56.912464 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.912436 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" (UID: "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:56.912464 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.912443 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-kube-api-access-t8dh5" (OuterVolumeSpecName: "kube-api-access-t8dh5") pod "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" (UID: "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721"). InnerVolumeSpecName "kube-api-access-t8dh5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:56.912577 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:56.912447 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" (UID: "cd4b7b3d-f1df-4541-828b-bbe2c7e5d721"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:57.011057 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.011021 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8dh5\" (UniqueName: \"kubernetes.io/projected/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-kube-api-access-t8dh5\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:57.011057 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.011052 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:57.011057 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.011063 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-oauth-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:57.011288 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.011073 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-console-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:57.011288 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.011081 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-oauth-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:57.011288 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.011091 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:57.011288 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.011099 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:31:57.539394 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.539315 2566 generic.go:356] "Generic (PLEG): container finished" podID="cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" containerID="069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a" exitCode=0 Jul 09 15:31:57.539394 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.539386 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-695bd4b6d-fp6ql" Jul 09 15:31:57.539842 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.539405 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695bd4b6d-fp6ql" event={"ID":"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721","Type":"ContainerDied","Data":"069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a"} Jul 09 15:31:57.539842 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.539494 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-695bd4b6d-fp6ql" event={"ID":"cd4b7b3d-f1df-4541-828b-bbe2c7e5d721","Type":"ContainerDied","Data":"e2c7839b9a139abbcf0c4ab56c3058e0c192c1c0a38aa7d7f8269b8d1d2d138f"} Jul 09 15:31:57.539842 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.539521 2566 scope.go:117] "RemoveContainer" containerID="069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a" Jul 09 15:31:57.553347 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.553329 2566 scope.go:117] "RemoveContainer" containerID="069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a" Jul 09 15:31:57.553620 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:31:57.553601 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a\": container with ID starting with 069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a not found: ID does not exist" containerID="069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a" Jul 09 15:31:57.553668 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.553631 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a"} err="failed to get container status \"069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a\": rpc error: code = NotFound desc = could not find container \"069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a\": container with ID starting with 069c4f53dbf0ac888fa359788955a6e6527a9fbacd16b06c0153eb771085ae9a not found: ID does not exist" Jul 09 15:31:57.557381 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.557357 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-695bd4b6d-fp6ql"] Jul 09 15:31:57.563486 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:57.563465 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-695bd4b6d-fp6ql"] Jul 09 15:31:59.263025 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:31:59.262992 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" path="/var/lib/kubelet/pods/cd4b7b3d-f1df-4541-828b-bbe2c7e5d721/volumes" Jul 09 15:32:14.798431 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:14.798339 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:14.850102 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:14.850068 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.370873 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.370838 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-559d5d7458-6t48n"] Jul 09 15:32:17.371857 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.371833 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" containerName="console" Jul 09 15:32:17.372024 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.372010 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" containerName="console" Jul 09 15:32:17.372290 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.372273 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd4b7b3d-f1df-4541-828b-bbe2c7e5d721" containerName="console" Jul 09 15:32:17.374717 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.374693 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.390898 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.390871 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559d5d7458-6t48n"] Jul 09 15:32:17.445098 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.445065 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.495147 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.495099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-oauth-config\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.495147 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.495146 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-oauth-serving-cert\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.495355 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.495170 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2nlf\" (UniqueName: \"kubernetes.io/projected/f7487d7a-f5df-437c-980a-1edbcd0d0f15-kube-api-access-c2nlf\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.495355 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.495254 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-trusted-ca-bundle\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.495355 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.495307 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-service-ca\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.495454 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.495370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-serving-cert\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.495454 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.495409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-config\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.542382 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.542347 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:17.596006 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.595973 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-config\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.596178 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596030 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-oauth-config\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.596178 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596051 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-oauth-serving-cert\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.596178 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2nlf\" (UniqueName: \"kubernetes.io/projected/f7487d7a-f5df-437c-980a-1edbcd0d0f15-kube-api-access-c2nlf\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.596178 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596105 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-trusted-ca-bundle\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.596178 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-service-ca\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.596440 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-serving-cert\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.596864 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596787 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-config\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.596864 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596832 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-service-ca\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.597139 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596981 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-trusted-ca-bundle\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.597139 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.596992 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-oauth-serving-cert\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.598676 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.598646 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-oauth-config\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.598789 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.598771 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-serving-cert\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.605450 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.605425 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2nlf\" (UniqueName: \"kubernetes.io/projected/f7487d7a-f5df-437c-980a-1edbcd0d0f15-kube-api-access-c2nlf\") pod \"console-559d5d7458-6t48n\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.684618 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.684533 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:17.823406 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:17.823238 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-559d5d7458-6t48n"] Jul 09 15:32:17.826165 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:32:17.826135 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7487d7a_f5df_437c_980a_1edbcd0d0f15.slice/crio-b81dec7d8edcc28ce0aa218d61bcc47782b3adcb71846b5e15b75feebe9eb724 WatchSource:0}: Error finding container b81dec7d8edcc28ce0aa218d61bcc47782b3adcb71846b5e15b75feebe9eb724: Status 404 returned error can't find the container with id b81dec7d8edcc28ce0aa218d61bcc47782b3adcb71846b5e15b75feebe9eb724 Jul 09 15:32:18.624923 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:18.624884 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559d5d7458-6t48n" event={"ID":"f7487d7a-f5df-437c-980a-1edbcd0d0f15","Type":"ContainerStarted","Data":"1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061"} Jul 09 15:32:18.625277 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:18.624939 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559d5d7458-6t48n" event={"ID":"f7487d7a-f5df-437c-980a-1edbcd0d0f15","Type":"ContainerStarted","Data":"b81dec7d8edcc28ce0aa218d61bcc47782b3adcb71846b5e15b75feebe9eb724"} Jul 09 15:32:18.643886 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:18.643824 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-559d5d7458-6t48n" podStartSLOduration=1.6438073640000002 podStartE2EDuration="1.643807364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:18.642931646 +0000 UTC m=+359.922308209" watchObservedRunningTime="2026-07-09 15:32:18.643807364 +0000 UTC m=+359.923183994" Jul 09 15:32:19.090276 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.090245 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:19.090551 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.090531 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="alertmanager" containerID="cri-o://7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803" gracePeriod=120 Jul 09 15:32:19.090611 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.090588 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy-metric" containerID="cri-o://25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6" gracePeriod=120 Jul 09 15:32:19.090669 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.090637 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy-web" containerID="cri-o://1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652" gracePeriod=120 Jul 09 15:32:19.090751 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.090664 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="prom-label-proxy" containerID="cri-o://d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365" gracePeriod=120 Jul 09 15:32:19.090751 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.090676 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="config-reloader" containerID="cri-o://ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f" gracePeriod=120 Jul 09 15:32:19.090751 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.090664 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy" containerID="cri-o://60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d" gracePeriod=120 Jul 09 15:32:19.631955 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.631919 2566 generic.go:356] "Generic (PLEG): container finished" podID="31399442-55b8-44be-b04d-f3473019560d" containerID="d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365" exitCode=0 Jul 09 15:32:19.631955 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.631946 2566 generic.go:356] "Generic (PLEG): container finished" podID="31399442-55b8-44be-b04d-f3473019560d" containerID="60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d" exitCode=0 Jul 09 15:32:19.631955 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.631953 2566 generic.go:356] "Generic (PLEG): container finished" podID="31399442-55b8-44be-b04d-f3473019560d" containerID="ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f" exitCode=0 Jul 09 15:32:19.631955 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.631958 2566 generic.go:356] "Generic (PLEG): container finished" podID="31399442-55b8-44be-b04d-f3473019560d" containerID="7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803" exitCode=0 Jul 09 15:32:19.632404 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.631987 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerDied","Data":"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365"} Jul 09 15:32:19.632404 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.632051 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerDied","Data":"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d"} Jul 09 15:32:19.632404 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.632079 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerDied","Data":"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f"} Jul 09 15:32:19.632404 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:19.632111 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerDied","Data":"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803"} Jul 09 15:32:19.966027 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:19.965938 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:32:20.047762 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.047721 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:20.106231 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.106201 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:20.345819 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.345791 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.526664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.526561 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-metrics-client-ca\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.526664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.526612 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.526664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.526642 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-tls-assets\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.526664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.526673 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527017 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.526695 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-config-volume\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527017 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.526741 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-web-config\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527017 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.526758 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-cluster-tls-config\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527177 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.526982 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.527177 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.527098 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-web\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527177 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.527171 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-config-out\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527399 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.527222 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gll4\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-kube-api-access-9gll4\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527554 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.527446 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-alertmanager-main-db\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527554 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.527475 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.527554 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.527511 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy\") pod \"31399442-55b8-44be-b04d-f3473019560d\" (UID: \"31399442-55b8-44be-b04d-f3473019560d\") " Jul 09 15:32:20.528129 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.527768 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:20.528129 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.527831 2566 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-metrics-client-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.528129 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.528081 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:32:20.530189 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.530149 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-config-volume" (OuterVolumeSpecName: "config-volume") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.530447 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.530409 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:32:20.530447 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.530420 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.530447 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.530440 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.530824 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.530797 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-config-out" (OuterVolumeSpecName: "config-out") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:32:20.531206 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.531183 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-kube-api-access-9gll4" (OuterVolumeSpecName: "kube-api-access-9gll4") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "kube-api-access-9gll4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:32:20.531848 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.531825 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.531848 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.531841 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.534628 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.534607 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.541878 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.541858 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-web-config" (OuterVolumeSpecName: "web-config") pod "31399442-55b8-44be-b04d-f3473019560d" (UID: "31399442-55b8-44be-b04d-f3473019560d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:20.628530 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628485 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-tls-assets\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628530 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628525 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628530 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628535 2566 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-config-volume\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628530 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628544 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-web-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628552 2566 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-cluster-tls-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628562 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628570 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-config-out\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628580 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gll4\" (UniqueName: \"kubernetes.io/projected/31399442-55b8-44be-b04d-f3473019560d-kube-api-access-9gll4\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628587 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/31399442-55b8-44be-b04d-f3473019560d-alertmanager-main-db\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628596 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-main-tls\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628605 2566 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31399442-55b8-44be-b04d-f3473019560d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.628823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.628614 2566 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31399442-55b8-44be-b04d-f3473019560d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:20.639668 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.639637 2566 generic.go:356] "Generic (PLEG): container finished" podID="31399442-55b8-44be-b04d-f3473019560d" containerID="25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6" exitCode=0 Jul 09 15:32:20.639668 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.639662 2566 generic.go:356] "Generic (PLEG): container finished" podID="31399442-55b8-44be-b04d-f3473019560d" containerID="1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652" exitCode=0 Jul 09 15:32:20.640176 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.639719 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerDied","Data":"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6"} Jul 09 15:32:20.640176 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.639742 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.640176 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.639785 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerDied","Data":"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652"} Jul 09 15:32:20.640176 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.639814 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"31399442-55b8-44be-b04d-f3473019560d","Type":"ContainerDied","Data":"163113957e22c80d8332e6009682e370ca06003ca04ffda719039c988c5802c4"} Jul 09 15:32:20.640176 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.639852 2566 scope.go:117] "RemoveContainer" containerID="d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365" Jul 09 15:32:20.648285 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.648269 2566 scope.go:117] "RemoveContainer" containerID="25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6" Jul 09 15:32:20.655538 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.655522 2566 scope.go:117] "RemoveContainer" containerID="60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d" Jul 09 15:32:20.662600 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.662584 2566 scope.go:117] "RemoveContainer" containerID="1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652" Jul 09 15:32:20.664385 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.664364 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:20.668629 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.668609 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:20.670347 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.670330 2566 scope.go:117] "RemoveContainer" containerID="ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f" Jul 09 15:32:20.677526 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.677508 2566 scope.go:117] "RemoveContainer" containerID="7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803" Jul 09 15:32:20.685446 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.685424 2566 scope.go:117] "RemoveContainer" containerID="58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9" Jul 09 15:32:20.695361 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695336 2566 scope.go:117] "RemoveContainer" containerID="d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365" Jul 09 15:32:20.695626 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695608 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:20.695694 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:20.695632 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365\": container with ID starting with d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365 not found: ID does not exist" containerID="d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365" Jul 09 15:32:20.695694 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695665 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365"} err="failed to get container status \"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365\": rpc error: code = NotFound desc = could not find container \"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365\": container with ID starting with d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365 not found: ID does not exist" Jul 09 15:32:20.695838 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695695 2566 scope.go:117] "RemoveContainer" containerID="25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6" Jul 09 15:32:20.695949 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695936 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="init-config-reloader" Jul 09 15:32:20.695991 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695951 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="init-config-reloader" Jul 09 15:32:20.695991 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:20.695947 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6\": container with ID starting with 25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6 not found: ID does not exist" containerID="25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6" Jul 09 15:32:20.695991 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695981 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6"} err="failed to get container status \"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6\": rpc error: code = NotFound desc = could not find container \"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6\": container with ID starting with 25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6 not found: ID does not exist" Jul 09 15:32:20.696089 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695998 2566 scope.go:117] "RemoveContainer" containerID="60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d" Jul 09 15:32:20.696089 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.695961 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy-metric" Jul 09 15:32:20.696089 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696042 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy-metric" Jul 09 15:32:20.696089 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696056 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="config-reloader" Jul 09 15:32:20.696089 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696065 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="config-reloader" Jul 09 15:32:20.696089 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696075 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy" Jul 09 15:32:20.696089 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696083 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696101 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy-web" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696109 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy-web" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696122 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="alertmanager" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696129 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="alertmanager" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696138 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="prom-label-proxy" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696146 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="prom-label-proxy" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696237 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy-metric" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696253 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="config-reloader" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696261 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:20.696258 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d\": container with ID starting with 60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d not found: ID does not exist" containerID="60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696287 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d"} err="failed to get container status \"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d\": rpc error: code = NotFound desc = could not find container \"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d\": container with ID starting with 60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d not found: ID does not exist" Jul 09 15:32:20.696312 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696306 2566 scope.go:117] "RemoveContainer" containerID="1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652" Jul 09 15:32:20.696808 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696267 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="kube-rbac-proxy-web" Jul 09 15:32:20.696808 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696357 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="prom-label-proxy" Jul 09 15:32:20.696808 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696367 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="31399442-55b8-44be-b04d-f3473019560d" containerName="alertmanager" Jul 09 15:32:20.696808 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:20.696512 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652\": container with ID starting with 1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652 not found: ID does not exist" containerID="1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652" Jul 09 15:32:20.696808 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696532 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652"} err="failed to get container status \"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652\": rpc error: code = NotFound desc = could not find container \"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652\": container with ID starting with 1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652 not found: ID does not exist" Jul 09 15:32:20.696808 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696547 2566 scope.go:117] "RemoveContainer" containerID="ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f" Jul 09 15:32:20.696808 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:20.696789 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f\": container with ID starting with ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f not found: ID does not exist" containerID="ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f" Jul 09 15:32:20.697051 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696828 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f"} err="failed to get container status \"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f\": rpc error: code = NotFound desc = could not find container \"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f\": container with ID starting with ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f not found: ID does not exist" Jul 09 15:32:20.697051 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.696893 2566 scope.go:117] "RemoveContainer" containerID="7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803" Jul 09 15:32:20.697138 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:20.697116 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803\": container with ID starting with 7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803 not found: ID does not exist" containerID="7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803" Jul 09 15:32:20.697173 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.697155 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803"} err="failed to get container status \"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803\": rpc error: code = NotFound desc = could not find container \"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803\": container with ID starting with 7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803 not found: ID does not exist" Jul 09 15:32:20.697208 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.697173 2566 scope.go:117] "RemoveContainer" containerID="58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9" Jul 09 15:32:20.697399 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:20.697373 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9\": container with ID starting with 58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9 not found: ID does not exist" containerID="58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9" Jul 09 15:32:20.697464 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.697408 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9"} err="failed to get container status \"58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9\": rpc error: code = NotFound desc = could not find container \"58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9\": container with ID starting with 58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9 not found: ID does not exist" Jul 09 15:32:20.697464 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.697430 2566 scope.go:117] "RemoveContainer" containerID="d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365" Jul 09 15:32:20.697632 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.697616 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365"} err="failed to get container status \"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365\": rpc error: code = NotFound desc = could not find container \"d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365\": container with ID starting with d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365 not found: ID does not exist" Jul 09 15:32:20.697693 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.697634 2566 scope.go:117] "RemoveContainer" containerID="25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6" Jul 09 15:32:20.697852 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.697833 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6"} err="failed to get container status \"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6\": rpc error: code = NotFound desc = could not find container \"25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6\": container with ID starting with 25c153638ba475256577127a4bb2965a502e6f0de35b00e11faf80886cd16cb6 not found: ID does not exist" Jul 09 15:32:20.697923 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.697853 2566 scope.go:117] "RemoveContainer" containerID="60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d" Jul 09 15:32:20.698046 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698028 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d"} err="failed to get container status \"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d\": rpc error: code = NotFound desc = could not find container \"60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d\": container with ID starting with 60d8169305613558934d038c884909f5219c6004119c7f61602d6fae15ab502d not found: ID does not exist" Jul 09 15:32:20.698091 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698047 2566 scope.go:117] "RemoveContainer" containerID="1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652" Jul 09 15:32:20.698270 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698253 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652"} err="failed to get container status \"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652\": rpc error: code = NotFound desc = could not find container \"1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652\": container with ID starting with 1a4cb76d0b2953cd8d793437ec5519c553afa499f88a5f67187ee037df6a5652 not found: ID does not exist" Jul 09 15:32:20.698335 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698271 2566 scope.go:117] "RemoveContainer" containerID="ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f" Jul 09 15:32:20.698472 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698456 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f"} err="failed to get container status \"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f\": rpc error: code = NotFound desc = could not find container \"ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f\": container with ID starting with ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f not found: ID does not exist" Jul 09 15:32:20.698530 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698472 2566 scope.go:117] "RemoveContainer" containerID="7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803" Jul 09 15:32:20.698669 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698655 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803"} err="failed to get container status \"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803\": rpc error: code = NotFound desc = could not find container \"7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803\": container with ID starting with 7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803 not found: ID does not exist" Jul 09 15:32:20.698754 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698669 2566 scope.go:117] "RemoveContainer" containerID="58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9" Jul 09 15:32:20.698872 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.698858 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9"} err="failed to get container status \"58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9\": rpc error: code = NotFound desc = could not find container \"58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9\": container with ID starting with 58df03c01e679ede9bce3f890ab8395c960bae4c6119f26fbf42723c5b5c53f9 not found: ID does not exist" Jul 09 15:32:20.700291 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.700276 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.703093 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703072 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 15:32:20.703211 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703096 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 15:32:20.703211 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703071 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 15:32:20.703211 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703097 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 15:32:20.703211 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703157 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 15:32:20.703503 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703481 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 15:32:20.703603 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703532 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 15:32:20.703603 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703572 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-dlbfr\"" Jul 09 15:32:20.703746 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.703690 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 15:32:20.708345 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.708328 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 15:32:20.715757 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.715737 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:20.830291 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830186 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830291 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830249 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830291 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830268 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830291 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830288 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830311 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28hz6\" (UniqueName: \"kubernetes.io/projected/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-kube-api-access-28hz6\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830421 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-config-out\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830476 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830508 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830577 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830890 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-web-config\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.830890 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.830665 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931135 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931097 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-config-out\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931135 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931143 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931363 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931161 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931363 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931179 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931363 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931207 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931363 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931363 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931262 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-web-config\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931363 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931363 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931681 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931371 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931681 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931395 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931681 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931428 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931681 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931460 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28hz6\" (UniqueName: \"kubernetes.io/projected/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-kube-api-access-28hz6\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.931681 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.931636 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.932228 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.932076 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.932228 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.932188 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.934464 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.934334 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-config-out\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.934593 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.934508 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-web-config\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.934593 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.934543 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.934811 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.934784 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.934984 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.934963 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.935049 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.935023 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.935096 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.935080 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.935310 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.935259 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.936584 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.936567 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:20.939908 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:20.939885 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28hz6\" (UniqueName: \"kubernetes.io/projected/84c26455-fb6f-4e08-95c9-f51f06ae9e3a-kube-api-access-28hz6\") pod \"alertmanager-main-0\" (UID: \"84c26455-fb6f-4e08-95c9-f51f06ae9e3a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:21.010154 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:21.010111 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:21.154380 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:21.154347 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:21.157337 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:32:21.157309 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84c26455_fb6f_4e08_95c9_f51f06ae9e3a.slice/crio-9703abee9383623f0bdee336c06e4c8f67b3465b54d797b6a536865c1bd85824 WatchSource:0}: Error finding container 9703abee9383623f0bdee336c06e4c8f67b3465b54d797b6a536865c1bd85824: Status 404 returned error can't find the container with id 9703abee9383623f0bdee336c06e4c8f67b3465b54d797b6a536865c1bd85824 Jul 09 15:32:21.264127 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:21.264099 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31399442-55b8-44be-b04d-f3473019560d" path="/var/lib/kubelet/pods/31399442-55b8-44be-b04d-f3473019560d/volumes" Jul 09 15:32:21.646123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:21.646084 2566 generic.go:356] "Generic (PLEG): container finished" podID="84c26455-fb6f-4e08-95c9-f51f06ae9e3a" containerID="81b75fac15db07cab084448dc920a47f52ad7b347bd074c0f84335932889f9e3" exitCode=0 Jul 09 15:32:21.646467 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:21.646154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"84c26455-fb6f-4e08-95c9-f51f06ae9e3a","Type":"ContainerDied","Data":"81b75fac15db07cab084448dc920a47f52ad7b347bd074c0f84335932889f9e3"} Jul 09 15:32:21.646467 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:21.646206 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"84c26455-fb6f-4e08-95c9-f51f06ae9e3a","Type":"ContainerStarted","Data":"9703abee9383623f0bdee336c06e4c8f67b3465b54d797b6a536865c1bd85824"} Jul 09 15:32:21.912611 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:21.912569 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:32:22.653577 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:22.653542 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"84c26455-fb6f-4e08-95c9-f51f06ae9e3a","Type":"ContainerStarted","Data":"7fc6e6dd30874bd1f1b1d597db8931dcacf7d136f9004b27193da229473638e9"} Jul 09 15:32:22.653966 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:22.653608 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"84c26455-fb6f-4e08-95c9-f51f06ae9e3a","Type":"ContainerStarted","Data":"549e9f11772051af2c01ea879f43f860c4f93f43b11ed56ff1ccc9870b64f91f"} Jul 09 15:32:22.653966 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:22.653637 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"84c26455-fb6f-4e08-95c9-f51f06ae9e3a","Type":"ContainerStarted","Data":"947e78cadc4984d5450748031437879685542b9427428479e1531ad07e03c9ca"} Jul 09 15:32:22.653966 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:22.653661 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"84c26455-fb6f-4e08-95c9-f51f06ae9e3a","Type":"ContainerStarted","Data":"100b59d1696a98c3bd8b7573d3321aab33e72f6efe81e2f106d8c267625ede61"} Jul 09 15:32:22.653966 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:22.653685 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"84c26455-fb6f-4e08-95c9-f51f06ae9e3a","Type":"ContainerStarted","Data":"e030c2afe2ae34e0f0896813d71856d899aecc3a186955d0f6ffb4c01256a533"} Jul 09 15:32:22.653966 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:22.653731 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"84c26455-fb6f-4e08-95c9-f51f06ae9e3a","Type":"ContainerStarted","Data":"a761b6266783b04f81cfdead493cf99c33411d29bf7a5ff93e7c296be4c7481a"} Jul 09 15:32:22.681299 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:22.681250 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6638367020000002 podStartE2EDuration="2.681233152s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.39645ms" isStatefulPod=false podCreationTimestamp="2026-07-09 15:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:22.680429328 +0000 UTC m=+363.959805935" watchObservedRunningTime="2026-07-09 15:32:22.681233152 +0000 UTC m=+363.960609800" Jul 09 15:32:26.766243 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:26.766206 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:26.842085 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:26.842049 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:27.684951 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:27.684922 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:27.685134 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:27.684980 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:27.689811 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:27.689782 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:28.687817 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:28.687780 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:32:28.736026 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:28.735985 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b84cbc54-gt95s"] Jul 09 15:32:28.830674 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:28.830629 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:28.934454 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:28.934424 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:29.287684 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:29.287643 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:29.389125 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:29.389096 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:32:30.006411 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:30.006367 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:32:36.932389 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:36.932347 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:32:40.013776 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:40.013731 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:32:50.053009 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:50.052969 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:32:51.896497 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:51.896442 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:32:53.763478 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:53.763430 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57b84cbc54-gt95s" podUID="43e51913-a19a-46d9-8a80-dff5073ab122" containerName="console" containerID="cri-o://f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef" gracePeriod=15 Jul 09 15:32:54.017202 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.017149 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:32:54.097624 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.097592 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-oauth-config\") pod \"43e51913-a19a-46d9-8a80-dff5073ab122\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " Jul 09 15:32:54.097819 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.097637 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-service-ca\") pod \"43e51913-a19a-46d9-8a80-dff5073ab122\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " Jul 09 15:32:54.097819 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.097688 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-trusted-ca-bundle\") pod \"43e51913-a19a-46d9-8a80-dff5073ab122\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " Jul 09 15:32:54.097819 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.097703 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-console-config\") pod \"43e51913-a19a-46d9-8a80-dff5073ab122\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " Jul 09 15:32:54.097819 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.097764 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-serving-cert\") pod \"43e51913-a19a-46d9-8a80-dff5073ab122\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " Jul 09 15:32:54.097819 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.097815 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w77zq\" (UniqueName: \"kubernetes.io/projected/43e51913-a19a-46d9-8a80-dff5073ab122-kube-api-access-w77zq\") pod \"43e51913-a19a-46d9-8a80-dff5073ab122\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " Jul 09 15:32:54.098134 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.097847 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-oauth-serving-cert\") pod \"43e51913-a19a-46d9-8a80-dff5073ab122\" (UID: \"43e51913-a19a-46d9-8a80-dff5073ab122\") " Jul 09 15:32:54.098189 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.098130 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-service-ca" (OuterVolumeSpecName: "service-ca") pod "43e51913-a19a-46d9-8a80-dff5073ab122" (UID: "43e51913-a19a-46d9-8a80-dff5073ab122"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:54.098289 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.098263 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-console-config" (OuterVolumeSpecName: "console-config") pod "43e51913-a19a-46d9-8a80-dff5073ab122" (UID: "43e51913-a19a-46d9-8a80-dff5073ab122"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:54.098431 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.098408 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "43e51913-a19a-46d9-8a80-dff5073ab122" (UID: "43e51913-a19a-46d9-8a80-dff5073ab122"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:54.098567 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.098540 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43e51913-a19a-46d9-8a80-dff5073ab122" (UID: "43e51913-a19a-46d9-8a80-dff5073ab122"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:54.099971 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.099948 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43e51913-a19a-46d9-8a80-dff5073ab122" (UID: "43e51913-a19a-46d9-8a80-dff5073ab122"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:54.100116 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.100090 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43e51913-a19a-46d9-8a80-dff5073ab122-kube-api-access-w77zq" (OuterVolumeSpecName: "kube-api-access-w77zq") pod "43e51913-a19a-46d9-8a80-dff5073ab122" (UID: "43e51913-a19a-46d9-8a80-dff5073ab122"). InnerVolumeSpecName "kube-api-access-w77zq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:32:54.100178 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.100117 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43e51913-a19a-46d9-8a80-dff5073ab122" (UID: "43e51913-a19a-46d9-8a80-dff5073ab122"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:54.199375 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.199342 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:54.199375 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.199369 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w77zq\" (UniqueName: \"kubernetes.io/projected/43e51913-a19a-46d9-8a80-dff5073ab122-kube-api-access-w77zq\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:54.199375 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.199379 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-oauth-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:54.199586 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.199388 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43e51913-a19a-46d9-8a80-dff5073ab122-console-oauth-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:54.199586 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.199398 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:54.199586 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.199408 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:54.199586 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.199416 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43e51913-a19a-46d9-8a80-dff5073ab122-console-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:32:54.788665 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.788629 2566 generic.go:356] "Generic (PLEG): container finished" podID="43e51913-a19a-46d9-8a80-dff5073ab122" containerID="f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef" exitCode=0 Jul 09 15:32:54.789094 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.788674 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57b84cbc54-gt95s" Jul 09 15:32:54.789094 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.788697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b84cbc54-gt95s" event={"ID":"43e51913-a19a-46d9-8a80-dff5073ab122","Type":"ContainerDied","Data":"f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef"} Jul 09 15:32:54.789094 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.788757 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57b84cbc54-gt95s" event={"ID":"43e51913-a19a-46d9-8a80-dff5073ab122","Type":"ContainerDied","Data":"120cd9aa2f1a5aaf7562bcdd15c65cd1fceaa0f698d7af00b3a73a7d9a3712dd"} Jul 09 15:32:54.789094 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.788776 2566 scope.go:117] "RemoveContainer" containerID="f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef" Jul 09 15:32:54.797537 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.797521 2566 scope.go:117] "RemoveContainer" containerID="f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef" Jul 09 15:32:54.797846 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:54.797829 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef\": container with ID starting with f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef not found: ID does not exist" containerID="f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef" Jul 09 15:32:54.797902 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.797855 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef"} err="failed to get container status \"f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef\": rpc error: code = NotFound desc = could not find container \"f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef\": container with ID starting with f5d03eab9017cff08601c4787156068919d6ec9395d95611a1154f20168b18ef not found: ID does not exist" Jul 09 15:32:54.810154 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.810134 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57b84cbc54-gt95s"] Jul 09 15:32:54.816263 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:54.816241 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57b84cbc54-gt95s"] Jul 09 15:32:55.263491 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:32:55.263461 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43e51913-a19a-46d9-8a80-dff5073ab122" path="/var/lib/kubelet/pods/43e51913-a19a-46d9-8a80-dff5073ab122/volumes" Jul 09 15:32:55.332812 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:55.332699 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:32:55.332812 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:32:55.332795 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:33:00.060751 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:33:00.060688 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:33:06.945433 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:33:06.945390 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:33:09.897175 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:33:09.897132 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:09.972058 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:33:09.972028 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:33:10.068877 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:33:10.068833 2566 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-7dd9fb259f97fe5244418e440d02ce2581c975dd15b44fd72bfde69605227803.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-d2b0789817a9656020bb919422233eff596a375d31a23f38ce2a9906fe4b7365.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31399442_55b8_44be_b04d_f3473019560d.slice/crio-conmon-ec2bea64f515c0dbb371df84612b4b73644e5828a4ce75a5ebb5a1ded0c03b3f.scope\": RecentStats: unable to find data in memory cache]" Jul 09 15:33:19.893192 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:33:19.893156 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:53.109262 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:34:53.109224 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:34:53.166994 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:34:53.166962 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:35:21.394831 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:35:21.394796 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:35:45.240950 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:35:45.240904 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:35:55.976046 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:35:55.976011 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:04.846774 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:04.846745 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:12.575877 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:12.575842 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:14.899720 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:14.899663 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:16.460391 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:16.460353 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:19.226487 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:19.226459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:36:19.230537 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:19.230518 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:36:19.234017 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:19.233996 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:36:19.237568 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:19.237551 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:36:48.853260 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:48.853228 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:48.907487 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:48.907461 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.184621 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:49.184542 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.297255 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:49.297218 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:49.386188 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:49.386160 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:56.576194 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.576166 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-747f765995-vrslt"] Jul 09 15:36:56.576563 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.576499 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43e51913-a19a-46d9-8a80-dff5073ab122" containerName="console" Jul 09 15:36:56.576563 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.576510 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="43e51913-a19a-46d9-8a80-dff5073ab122" containerName="console" Jul 09 15:36:56.576686 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.576576 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="43e51913-a19a-46d9-8a80-dff5073ab122" containerName="console" Jul 09 15:36:56.578745 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.578696 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.662757 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.662729 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747f765995-vrslt"] Jul 09 15:36:56.682187 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.682163 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:56.691390 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.691367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cab915b-b8e4-4c14-a830-820d66907eec-console-oauth-config\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.691449 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.691395 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-trusted-ca-bundle\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.691449 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.691415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-console-config\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.691529 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.691517 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cab915b-b8e4-4c14-a830-820d66907eec-console-serving-cert\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.691566 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.691540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-oauth-serving-cert\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.691566 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.691561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-service-ca\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.691632 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.691602 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dspf\" (UniqueName: \"kubernetes.io/projected/9cab915b-b8e4-4c14-a830-820d66907eec-kube-api-access-2dspf\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.779677 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.779646 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:36:56.792962 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.792941 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cab915b-b8e4-4c14-a830-820d66907eec-console-oauth-config\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.793041 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.792968 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-trusted-ca-bundle\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.793041 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.792989 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-console-config\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.793113 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.793044 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cab915b-b8e4-4c14-a830-820d66907eec-console-serving-cert\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.793113 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.793074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-oauth-serving-cert\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.793113 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.793102 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-service-ca\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.793283 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.793250 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dspf\" (UniqueName: \"kubernetes.io/projected/9cab915b-b8e4-4c14-a830-820d66907eec-kube-api-access-2dspf\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.793926 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.793888 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-console-config\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.794042 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.793894 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-trusted-ca-bundle\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.794042 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.794000 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-service-ca\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.794115 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.794052 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9cab915b-b8e4-4c14-a830-820d66907eec-oauth-serving-cert\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.795556 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.795539 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9cab915b-b8e4-4c14-a830-820d66907eec-console-oauth-config\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.795691 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.795675 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9cab915b-b8e4-4c14-a830-820d66907eec-console-serving-cert\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.805221 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.805194 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dspf\" (UniqueName: \"kubernetes.io/projected/9cab915b-b8e4-4c14-a830-820d66907eec-kube-api-access-2dspf\") pod \"console-747f765995-vrslt\" (UID: \"9cab915b-b8e4-4c14-a830-820d66907eec\") " pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:56.887346 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:56.887275 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-747f765995-vrslt" Jul 09 15:36:57.023847 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:57.023823 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-747f765995-vrslt"] Jul 09 15:36:57.026364 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:36:57.026339 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cab915b_b8e4_4c14_a830_820d66907eec.slice/crio-518d25a66a80db36ed78718c85f4c3b64a028dffea32c48546393b585a7c13fa WatchSource:0}: Error finding container 518d25a66a80db36ed78718c85f4c3b64a028dffea32c48546393b585a7c13fa: Status 404 returned error can't find the container with id 518d25a66a80db36ed78718c85f4c3b64a028dffea32c48546393b585a7c13fa Jul 09 15:36:57.770472 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:57.770438 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747f765995-vrslt" event={"ID":"9cab915b-b8e4-4c14-a830-820d66907eec","Type":"ContainerStarted","Data":"0c2bb13de3c985726fbb45889cb06ee9a3ae205faa06dc38fd446b1a1d3cdfcb"} Jul 09 15:36:57.770912 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:57.770485 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-747f765995-vrslt" event={"ID":"9cab915b-b8e4-4c14-a830-820d66907eec","Type":"ContainerStarted","Data":"518d25a66a80db36ed78718c85f4c3b64a028dffea32c48546393b585a7c13fa"} Jul 09 15:36:57.789428 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:36:57.789379 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-747f765995-vrslt" podStartSLOduration=1.789363182 podStartE2EDuration="1.789363182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:36:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:36:57.788072487 +0000 UTC m=+639.067449048" watchObservedRunningTime="2026-07-09 15:36:57.789363182 +0000 UTC m=+639.068739790" Jul 09 15:37:06.887917 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:06.887879 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-747f765995-vrslt" Jul 09 15:37:06.888303 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:06.887933 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-747f765995-vrslt" Jul 09 15:37:06.892630 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:06.892610 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-747f765995-vrslt" Jul 09 15:37:07.814362 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:07.814331 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-747f765995-vrslt" Jul 09 15:37:07.861770 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:07.861735 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559d5d7458-6t48n"] Jul 09 15:37:07.966025 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:07.965980 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:37:32.890922 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:32.890855 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-559d5d7458-6t48n" podUID="f7487d7a-f5df-437c-980a-1edbcd0d0f15" containerName="console" containerID="cri-o://1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061" gracePeriod=15 Jul 09 15:37:33.139074 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.139049 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:37:33.207896 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.207810 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-serving-cert\") pod \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " Jul 09 15:37:33.208047 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.207907 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-trusted-ca-bundle\") pod \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " Jul 09 15:37:33.208103 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208078 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-service-ca\") pod \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " Jul 09 15:37:33.208154 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208129 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-oauth-config\") pod \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " Jul 09 15:37:33.208213 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208202 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-oauth-serving-cert\") pod \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " Jul 09 15:37:33.208271 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208234 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2nlf\" (UniqueName: \"kubernetes.io/projected/f7487d7a-f5df-437c-980a-1edbcd0d0f15-kube-api-access-c2nlf\") pod \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " Jul 09 15:37:33.208271 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208263 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-config\") pod \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\" (UID: \"f7487d7a-f5df-437c-980a-1edbcd0d0f15\") " Jul 09 15:37:33.208415 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208288 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f7487d7a-f5df-437c-980a-1edbcd0d0f15" (UID: "f7487d7a-f5df-437c-980a-1edbcd0d0f15"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:37:33.208527 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208505 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-service-ca" (OuterVolumeSpecName: "service-ca") pod "f7487d7a-f5df-437c-980a-1edbcd0d0f15" (UID: "f7487d7a-f5df-437c-980a-1edbcd0d0f15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:37:33.208595 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208582 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f7487d7a-f5df-437c-980a-1edbcd0d0f15" (UID: "f7487d7a-f5df-437c-980a-1edbcd0d0f15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:37:33.208687 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208670 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-oauth-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:37:33.208769 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208694 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-trusted-ca-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:37:33.208769 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208741 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-service-ca\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:37:33.208935 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.208913 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-config" (OuterVolumeSpecName: "console-config") pod "f7487d7a-f5df-437c-980a-1edbcd0d0f15" (UID: "f7487d7a-f5df-437c-980a-1edbcd0d0f15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:37:33.210271 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.210247 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f7487d7a-f5df-437c-980a-1edbcd0d0f15" (UID: "f7487d7a-f5df-437c-980a-1edbcd0d0f15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:37:33.210923 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.210897 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7487d7a-f5df-437c-980a-1edbcd0d0f15-kube-api-access-c2nlf" (OuterVolumeSpecName: "kube-api-access-c2nlf") pod "f7487d7a-f5df-437c-980a-1edbcd0d0f15" (UID: "f7487d7a-f5df-437c-980a-1edbcd0d0f15"). InnerVolumeSpecName "kube-api-access-c2nlf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:37:33.210923 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.210914 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f7487d7a-f5df-437c-980a-1edbcd0d0f15" (UID: "f7487d7a-f5df-437c-980a-1edbcd0d0f15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:37:33.310053 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.310024 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2nlf\" (UniqueName: \"kubernetes.io/projected/f7487d7a-f5df-437c-980a-1edbcd0d0f15-kube-api-access-c2nlf\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:37:33.310053 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.310051 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:37:33.310053 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.310061 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-serving-cert\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:37:33.310288 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.310070 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f7487d7a-f5df-437c-980a-1edbcd0d0f15-console-oauth-config\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:37:33.922572 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.922537 2566 generic.go:356] "Generic (PLEG): container finished" podID="f7487d7a-f5df-437c-980a-1edbcd0d0f15" containerID="1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061" exitCode=0 Jul 09 15:37:33.923078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.922591 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-559d5d7458-6t48n" Jul 09 15:37:33.923078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.922622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559d5d7458-6t48n" event={"ID":"f7487d7a-f5df-437c-980a-1edbcd0d0f15","Type":"ContainerDied","Data":"1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061"} Jul 09 15:37:33.923078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.922672 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-559d5d7458-6t48n" event={"ID":"f7487d7a-f5df-437c-980a-1edbcd0d0f15","Type":"ContainerDied","Data":"b81dec7d8edcc28ce0aa218d61bcc47782b3adcb71846b5e15b75feebe9eb724"} Jul 09 15:37:33.923078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.922694 2566 scope.go:117] "RemoveContainer" containerID="1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061" Jul 09 15:37:33.931178 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.931161 2566 scope.go:117] "RemoveContainer" containerID="1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061" Jul 09 15:37:33.931448 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:37:33.931429 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061\": container with ID starting with 1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061 not found: ID does not exist" containerID="1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061" Jul 09 15:37:33.931525 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.931461 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061"} err="failed to get container status \"1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061\": rpc error: code = NotFound desc = could not find container \"1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061\": container with ID starting with 1ad5a35f4e50b36161a278907706a69f6822934cd5bc1d0c435e6b8ec6627061 not found: ID does not exist" Jul 09 15:37:33.938476 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.938448 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-559d5d7458-6t48n"] Jul 09 15:37:33.942528 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:33.942502 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-559d5d7458-6t48n"] Jul 09 15:37:35.263478 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:37:35.263444 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7487d7a-f5df-437c-980a-1edbcd0d0f15" path="/var/lib/kubelet/pods/f7487d7a-f5df-437c-980a-1edbcd0d0f15/volumes" Jul 09 15:38:01.385068 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:01.385038 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:12.407111 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.407035 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph"] Jul 09 15:38:12.407492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.407383 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7487d7a-f5df-437c-980a-1edbcd0d0f15" containerName="console" Jul 09 15:38:12.407492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.407394 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7487d7a-f5df-437c-980a-1edbcd0d0f15" containerName="console" Jul 09 15:38:12.407492 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.407464 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7487d7a-f5df-437c-980a-1edbcd0d0f15" containerName="console" Jul 09 15:38:12.410782 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.410763 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.413347 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.413320 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 15:38:12.413479 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.413346 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 15:38:12.414387 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.414370 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xmkr7\"" Jul 09 15:38:12.421011 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.420989 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph"] Jul 09 15:38:12.439379 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.439344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.439502 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.439391 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.439502 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.439461 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rvc9\" (UniqueName: \"kubernetes.io/projected/f8435be6-efab-4145-9ed2-0ca7feee734c-kube-api-access-6rvc9\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.540779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.540734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.540779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.540784 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.540977 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.540829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rvc9\" (UniqueName: \"kubernetes.io/projected/f8435be6-efab-4145-9ed2-0ca7feee734c-kube-api-access-6rvc9\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.541122 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.541104 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.541197 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.541173 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.550476 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.550442 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rvc9\" (UniqueName: \"kubernetes.io/projected/f8435be6-efab-4145-9ed2-0ca7feee734c-kube-api-access-6rvc9\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.719696 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.719618 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:12.851613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.851484 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph"] Jul 09 15:38:12.854269 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:38:12.854235 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8435be6_efab_4145_9ed2_0ca7feee734c.slice/crio-c7cfe1faa5ea727b614ae32c18e29517c5073b6a51a69ff7ae27bd46d08738ea WatchSource:0}: Error finding container c7cfe1faa5ea727b614ae32c18e29517c5073b6a51a69ff7ae27bd46d08738ea: Status 404 returned error can't find the container with id c7cfe1faa5ea727b614ae32c18e29517c5073b6a51a69ff7ae27bd46d08738ea Jul 09 15:38:12.856343 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:12.856326 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:38:13.075564 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:13.075530 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" event={"ID":"f8435be6-efab-4145-9ed2-0ca7feee734c","Type":"ContainerStarted","Data":"c7cfe1faa5ea727b614ae32c18e29517c5073b6a51a69ff7ae27bd46d08738ea"} Jul 09 15:38:20.109881 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:20.109845 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" event={"ID":"f8435be6-efab-4145-9ed2-0ca7feee734c","Type":"ContainerStarted","Data":"b81e585ac8ba77669f5f64ba95e3b51f92933b0be5c9303cc259db0ad6172165"} Jul 09 15:38:21.115224 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:21.115187 2566 generic.go:356] "Generic (PLEG): container finished" podID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerID="b81e585ac8ba77669f5f64ba95e3b51f92933b0be5c9303cc259db0ad6172165" exitCode=0 Jul 09 15:38:21.115596 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:21.115257 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" event={"ID":"f8435be6-efab-4145-9ed2-0ca7feee734c","Type":"ContainerDied","Data":"b81e585ac8ba77669f5f64ba95e3b51f92933b0be5c9303cc259db0ad6172165"} Jul 09 15:38:24.128770 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:24.128734 2566 generic.go:356] "Generic (PLEG): container finished" podID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerID="ab8c8f6f02b543908873a811808cc22f87222bfee355d536a80efe2172a312e7" exitCode=0 Jul 09 15:38:24.129146 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:24.128799 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" event={"ID":"f8435be6-efab-4145-9ed2-0ca7feee734c","Type":"ContainerDied","Data":"ab8c8f6f02b543908873a811808cc22f87222bfee355d536a80efe2172a312e7"} Jul 09 15:38:32.166511 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:32.166473 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" event={"ID":"f8435be6-efab-4145-9ed2-0ca7feee734c","Type":"ContainerStarted","Data":"356cf718397f0a51830fd76b52a19626b9b7e70a2e69a9f2cf666bfad564e048"} Jul 09 15:38:32.187889 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:32.187823 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" podStartSLOduration=3.084538579 podStartE2EDuration="20.187801148s" totalImagesPullingTime="17.103262569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:38:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:38:32.186051173 +0000 UTC m=+733.465427736" watchObservedRunningTime="2026-07-09 15:38:32.187801148 +0000 UTC m=+733.467177712" Jul 09 15:38:33.172638 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:33.172602 2566 generic.go:356] "Generic (PLEG): container finished" podID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerID="356cf718397f0a51830fd76b52a19626b9b7e70a2e69a9f2cf666bfad564e048" exitCode=0 Jul 09 15:38:33.173042 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:33.172684 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" event={"ID":"f8435be6-efab-4145-9ed2-0ca7feee734c","Type":"ContainerDied","Data":"356cf718397f0a51830fd76b52a19626b9b7e70a2e69a9f2cf666bfad564e048"} Jul 09 15:38:34.353591 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.353564 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:34.436880 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.436796 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rvc9\" (UniqueName: \"kubernetes.io/projected/f8435be6-efab-4145-9ed2-0ca7feee734c-kube-api-access-6rvc9\") pod \"f8435be6-efab-4145-9ed2-0ca7feee734c\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " Jul 09 15:38:34.436880 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.436843 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-util\") pod \"f8435be6-efab-4145-9ed2-0ca7feee734c\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " Jul 09 15:38:34.436880 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.436880 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-bundle\") pod \"f8435be6-efab-4145-9ed2-0ca7feee734c\" (UID: \"f8435be6-efab-4145-9ed2-0ca7feee734c\") " Jul 09 15:38:34.437589 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.437517 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-bundle" (OuterVolumeSpecName: "bundle") pod "f8435be6-efab-4145-9ed2-0ca7feee734c" (UID: "f8435be6-efab-4145-9ed2-0ca7feee734c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:38:34.439209 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.439186 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8435be6-efab-4145-9ed2-0ca7feee734c-kube-api-access-6rvc9" (OuterVolumeSpecName: "kube-api-access-6rvc9") pod "f8435be6-efab-4145-9ed2-0ca7feee734c" (UID: "f8435be6-efab-4145-9ed2-0ca7feee734c"). InnerVolumeSpecName "kube-api-access-6rvc9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:38:34.441108 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.441087 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-util" (OuterVolumeSpecName: "util") pod "f8435be6-efab-4145-9ed2-0ca7feee734c" (UID: "f8435be6-efab-4145-9ed2-0ca7feee734c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:38:34.538250 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.538221 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rvc9\" (UniqueName: \"kubernetes.io/projected/f8435be6-efab-4145-9ed2-0ca7feee734c-kube-api-access-6rvc9\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:38:34.538250 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.538243 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-util\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:38:34.538250 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:34.538253 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8435be6-efab-4145-9ed2-0ca7feee734c-bundle\") on node \"ip-10-0-138-133.ec2.internal\" DevicePath \"\"" Jul 09 15:38:35.182263 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:35.182237 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" Jul 09 15:38:35.182263 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:35.182258 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589f47ph" event={"ID":"f8435be6-efab-4145-9ed2-0ca7feee734c","Type":"ContainerDied","Data":"c7cfe1faa5ea727b614ae32c18e29517c5073b6a51a69ff7ae27bd46d08738ea"} Jul 09 15:38:35.182474 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:35.182306 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7cfe1faa5ea727b614ae32c18e29517c5073b6a51a69ff7ae27bd46d08738ea" Jul 09 15:38:38.601455 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:38.601417 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:38.714505 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:38.714467 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:40.192725 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.192670 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85"] Jul 09 15:38:40.193101 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.193048 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerName="extract" Jul 09 15:38:40.193101 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.193061 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerName="extract" Jul 09 15:38:40.193101 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.193074 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerName="util" Jul 09 15:38:40.193101 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.193080 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerName="util" Jul 09 15:38:40.193101 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.193100 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerName="pull" Jul 09 15:38:40.193101 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.193105 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerName="pull" Jul 09 15:38:40.193302 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.193161 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8435be6-efab-4145-9ed2-0ca7feee734c" containerName="extract" Jul 09 15:38:40.196450 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.196432 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:40.199132 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.199109 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 09 15:38:40.199256 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.199166 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 09 15:38:40.199256 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.199201 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 09 15:38:40.199256 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.199229 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-4vxzq\"" Jul 09 15:38:40.207980 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.207957 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85"] Jul 09 15:38:40.287065 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.287024 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5nzw8\" (UniqueName: \"kubernetes.io/projected/8956c986-914e-4d91-ba09-dcb858613d1f-kube-api-access-5nzw8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-hhf85\" (UID: \"8956c986-914e-4d91-ba09-dcb858613d1f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:40.287240 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.287081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8956c986-914e-4d91-ba09-dcb858613d1f-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-hhf85\" (UID: \"8956c986-914e-4d91-ba09-dcb858613d1f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:40.387812 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.387769 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5nzw8\" (UniqueName: \"kubernetes.io/projected/8956c986-914e-4d91-ba09-dcb858613d1f-kube-api-access-5nzw8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-hhf85\" (UID: \"8956c986-914e-4d91-ba09-dcb858613d1f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:40.387999 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.387877 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8956c986-914e-4d91-ba09-dcb858613d1f-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-hhf85\" (UID: \"8956c986-914e-4d91-ba09-dcb858613d1f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:40.391000 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.390944 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/8956c986-914e-4d91-ba09-dcb858613d1f-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-hhf85\" (UID: \"8956c986-914e-4d91-ba09-dcb858613d1f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:40.399857 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.399825 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5nzw8\" (UniqueName: \"kubernetes.io/projected/8956c986-914e-4d91-ba09-dcb858613d1f-kube-api-access-5nzw8\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-hhf85\" (UID: \"8956c986-914e-4d91-ba09-dcb858613d1f\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:40.507869 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.507835 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:40.667900 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:40.667869 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85"] Jul 09 15:38:40.671375 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:38:40.671342 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8956c986_914e_4d91_ba09_dcb858613d1f.slice/crio-3df6d7538406353bf2b769a75db1c47163814af50af0adbf2f13eb9f2fb481d4 WatchSource:0}: Error finding container 3df6d7538406353bf2b769a75db1c47163814af50af0adbf2f13eb9f2fb481d4: Status 404 returned error can't find the container with id 3df6d7538406353bf2b769a75db1c47163814af50af0adbf2f13eb9f2fb481d4 Jul 09 15:38:41.209305 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:41.209271 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" event={"ID":"8956c986-914e-4d91-ba09-dcb858613d1f","Type":"ContainerStarted","Data":"3df6d7538406353bf2b769a75db1c47163814af50af0adbf2f13eb9f2fb481d4"} Jul 09 15:38:46.113002 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.112963 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:46.233816 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.233777 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" event={"ID":"8956c986-914e-4d91-ba09-dcb858613d1f","Type":"ContainerStarted","Data":"e19a2684b57a7e8bfe4e5041a2668e0a8db04d0344f95550de3519c0c16aa54f"} Jul 09 15:38:46.234006 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.233979 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:38:46.255217 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.255162 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" podStartSLOduration=1.329689006 podStartE2EDuration="6.255145964s" totalImagesPullingTime="4.925456958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:38:46.253169172 +0000 UTC m=+747.532545733" watchObservedRunningTime="2026-07-09 15:38:46.255145964 +0000 UTC m=+747.534522522" Jul 09 15:38:46.395646 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.395555 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:46.401489 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.401457 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-z2cl7"] Jul 09 15:38:46.403995 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.403973 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.406231 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.406196 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 09 15:38:46.406337 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.406270 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 09 15:38:46.406929 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.406911 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-pb9jl\"" Jul 09 15:38:46.416231 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.416206 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-z2cl7"] Jul 09 15:38:46.518523 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.518479 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:46.545337 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.545310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-certificates\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.545503 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.545394 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/16f47fd5-dd5b-4387-a2de-c9a73999f693-cabundle0\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.545503 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.545413 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46glj\" (UniqueName: \"kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-kube-api-access-46glj\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.638622 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.638591 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:46.646020 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.645954 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/16f47fd5-dd5b-4387-a2de-c9a73999f693-cabundle0\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.646020 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.646004 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46glj\" (UniqueName: \"kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-kube-api-access-46glj\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.646200 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.646050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-certificates\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.646258 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:38:46.646218 2566 secret.go:281] references non-existent secret key: ca.crt Jul 09 15:38:46.646258 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:38:46.646235 2566 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 09 15:38:46.646258 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:38:46.646246 2566 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-z2cl7: references non-existent secret key: ca.crt Jul 09 15:38:46.646410 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:38:46.646309 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-certificates podName:16f47fd5-dd5b-4387-a2de-c9a73999f693 nodeName:}" failed. No retries permitted until 2026-07-09 15:38:47.146286011 +0000 UTC m=+748.425662553 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-certificates") pod "keda-operator-68bff59c-z2cl7" (UID: "16f47fd5-dd5b-4387-a2de-c9a73999f693") : references non-existent secret key: ca.crt Jul 09 15:38:46.646683 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.646658 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/16f47fd5-dd5b-4387-a2de-c9a73999f693-cabundle0\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.656837 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.656803 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46glj\" (UniqueName: \"kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-kube-api-access-46glj\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:46.746361 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.746328 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8"] Jul 09 15:38:46.748819 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.748795 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.751248 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.751227 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\"" Jul 09 15:38:46.759751 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.759697 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8"] Jul 09 15:38:46.847431 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.847393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.847431 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.847432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-certificates\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.847643 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.847543 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8b84\" (UniqueName: \"kubernetes.io/projected/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-kube-api-access-t8b84\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.948314 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.948239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8b84\" (UniqueName: \"kubernetes.io/projected/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-kube-api-access-t8b84\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.948314 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.948298 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.948314 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.948315 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-certificates\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.948760 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.948738 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-temp-vol\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.950993 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.950959 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-certificates\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:46.957109 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.957064 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:46.959824 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:46.959801 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8b84\" (UniqueName: \"kubernetes.io/projected/1dfb5c48-82ad-4ee7-867d-7a964e9ed039-kube-api-access-t8b84\") pod \"keda-metrics-apiserver-559f75f947-zq2c8\" (UID: \"1dfb5c48-82ad-4ee7-867d-7a964e9ed039\") " pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:47.060686 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.060645 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:47.066700 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.066665 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:47.150613 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.150398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-certificates\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:47.153790 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.153764 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/16f47fd5-dd5b-4387-a2de-c9a73999f693-certificates\") pod \"keda-operator-68bff59c-z2cl7\" (UID: \"16f47fd5-dd5b-4387-a2de-c9a73999f693\") " pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:47.205424 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.205343 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:47.211078 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.211059 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8"] Jul 09 15:38:47.213735 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:38:47.213685 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dfb5c48_82ad_4ee7_867d_7a964e9ed039.slice/crio-38d906cb6e11030954469c8bd585850d125ebf7f55bfdd904c8f96c1aad80e04 WatchSource:0}: Error finding container 38d906cb6e11030954469c8bd585850d125ebf7f55bfdd904c8f96c1aad80e04: Status 404 returned error can't find the container with id 38d906cb6e11030954469c8bd585850d125ebf7f55bfdd904c8f96c1aad80e04 Jul 09 15:38:47.238905 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.238877 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" event={"ID":"1dfb5c48-82ad-4ee7-867d-7a964e9ed039","Type":"ContainerStarted","Data":"38d906cb6e11030954469c8bd585850d125ebf7f55bfdd904c8f96c1aad80e04"} Jul 09 15:38:47.316917 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.316880 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:47.456245 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:47.456220 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-z2cl7"] Jul 09 15:38:47.458612 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:38:47.458559 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f47fd5_dd5b_4387_a2de_c9a73999f693.slice/crio-c9205319a6d397cf4ace3bff7137d9dcbd528d74b11c7faf341f46353bd242d6 WatchSource:0}: Error finding container c9205319a6d397cf4ace3bff7137d9dcbd528d74b11c7faf341f46353bd242d6: Status 404 returned error can't find the container with id c9205319a6d397cf4ace3bff7137d9dcbd528d74b11c7faf341f46353bd242d6 Jul 09 15:38:48.247256 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:48.247215 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-z2cl7" event={"ID":"16f47fd5-dd5b-4387-a2de-c9a73999f693","Type":"ContainerStarted","Data":"c9205319a6d397cf4ace3bff7137d9dcbd528d74b11c7faf341f46353bd242d6"} Jul 09 15:38:49.535179 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:49.535140 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:49.632605 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:49.632567 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:38:51.265656 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:51.265623 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-z2cl7" event={"ID":"16f47fd5-dd5b-4387-a2de-c9a73999f693","Type":"ContainerStarted","Data":"77e630ae70ea8f3291027c9f3ecabe1f09bc231814d482356f5007ee9f200c81"} Jul 09 15:38:51.266323 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:51.265673 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:38:51.266879 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:51.266859 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" event={"ID":"1dfb5c48-82ad-4ee7-867d-7a964e9ed039","Type":"ContainerStarted","Data":"3c945ed5fc426c4de72c31db2c0060f425a26a63d1426d6c524993e45210a8db"} Jul 09 15:38:51.266984 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:51.266917 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:38:51.286536 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:51.286490 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-z2cl7" podStartSLOduration=1.682882829 podStartE2EDuration="5.286475384s" totalImagesPullingTime="3.603592555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:38:51.284358424 +0000 UTC m=+752.563735009" watchObservedRunningTime="2026-07-09 15:38:51.286475384 +0000 UTC m=+752.565851997" Jul 09 15:38:51.304779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:38:51.304731 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" podStartSLOduration=1.463207372 podStartE2EDuration="5.304694841s" totalImagesPullingTime="3.841487469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:38:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:38:51.302747732 +0000 UTC m=+752.582124294" watchObservedRunningTime="2026-07-09 15:38:51.304694841 +0000 UTC m=+752.584071401" Jul 09 15:39:02.275917 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:02.275889 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-559f75f947-zq2c8" Jul 09 15:39:07.241451 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:07.241418 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-hhf85" Jul 09 15:39:12.273859 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:12.273828 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-z2cl7" Jul 09 15:39:50.640465 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.640432 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:50.700781 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.700748 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-b67j2"] Jul 09 15:39:50.703699 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.703681 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:50.707091 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.707066 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 09 15:39:50.707206 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.707121 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 09 15:39:50.707206 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.707142 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 09 15:39:50.707206 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.707190 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-cfpqv\"" Jul 09 15:39:50.714951 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.714896 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-b67j2"] Jul 09 15:39:50.726283 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.726162 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:50.749090 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.749054 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-pzh58"] Jul 09 15:39:50.751964 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.751943 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:50.754299 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.754281 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 09 15:39:50.754417 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.754397 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-tdrnk\"" Jul 09 15:39:50.763822 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.763802 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-pzh58"] Jul 09 15:39:50.799910 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.799879 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:50.813376 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.813352 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fbf058e3-2370-40a2-be98-e68dfe7cdd5a-data\") pod \"seaweedfs-64568bcd49-pzh58\" (UID: \"fbf058e3-2370-40a2-be98-e68dfe7cdd5a\") " pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:50.813480 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.813441 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb4a394-3150-49c9-92e0-cdd6c44a25dd-cert\") pod \"kserve-controller-manager-799c68cd74-b67j2\" (UID: \"0eb4a394-3150-49c9-92e0-cdd6c44a25dd\") " pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:50.813535 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.813501 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gx68h\" (UniqueName: \"kubernetes.io/projected/0eb4a394-3150-49c9-92e0-cdd6c44a25dd-kube-api-access-gx68h\") pod \"kserve-controller-manager-799c68cd74-b67j2\" (UID: \"0eb4a394-3150-49c9-92e0-cdd6c44a25dd\") " pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:50.813584 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.813538 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwdkm\" (UniqueName: \"kubernetes.io/projected/fbf058e3-2370-40a2-be98-e68dfe7cdd5a-kube-api-access-wwdkm\") pod \"seaweedfs-64568bcd49-pzh58\" (UID: \"fbf058e3-2370-40a2-be98-e68dfe7cdd5a\") " pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:50.859043 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.859017 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:50.914491 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.914426 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fbf058e3-2370-40a2-be98-e68dfe7cdd5a-data\") pod \"seaweedfs-64568bcd49-pzh58\" (UID: \"fbf058e3-2370-40a2-be98-e68dfe7cdd5a\") " pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:50.914491 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.914474 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb4a394-3150-49c9-92e0-cdd6c44a25dd-cert\") pod \"kserve-controller-manager-799c68cd74-b67j2\" (UID: \"0eb4a394-3150-49c9-92e0-cdd6c44a25dd\") " pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:50.914860 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.914505 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gx68h\" (UniqueName: \"kubernetes.io/projected/0eb4a394-3150-49c9-92e0-cdd6c44a25dd-kube-api-access-gx68h\") pod \"kserve-controller-manager-799c68cd74-b67j2\" (UID: \"0eb4a394-3150-49c9-92e0-cdd6c44a25dd\") " pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:50.914860 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.914537 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwdkm\" (UniqueName: \"kubernetes.io/projected/fbf058e3-2370-40a2-be98-e68dfe7cdd5a-kube-api-access-wwdkm\") pod \"seaweedfs-64568bcd49-pzh58\" (UID: \"fbf058e3-2370-40a2-be98-e68dfe7cdd5a\") " pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:50.914982 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.914865 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/fbf058e3-2370-40a2-be98-e68dfe7cdd5a-data\") pod \"seaweedfs-64568bcd49-pzh58\" (UID: \"fbf058e3-2370-40a2-be98-e68dfe7cdd5a\") " pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:50.917046 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.917028 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0eb4a394-3150-49c9-92e0-cdd6c44a25dd-cert\") pod \"kserve-controller-manager-799c68cd74-b67j2\" (UID: \"0eb4a394-3150-49c9-92e0-cdd6c44a25dd\") " pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:50.923774 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.923740 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwdkm\" (UniqueName: \"kubernetes.io/projected/fbf058e3-2370-40a2-be98-e68dfe7cdd5a-kube-api-access-wwdkm\") pod \"seaweedfs-64568bcd49-pzh58\" (UID: \"fbf058e3-2370-40a2-be98-e68dfe7cdd5a\") " pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:50.923857 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:50.923836 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gx68h\" (UniqueName: \"kubernetes.io/projected/0eb4a394-3150-49c9-92e0-cdd6c44a25dd-kube-api-access-gx68h\") pod \"kserve-controller-manager-799c68cd74-b67j2\" (UID: \"0eb4a394-3150-49c9-92e0-cdd6c44a25dd\") " pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:51.017653 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:51.017621 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:51.061380 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:51.061353 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:51.163509 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:51.163476 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-b67j2"] Jul 09 15:39:51.167759 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:39:51.167701 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb4a394_3150_49c9_92e0_cdd6c44a25dd.slice/crio-ed6ca43217b717743ef33aff136df2eb8488ddd96cccede410a9375d940af19f WatchSource:0}: Error finding container ed6ca43217b717743ef33aff136df2eb8488ddd96cccede410a9375d940af19f: Status 404 returned error can't find the container with id ed6ca43217b717743ef33aff136df2eb8488ddd96cccede410a9375d940af19f Jul 09 15:39:51.205683 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:51.205662 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-pzh58"] Jul 09 15:39:51.208131 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:39:51.208108 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbf058e3_2370_40a2_be98_e68dfe7cdd5a.slice/crio-0b5a9e51d4343d935e799f2d28a2e11cf80a943a1a187206525f4e6b99f32df3 WatchSource:0}: Error finding container 0b5a9e51d4343d935e799f2d28a2e11cf80a943a1a187206525f4e6b99f32df3: Status 404 returned error can't find the container with id 0b5a9e51d4343d935e799f2d28a2e11cf80a943a1a187206525f4e6b99f32df3 Jul 09 15:39:51.536076 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:51.536044 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-pzh58" event={"ID":"fbf058e3-2370-40a2-be98-e68dfe7cdd5a","Type":"ContainerStarted","Data":"0b5a9e51d4343d935e799f2d28a2e11cf80a943a1a187206525f4e6b99f32df3"} Jul 09 15:39:51.537083 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:51.537059 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerStarted","Data":"ed6ca43217b717743ef33aff136df2eb8488ddd96cccede410a9375d940af19f"} Jul 09 15:39:51.734368 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:51.734331 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:51.800081 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:51.799984 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:39:55.561676 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:55.561645 2566 generic.go:356] "Generic (PLEG): container finished" podID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" containerID="a199572de996920506a24048aa29e9bfd2e63f460a888729c0b63a2c0fb27718" exitCode=1 Jul 09 15:39:55.562100 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:55.561688 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerDied","Data":"a199572de996920506a24048aa29e9bfd2e63f460a888729c0b63a2c0fb27718"} Jul 09 15:39:55.562100 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:55.561929 2566 scope.go:117] "RemoveContainer" containerID="a199572de996920506a24048aa29e9bfd2e63f460a888729c0b63a2c0fb27718" Jul 09 15:39:55.563485 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:55.563461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-pzh58" event={"ID":"fbf058e3-2370-40a2-be98-e68dfe7cdd5a","Type":"ContainerStarted","Data":"f6e3fb9d4cc99a7378eb1c0c84dae2e029383c7801a0fb8d9a47bf8c38238795"} Jul 09 15:39:55.563614 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:55.563598 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:39:55.594075 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:55.594035 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-pzh58" podStartSLOduration=1.9036997329999998 podStartE2EDuration="5.594019538s" totalImagesPullingTime="3.690319805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:39:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:39:55.593370821 +0000 UTC m=+816.872747382" watchObservedRunningTime="2026-07-09 15:39:55.594019538 +0000 UTC m=+816.873396100" Jul 09 15:39:56.017790 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:56.017754 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:39:56.569984 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:56.569954 2566 generic.go:356] "Generic (PLEG): container finished" podID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" containerID="007f5a393af8c04b40afb1a340ab66e9231c7f7e0cc1e78de7387dc5d29f3daf" exitCode=1 Jul 09 15:39:56.570361 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:56.570031 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerDied","Data":"007f5a393af8c04b40afb1a340ab66e9231c7f7e0cc1e78de7387dc5d29f3daf"} Jul 09 15:39:56.570361 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:56.570084 2566 scope.go:117] "RemoveContainer" containerID="a199572de996920506a24048aa29e9bfd2e63f460a888729c0b63a2c0fb27718" Jul 09 15:39:56.570361 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:56.570287 2566 scope.go:117] "RemoveContainer" containerID="007f5a393af8c04b40afb1a340ab66e9231c7f7e0cc1e78de7387dc5d29f3daf" Jul 09 15:39:56.570532 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:39:56.570466 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:39:57.576757 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:39:57.576728 2566 scope.go:117] "RemoveContainer" containerID="007f5a393af8c04b40afb1a340ab66e9231c7f7e0cc1e78de7387dc5d29f3daf" Jul 09 15:39:57.577132 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:39:57.576911 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:40:01.018689 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:01.018662 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:40:01.019066 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:01.018724 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:40:01.019066 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:01.018995 2566 scope.go:117] "RemoveContainer" containerID="007f5a393af8c04b40afb1a340ab66e9231c7f7e0cc1e78de7387dc5d29f3daf" Jul 09 15:40:01.019169 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:40:01.019150 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:40:01.572286 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:01.572259 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-pzh58" Jul 09 15:40:16.259238 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:16.259206 2566 scope.go:117] "RemoveContainer" containerID="007f5a393af8c04b40afb1a340ab66e9231c7f7e0cc1e78de7387dc5d29f3daf" Jul 09 15:40:17.668291 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:17.668204 2566 generic.go:356] "Generic (PLEG): container finished" podID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" containerID="4c86dba9fdc0d8a6a20ae040e3f4fe6b8da05176124ad924d2c34a6bcdf002bb" exitCode=1 Jul 09 15:40:17.668291 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:17.668276 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerDied","Data":"4c86dba9fdc0d8a6a20ae040e3f4fe6b8da05176124ad924d2c34a6bcdf002bb"} Jul 09 15:40:17.668773 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:17.668334 2566 scope.go:117] "RemoveContainer" containerID="007f5a393af8c04b40afb1a340ab66e9231c7f7e0cc1e78de7387dc5d29f3daf" Jul 09 15:40:17.668773 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:17.668676 2566 scope.go:117] "RemoveContainer" containerID="4c86dba9fdc0d8a6a20ae040e3f4fe6b8da05176124ad924d2c34a6bcdf002bb" Jul 09 15:40:17.668892 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:40:17.668881 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:40:21.018480 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:21.018420 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:40:21.018940 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:21.018527 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:40:21.018940 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:21.018866 2566 scope.go:117] "RemoveContainer" containerID="4c86dba9fdc0d8a6a20ae040e3f4fe6b8da05176124ad924d2c34a6bcdf002bb" Jul 09 15:40:21.019089 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:40:21.019067 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:40:35.258870 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:35.258839 2566 scope.go:117] "RemoveContainer" containerID="4c86dba9fdc0d8a6a20ae040e3f4fe6b8da05176124ad924d2c34a6bcdf002bb" Jul 09 15:40:35.259324 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:40:35.259015 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:40:50.258477 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:50.258444 2566 scope.go:117] "RemoveContainer" containerID="4c86dba9fdc0d8a6a20ae040e3f4fe6b8da05176124ad924d2c34a6bcdf002bb" Jul 09 15:40:50.819356 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:50.819328 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerStarted","Data":"e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2"} Jul 09 15:40:50.819580 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:50.819554 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:40:50.836521 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:50.836414 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podStartSLOduration=54.81775587 podStartE2EDuration="1m0.836395972s" totalImagesPullingTime="6.018640102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:39:50 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:40:50.835840246 +0000 UTC m=+872.115216820" watchObservedRunningTime="2026-07-09 15:40:50.836395972 +0000 UTC m=+872.115772535" Jul 09 15:40:51.826271 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:51.826231 2566 generic.go:356] "Generic (PLEG): container finished" podID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" containerID="e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2" exitCode=1 Jul 09 15:40:51.826271 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:51.826264 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerDied","Data":"e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2"} Jul 09 15:40:51.826783 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:51.826326 2566 scope.go:117] "RemoveContainer" containerID="4c86dba9fdc0d8a6a20ae040e3f4fe6b8da05176124ad924d2c34a6bcdf002bb" Jul 09 15:40:51.826783 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:51.826531 2566 scope.go:117] "RemoveContainer" containerID="e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2" Jul 09 15:40:51.826783 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:40:51.826766 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:40:52.832993 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:40:52.832961 2566 scope.go:117] "RemoveContainer" containerID="e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2" Jul 09 15:40:52.833462 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:40:52.833184 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:41:01.018049 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:01.018018 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:41:01.018429 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:01.018414 2566 scope.go:117] "RemoveContainer" containerID="e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2" Jul 09 15:41:01.018618 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:41:01.018598 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:41:11.258985 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:11.258889 2566 scope.go:117] "RemoveContainer" containerID="e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2" Jul 09 15:41:11.259831 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:41:11.259110 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:41:19.255794 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:19.255764 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:41:19.258899 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:19.258870 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:41:19.263649 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:19.263622 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:41:19.267234 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:19.267211 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:41:25.259239 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:25.259212 2566 scope.go:117] "RemoveContainer" containerID="e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2" Jul 09 15:41:25.259765 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:41:25.259394 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:41:30.379136 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:30.379086 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:31.905086 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:31.905044 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:41:38.259037 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:38.259007 2566 scope.go:117] "RemoveContainer" containerID="e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2" Jul 09 15:41:39.043781 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:39.043752 2566 generic.go:356] "Generic (PLEG): container finished" podID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" exitCode=1 Jul 09 15:41:39.043956 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:39.043830 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerDied","Data":"6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85"} Jul 09 15:41:39.043956 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:39.043892 2566 scope.go:117] "RemoveContainer" containerID="e20fffde81e44f7e4d0deaf01fdc50c600859aa9c59087065d241c85d5c00fd2" Jul 09 15:41:39.044163 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:39.044149 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:41:39.044407 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:41:39.044371 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:41:40.819892 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:40.819859 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:41:40.820284 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:40.820222 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:41:40.820400 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:41:40.820381 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:41:41.018631 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:41.018597 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:41:41.054267 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:41.054245 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:41:41.054452 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:41:41.054432 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:41:55.258744 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:41:55.258690 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:41:55.259174 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:41:55.258922 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:42:10.258975 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:42:10.258941 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:42:10.259451 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:42:10.259122 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:42:21.258973 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:42:21.258942 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:42:21.259352 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:42:21.259144 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:42:25.532112 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:42:25.532078 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:35.258893 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:42:35.258861 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:42:35.259269 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:42:35.259037 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:42:46.229250 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:42:46.229210 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:42:46.259270 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:42:46.259240 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:42:46.259482 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:42:46.259456 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:43:00.258832 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:00.258800 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:43:01.418410 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:01.418378 2566 generic.go:356] "Generic (PLEG): container finished" podID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" exitCode=1 Jul 09 15:43:01.418854 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:01.418454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerDied","Data":"9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0"} Jul 09 15:43:01.418854 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:01.418520 2566 scope.go:117] "RemoveContainer" containerID="6c7b7152ca3efef227fa03f3247bff5abfa4974136acc7c4a29b875d3bbdef85" Jul 09 15:43:01.418998 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:01.418916 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:43:01.419101 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:43:01.419079 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:43:05.820523 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:05.820481 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:43:05.820961 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:05.820866 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:43:05.821052 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:43:05.821033 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:43:10.381124 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:10.381087 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:43:11.018801 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:11.018758 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:43:11.019131 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:11.019116 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:43:11.019303 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:43:11.019284 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:43:25.258996 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:25.258964 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:43:25.259482 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:43:25.259155 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:43:40.259285 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:40.259253 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:43:40.259646 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:43:40.259418 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:43:51.259367 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:43:51.259332 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:43:51.259890 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:43:51.259487 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:44:02.258523 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:44:02.258485 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:44:02.259022 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:44:02.258670 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:44:17.259393 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:44:17.259312 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:44:17.259887 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:44:17.259495 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:44:30.258573 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:44:30.258538 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:44:30.258995 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:44:30.258745 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:44:41.258773 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:44:41.258740 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:44:41.259142 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:44:41.258930 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:44:54.259197 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:44:54.259167 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:44:54.259649 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:44:54.259341 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:45:06.258914 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:06.258882 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:45:06.259387 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:45:06.259057 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:45:20.457265 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:20.457226 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:45:21.258730 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:21.258675 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:45:21.258934 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:45:21.258915 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:45:35.259035 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:35.258996 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:45:35.259503 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:45:35.259180 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:45:49.261329 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:49.261293 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:45:49.261830 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:49.261684 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:45:51.207619 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:51.207588 2566 generic.go:356] "Generic (PLEG): container finished" podID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" exitCode=1 Jul 09 15:45:51.208019 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:51.207639 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" event={"ID":"0eb4a394-3150-49c9-92e0-cdd6c44a25dd","Type":"ContainerDied","Data":"c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554"} Jul 09 15:45:51.208019 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:51.207685 2566 scope.go:117] "RemoveContainer" containerID="9c478c0dc42532caf351771dc75bb52e7de323a61dec15fd39166d0b248de9f0" Jul 09 15:45:51.208019 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:51.208016 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:45:51.208220 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:45:51.208198 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:45:55.820168 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:55.820136 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:45:55.820600 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:45:55.820584 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:45:55.820836 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:45:55.820806 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:46:01.018100 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:01.018069 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" Jul 09 15:46:01.018486 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:01.018434 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:46:01.018611 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:46:01.018592 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:46:16.259407 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:16.259373 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:46:16.259893 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:46:16.259561 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:46:19.284773 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:19.284746 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:46:19.296640 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:19.296604 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:46:19.298855 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:19.298833 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:46:19.304285 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:19.304265 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:46:28.258692 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:28.258659 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:46:28.259093 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:46:28.258851 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:46:41.259160 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:41.259124 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:46:41.259605 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:46:41.259390 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:46:55.259331 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:46:55.259298 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:46:55.261696 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:46:55.259470 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:47:07.258977 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:47:07.258938 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:47:07.259388 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:47:07.259184 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:47:20.258920 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:47:20.258839 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:47:20.259273 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:47:20.258994 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:47:31.258664 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:47:31.258628 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:47:31.259182 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:47:31.258836 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:47:43.258871 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:47:43.258838 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:47:43.259267 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:47:43.259008 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:47:57.258830 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:47:57.258799 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:47:57.259303 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:47:57.258969 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:48:12.259118 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:48:12.259090 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:48:12.259578 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:48:12.259257 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:48:24.258589 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:48:24.258559 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:48:24.259061 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:48:24.258772 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:48:35.258983 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:48:35.258949 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:48:35.259389 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:48:35.259159 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:48:48.310327 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:48:48.310288 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:48:50.259118 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:48:50.259088 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:48:50.259487 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:48:50.259291 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:49:04.259170 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:49:04.259141 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:49:04.259610 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:49:04.259303 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:49:18.259372 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:49:18.259338 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:49:18.259860 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:49:18.259514 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:49:31.259094 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:49:31.259058 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:49:31.259582 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:49:31.259222 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:49:45.264811 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:49:45.264786 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:49:45.265199 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:49:45.264965 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:49:57.259383 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:49:57.259353 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:49:57.259779 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:49:57.259524 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:50:03.184363 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:03.184318 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:03.241275 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:03.241235 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:08.258608 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:08.258578 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:50:08.259015 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:50:08.258780 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:50:20.259365 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:20.259275 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:50:20.259807 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:50:20.259451 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:50:22.506568 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:22.506534 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:22.696180 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:22.696142 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:22.768298 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:22.768202 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:25.586140 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:25.586106 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-px6xd_6b15963b-50f4-442b-8872-8858281ab6a4/global-pull-secret-syncer/0.log" Jul 09 15:50:25.692780 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:25.692756 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" Jul 09 15:50:25.853062 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:25.852980 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-133.ec2.internal_dca3604df6062d18799a8c635a695b55/haproxy/0.log" Jul 09 15:50:28.152357 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:28.152264 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:28.223139 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:28.223104 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:29.775287 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:29.775239 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_84c26455-fb6f-4e08-95c9-f51f06ae9e3a/alertmanager/0.log" Jul 09 15:50:29.813395 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:29.813359 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_84c26455-fb6f-4e08-95c9-f51f06ae9e3a/config-reloader/0.log" Jul 09 15:50:29.840459 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:29.840377 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_84c26455-fb6f-4e08-95c9-f51f06ae9e3a/kube-rbac-proxy-web/0.log" Jul 09 15:50:29.867123 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:29.867096 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_84c26455-fb6f-4e08-95c9-f51f06ae9e3a/kube-rbac-proxy/0.log" Jul 09 15:50:29.897600 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:29.897561 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_84c26455-fb6f-4e08-95c9-f51f06ae9e3a/kube-rbac-proxy-metric/0.log" Jul 09 15:50:29.925105 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:29.925072 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_84c26455-fb6f-4e08-95c9-f51f06ae9e3a/prom-label-proxy/0.log" Jul 09 15:50:29.953229 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:29.953203 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_84c26455-fb6f-4e08-95c9-f51f06ae9e3a/init-config-reloader/0.log" Jul 09 15:50:30.103259 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.103150 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-p9ggs_a64fa3a3-e1c7-440a-bf08-1da983e2d1fd/kube-state-metrics/0.log" Jul 09 15:50:30.126933 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.126906 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-p9ggs_a64fa3a3-e1c7-440a-bf08-1da983e2d1fd/kube-rbac-proxy-main/0.log" Jul 09 15:50:30.151990 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.151963 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-p9ggs_a64fa3a3-e1c7-440a-bf08-1da983e2d1fd/kube-rbac-proxy-self/0.log" Jul 09 15:50:30.182516 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.182486 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-c7c5b69db-jvflp_2c74a072-e089-458d-b3c1-23b1641925a1/metrics-server/0.log" Jul 09 15:50:30.208319 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.208298 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-qj4nb_0b6d43a4-c23f-4f09-961e-ed7e29c65772/monitoring-plugin/0.log" Jul 09 15:50:30.241811 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.241784 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hf8r_46d444eb-9e95-46c7-8995-e3121819bd70/node-exporter/0.log" Jul 09 15:50:30.266848 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.266817 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hf8r_46d444eb-9e95-46c7-8995-e3121819bd70/kube-rbac-proxy/0.log" Jul 09 15:50:30.290594 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.290571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4hf8r_46d444eb-9e95-46c7-8995-e3121819bd70/init-textfile/0.log" Jul 09 15:50:30.896027 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.895993 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-x45n7_a235d6ad-9ca2-4793-9a60-9f7e0a407c02/prometheus-operator-admission-webhook/0.log" Jul 09 15:50:30.933081 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.933055 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dc9c55b6f-hl5vd_1f21b4c4-907c-4fea-9ca7-33a7e2abadda/telemeter-client/0.log" Jul 09 15:50:30.960358 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.960331 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dc9c55b6f-hl5vd_1f21b4c4-907c-4fea-9ca7-33a7e2abadda/reload/0.log" Jul 09 15:50:30.988468 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:30.988439 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dc9c55b6f-hl5vd_1f21b4c4-907c-4fea-9ca7-33a7e2abadda/kube-rbac-proxy/0.log" Jul 09 15:50:31.030164 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:31.030124 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9978c7cd-wslhw_52b3daa1-09af-4f56-ab7c-8b8b57258d0d/thanos-query/0.log" Jul 09 15:50:31.080419 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:31.080394 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9978c7cd-wslhw_52b3daa1-09af-4f56-ab7c-8b8b57258d0d/kube-rbac-proxy-web/0.log" Jul 09 15:50:31.116351 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:31.116324 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9978c7cd-wslhw_52b3daa1-09af-4f56-ab7c-8b8b57258d0d/kube-rbac-proxy/0.log" Jul 09 15:50:31.146018 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:31.145992 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9978c7cd-wslhw_52b3daa1-09af-4f56-ab7c-8b8b57258d0d/prom-label-proxy/0.log" Jul 09 15:50:31.179939 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:31.179859 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9978c7cd-wslhw_52b3daa1-09af-4f56-ab7c-8b8b57258d0d/kube-rbac-proxy-rules/0.log" Jul 09 15:50:31.212121 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:31.212102 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5f9978c7cd-wslhw_52b3daa1-09af-4f56-ab7c-8b8b57258d0d/kube-rbac-proxy-metrics/0.log" Jul 09 15:50:32.902512 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:32.902475 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/2.log" Jul 09 15:50:32.906748 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:32.906728 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-mc4kb_9df66703-4718-4815-9965-a29acaa970c6/console-operator/3.log" Jul 09 15:50:33.065783 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.065749 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5"] Jul 09 15:50:33.069264 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.069243 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.071823 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.071802 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lkw82\"/\"kube-root-ca.crt\"" Jul 09 15:50:33.071950 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.071844 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lkw82\"/\"openshift-service-ca.crt\"" Jul 09 15:50:33.072011 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.071952 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lkw82\"/\"default-dockercfg-xsxtl\"" Jul 09 15:50:33.081449 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.081426 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5"] Jul 09 15:50:33.258497 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.258465 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-podres\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.258735 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.258504 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-sys\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.258735 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.258536 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-lib-modules\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.258735 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.258619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-proc\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.258896 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.258793 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfdpf\" (UniqueName: \"kubernetes.io/projected/ceae5a2a-6c6f-4e96-94e7-ae247d736734-kube-api-access-gfdpf\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.258896 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.258880 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:50:33.259039 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:50:33.259018 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:50:33.334433 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.334404 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-747f765995-vrslt_9cab915b-b8e4-4c14-a830-820d66907eec/console/0.log" Jul 09 15:50:33.359692 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.359660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-lib-modules\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.359908 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.359773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-proc\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.359908 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.359817 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfdpf\" (UniqueName: \"kubernetes.io/projected/ceae5a2a-6c6f-4e96-94e7-ae247d736734-kube-api-access-gfdpf\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.359908 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.359848 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-lib-modules\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.359908 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.359882 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-proc\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.360603 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.360570 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-podres\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.360766 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.360627 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-sys\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.365346 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.360846 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-sys\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.365346 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.360952 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ceae5a2a-6c6f-4e96-94e7-ae247d736734-podres\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.369133 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.369106 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfdpf\" (UniqueName: \"kubernetes.io/projected/ceae5a2a-6c6f-4e96-94e7-ae247d736734-kube-api-access-gfdpf\") pod \"perf-node-gather-daemonset-zxhv5\" (UID: \"ceae5a2a-6c6f-4e96-94e7-ae247d736734\") " pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.370022 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.370001 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-sgr6r_d9914449-833f-41ac-bbe4-c9a70c0bdbec/download-server/0.log" Jul 09 15:50:33.378926 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.378905 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:33.520541 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.520376 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5"] Jul 09 15:50:33.522991 ip-10-0-138-133 kubenswrapper[2566]: W0709 15:50:33.522959 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podceae5a2a_6c6f_4e96_94e7_ae247d736734.slice/crio-86017ceb87d2a170260f9fc73b471b77493c075ff063fb311bfd9aee79efd425 WatchSource:0}: Error finding container 86017ceb87d2a170260f9fc73b471b77493c075ff063fb311bfd9aee79efd425: Status 404 returned error can't find the container with id 86017ceb87d2a170260f9fc73b471b77493c075ff063fb311bfd9aee79efd425 Jul 09 15:50:33.894125 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:33.894049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-t8wvf_da174c21-04fa-4b77-98ac-1f7c7ed2de80/volume-data-source-validator/0.log" Jul 09 15:50:34.507062 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:34.507026 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" event={"ID":"ceae5a2a-6c6f-4e96-94e7-ae247d736734","Type":"ContainerStarted","Data":"e6dd331ef6ca4261e469314196c7fe42c8f6f1d1f46e94d26cf1b753080f6a82"} Jul 09 15:50:34.507518 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:34.507077 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" event={"ID":"ceae5a2a-6c6f-4e96-94e7-ae247d736734","Type":"ContainerStarted","Data":"86017ceb87d2a170260f9fc73b471b77493c075ff063fb311bfd9aee79efd425"} Jul 09 15:50:34.507518 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:34.507155 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:34.530410 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:34.530364 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" podStartSLOduration=1.530347071 podStartE2EDuration="1.530347071s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:50:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:50:34.52956694 +0000 UTC m=+1455.808943501" watchObservedRunningTime="2026-07-09 15:50:34.530347071 +0000 UTC m=+1455.809723642" Jul 09 15:50:34.933043 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:34.932958 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xzvk5_ff2dedf4-d7c0-42c7-a274-7d13ac2fffae/dns/0.log" Jul 09 15:50:34.959681 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:34.959653 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xzvk5_ff2dedf4-d7c0-42c7-a274-7d13ac2fffae/kube-rbac-proxy/0.log" Jul 09 15:50:35.106105 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:35.106073 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xwb2t_bfcbc1be-8b62-4992-b7a6-afb5cefd4663/dns-node-resolver/0.log" Jul 09 15:50:35.733359 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:35.733331 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-m94j4_1e002460-a3d1-4ad7-b248-0122b661f22b/node-ca/0.log" Jul 09 15:50:36.653575 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:36.653550 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-596f7d568b-gv49z_6928f790-cc79-4d08-bbf4-3a48557d079d/router/0.log" Jul 09 15:50:37.052582 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:37.052555 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rp5sk_a6111a94-30ad-4ecb-89b2-774cc73e7282/serve-healthcheck-canary/0.log" Jul 09 15:50:37.414510 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:37.414440 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5ng6_0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5/kube-rbac-proxy/0.log" Jul 09 15:50:37.436601 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:37.436575 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5ng6_0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5/exporter/0.log" Jul 09 15:50:37.458816 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:37.458792 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h5ng6_0e45c8ae-01ca-4fc6-a6bc-7d9fa2d43cb5/extractor/0.log" Jul 09 15:50:39.630471 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:39.630442 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-799c68cd74-b67j2_0eb4a394-3150-49c9-92e0-cdd6c44a25dd/manager/6.log" Jul 09 15:50:39.630471 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:39.630468 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-799c68cd74-b67j2_0eb4a394-3150-49c9-92e0-cdd6c44a25dd/manager/6.log" Jul 09 15:50:39.690273 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:39.690242 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-pzh58_fbf058e3-2370-40a2-be98-e68dfe7cdd5a/seaweedfs/0.log" Jul 09 15:50:40.522460 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:40.522430 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lkw82/perf-node-gather-daemonset-zxhv5" Jul 09 15:50:43.515835 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:43.515768 2566 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-qfmvb_cb5fbb5b-cd45-44fd-b1f2-f1fb1f945021/konnectivity-agent/0.log" limit=1024 Jul 09 15:50:44.324652 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:44.324576 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-s7qk6_2e707eba-5a8c-4086-9a05-cbb66791b425/kube-storage-version-migrator-operator/1.log" Jul 09 15:50:44.325432 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:44.325413 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-s7qk6_2e707eba-5a8c-4086-9a05-cbb66791b425/kube-storage-version-migrator-operator/0.log" Jul 09 15:50:45.620960 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:45.620934 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwhpx_c5c4e04a-9b0d-40f9-9a15-d600e6334fcc/kube-multus-additional-cni-plugins/0.log" Jul 09 15:50:45.644544 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:45.644516 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwhpx_c5c4e04a-9b0d-40f9-9a15-d600e6334fcc/egress-router-binary-copy/0.log" Jul 09 15:50:45.694468 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:45.694440 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwhpx_c5c4e04a-9b0d-40f9-9a15-d600e6334fcc/cni-plugins/0.log" Jul 09 15:50:45.764625 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:45.764597 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwhpx_c5c4e04a-9b0d-40f9-9a15-d600e6334fcc/bond-cni-plugin/0.log" Jul 09 15:50:45.791747 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:45.791720 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwhpx_c5c4e04a-9b0d-40f9-9a15-d600e6334fcc/routeoverride-cni/0.log" Jul 09 15:50:45.820430 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:45.820401 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwhpx_c5c4e04a-9b0d-40f9-9a15-d600e6334fcc/whereabouts-cni-bincopy/0.log" Jul 09 15:50:45.847551 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:45.847529 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-zwhpx_c5c4e04a-9b0d-40f9-9a15-d600e6334fcc/whereabouts-cni/0.log" Jul 09 15:50:45.907522 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:45.907449 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-klq7h_e360b86c-8026-44a4-975f-00e1bffa4e71/kube-multus/0.log" Jul 09 15:50:46.122105 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:46.122076 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mxqzz_12b20f1c-d297-4a7e-bc1c-2817359a7d21/network-metrics-daemon/0.log" Jul 09 15:50:46.153225 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:46.153192 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mxqzz_12b20f1c-d297-4a7e-bc1c-2817359a7d21/kube-rbac-proxy/0.log" Jul 09 15:50:47.429207 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.429176 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-controller/0.log" Jul 09 15:50:47.452604 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.452576 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/0.log" Jul 09 15:50:47.452779 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.452580 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovn-acl-logging/1.log" Jul 09 15:50:47.476744 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.476690 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/kube-rbac-proxy-node/0.log" Jul 09 15:50:47.500620 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.500597 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 15:50:47.523891 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.523868 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/northd/0.log" Jul 09 15:50:47.548083 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.548025 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/nbdb/0.log" Jul 09 15:50:47.577760 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.577734 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/sbdb/0.log" Jul 09 15:50:47.621503 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:47.621464 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zp7dp_dc5626e8-ee87-4703-b99f-64122274104f/ovnkube-controller/0.log" Jul 09 15:50:48.258955 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:48.258918 2566 scope.go:117] "RemoveContainer" containerID="c65e853707774453dc894287b7967d9994f67354edd3e19655d169617c358554" Jul 09 15:50:48.259185 ip-10-0-138-133 kubenswrapper[2566]: E0709 15:50:48.259161 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-b67j2_kserve(0eb4a394-3150-49c9-92e0-cdd6c44a25dd)\"" pod="kserve/kserve-controller-manager-799c68cd74-b67j2" podUID="0eb4a394-3150-49c9-92e0-cdd6c44a25dd" Jul 09 15:50:48.640460 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:48.640386 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-wrzr5_47d67b1f-0722-4d14-9ed1-73fbb50aec95/network-check-target-container/0.log" Jul 09 15:50:49.650434 ip-10-0-138-133 kubenswrapper[2566]: I0709 15:50:49.650357 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-pwlbp_ad43bf83-0c58-427c-90a9-efae74ce39ba/iptables-alerter/0.log"