Aug 01 05:41:07.899702 ip-10-0-138-6 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Aug 01 05:41:07.899716 ip-10-0-138-6 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Aug 01 05:41:07.899726 ip-10-0-138-6 systemd[1]: kubelet.service: Failed with result 'resources'. Aug 01 05:41:07.900209 ip-10-0-138-6 systemd[1]: Failed to start Kubernetes Kubelet. Aug 01 05:41:18.051076 ip-10-0-138-6 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Aug 01 05:41:18.051095 ip-10-0-138-6 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ef031f258924404ba3fcc86c775cadeb -- Aug 01 05:43:07.612536 ip-10-0-138-6 systemd[1]: Starting Kubernetes Kubelet... Aug 01 05:43:07.957303 ip-10-0-138-6 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 01 05:43:07.957303 ip-10-0-138-6 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Aug 01 05:43:07.957303 ip-10-0-138-6 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 01 05:43:07.957303 ip-10-0-138-6 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Aug 01 05:43:07.957303 ip-10-0-138-6 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Aug 01 05:43:07.959178 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.959090 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Aug 01 05:43:07.964411 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964385 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 05:43:07.964411 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964409 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 05:43:07.964411 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964413 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 05:43:07.964411 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964417 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 05:43:07.964411 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964420 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 05:43:07.964411 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964423 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964426 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964431 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964434 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964438 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964441 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964444 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964462 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964465 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964468 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964472 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964474 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964477 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964480 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964482 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964485 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964487 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964490 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964493 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964495 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 05:43:07.964588 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964498 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964500 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964503 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964506 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964508 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964511 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964514 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964516 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964519 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964521 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964524 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964526 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964529 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964536 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964540 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964544 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964547 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964551 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964554 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 05:43:07.965098 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964556 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964559 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964562 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964565 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964570 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964574 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964577 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964580 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964583 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964585 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964588 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964591 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964594 2561 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964596 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964599 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964602 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964604 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964607 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964610 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964612 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 05:43:07.965576 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964615 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964619 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964622 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964625 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964627 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964630 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964633 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964636 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964638 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964641 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964644 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964647 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964650 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964652 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964655 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964657 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964660 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964662 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964665 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964667 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 05:43:07.966054 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964670 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964672 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964676 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964679 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964682 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964684 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964687 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964690 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964693 2561 feature_gate.go:328] unrecognized feature gate: Example Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964695 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964698 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964701 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964703 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964706 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.964708 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965420 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965426 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965429 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965431 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 05:43:07.966558 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965435 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965438 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965441 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965444 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965446 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965450 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965453 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965455 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965458 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965460 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965463 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965465 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965468 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965470 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965473 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965475 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965478 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965480 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965483 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965485 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 05:43:07.967019 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965488 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965491 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965493 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965496 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965499 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965502 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965505 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965508 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965510 2561 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965513 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965516 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965519 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965521 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965524 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965526 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965529 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965531 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965534 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965537 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 05:43:07.967518 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965540 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965543 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965546 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965548 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965551 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965554 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965556 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965558 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965561 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965564 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965566 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965568 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965571 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965573 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965576 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965578 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965581 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965584 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965587 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965590 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 05:43:07.967992 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965592 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965596 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965598 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965601 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965604 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965606 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965609 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965613 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965617 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965620 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965623 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965625 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965628 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965630 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965633 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965636 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965638 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965641 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965646 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965649 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 05:43:07.968494 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965652 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965655 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965658 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965660 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965663 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965665 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965668 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965670 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965673 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965676 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965678 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965682 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965686 2561 feature_gate.go:328] unrecognized feature gate: Example Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965689 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965691 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.965694 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966081 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966085 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966088 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 05:43:07.968998 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966090 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966095 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966098 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966101 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966103 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966106 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966109 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966112 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966114 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966117 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966120 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966122 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966125 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966127 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966130 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966133 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966135 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966138 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966140 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 05:43:07.969480 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966143 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966145 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966148 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966150 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966153 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966156 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966159 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966161 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966164 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966166 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966169 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966171 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966174 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966176 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966179 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966181 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966183 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966186 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966189 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966192 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 05:43:07.969968 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966194 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966197 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966199 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966201 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966204 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966206 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966209 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966211 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966215 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966220 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966224 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966227 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966230 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966233 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966235 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966238 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966241 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966244 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966247 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 05:43:07.970465 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966249 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966252 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966254 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966257 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966259 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966262 2561 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966277 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966280 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966283 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966285 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966288 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966290 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966293 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966296 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966298 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966301 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966303 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966306 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966308 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966311 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 05:43:07.970948 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966314 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966316 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966319 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966322 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966325 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966327 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966330 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966332 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966337 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966340 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966343 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966345 2561 feature_gate.go:328] unrecognized feature gate: Example Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966348 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966351 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966353 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966356 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966358 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.966361 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966429 2561 flags.go:64] FLAG: --address="0.0.0.0" Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966436 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966442 2561 flags.go:64] FLAG: --anonymous-auth="true" Aug 01 05:43:07.971486 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966447 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966451 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966454 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966458 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966462 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966466 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966470 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966473 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966476 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966479 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966482 2561 flags.go:64] FLAG: --cgroup-root="" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966485 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966488 2561 flags.go:64] FLAG: --client-ca-file="" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966491 2561 flags.go:64] FLAG: --cloud-provider="external" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966494 2561 flags.go:64] FLAG: --cluster-dns="[]" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966498 2561 flags.go:64] FLAG: --cluster-domain="" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966501 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966504 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966507 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966513 2561 flags.go:64] FLAG: --container-log-max-files="5" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966516 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966519 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966523 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Aug 01 05:43:07.971986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966526 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966529 2561 flags.go:64] FLAG: --contention-profiling="false" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966532 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966535 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966538 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966541 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966545 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966548 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966550 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966553 2561 flags.go:64] FLAG: --enable-load-reader="false" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966557 2561 flags.go:64] FLAG: --enable-server="true" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966560 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966565 2561 flags.go:64] FLAG: --event-burst="100" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966568 2561 flags.go:64] FLAG: --event-qps="50" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966571 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966575 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966578 2561 flags.go:64] FLAG: --eviction-hard="" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966582 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966585 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966588 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966591 2561 flags.go:64] FLAG: --eviction-soft="" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966594 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966597 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966599 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966602 2561 flags.go:64] FLAG: --experimental-mounter-path="" Aug 01 05:43:07.972552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966605 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966608 2561 flags.go:64] FLAG: --fail-swap-on="true" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966611 2561 flags.go:64] FLAG: --feature-gates="" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966615 2561 flags.go:64] FLAG: --file-check-frequency="20s" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966625 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966630 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966633 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966636 2561 flags.go:64] FLAG: --healthz-port="10248" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966639 2561 flags.go:64] FLAG: --help="false" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966642 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-138-6.ec2.internal" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966645 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966648 2561 flags.go:64] FLAG: --http-check-frequency="20s" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966651 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966654 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966657 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966660 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966663 2561 flags.go:64] FLAG: --image-service-endpoint="" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966666 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966668 2561 flags.go:64] FLAG: --kube-api-burst="100" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966671 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966674 2561 flags.go:64] FLAG: --kube-api-qps="50" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966677 2561 flags.go:64] FLAG: --kube-reserved="" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966680 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966683 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Aug 01 05:43:07.973179 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966686 2561 flags.go:64] FLAG: --kubelet-cgroups="" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966689 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966692 2561 flags.go:64] FLAG: --lock-file="" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966695 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966698 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966700 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966706 2561 flags.go:64] FLAG: --log-json-split-stream="false" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966708 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966711 2561 flags.go:64] FLAG: --log-text-split-stream="false" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966714 2561 flags.go:64] FLAG: --logging-format="text" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966717 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966721 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966723 2561 flags.go:64] FLAG: --manifest-url="" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966726 2561 flags.go:64] FLAG: --manifest-url-header="" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966731 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966734 2561 flags.go:64] FLAG: --max-open-files="1000000" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966738 2561 flags.go:64] FLAG: --max-pods="110" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966741 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966744 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966747 2561 flags.go:64] FLAG: --memory-manager-policy="None" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966750 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966753 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966756 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966758 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966766 2561 flags.go:64] FLAG: --node-status-max-images="50" Aug 01 05:43:07.974068 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966769 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966772 2561 flags.go:64] FLAG: --oom-score-adj="-999" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966775 2561 flags.go:64] FLAG: --pod-cidr="" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966778 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966784 2561 flags.go:64] FLAG: --pod-manifest-path="" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966787 2561 flags.go:64] FLAG: --pod-max-pids="-1" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966790 2561 flags.go:64] FLAG: --pods-per-core="0" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966793 2561 flags.go:64] FLAG: --port="10250" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966796 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966799 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c8bd79eedbb8c18" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966802 2561 flags.go:64] FLAG: --qos-reserved="" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966805 2561 flags.go:64] FLAG: --read-only-port="10255" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966808 2561 flags.go:64] FLAG: --register-node="true" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966811 2561 flags.go:64] FLAG: --register-with-taints="" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966814 2561 flags.go:64] FLAG: --registry-burst="10" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966817 2561 flags.go:64] FLAG: --registry-qps="5" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966820 2561 flags.go:64] FLAG: --reserved-cpus="" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966823 2561 flags.go:64] FLAG: --reserved-memory="" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966828 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966831 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966834 2561 flags.go:64] FLAG: --rotate-certificates="false" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966837 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966840 2561 flags.go:64] FLAG: --runonce="false" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966843 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966846 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Aug 01 05:43:07.975164 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966849 2561 flags.go:64] FLAG: --seccomp-default="false" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966852 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966854 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966857 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966860 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966864 2561 flags.go:64] FLAG: --storage-driver-password="root" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966866 2561 flags.go:64] FLAG: --storage-driver-secure="false" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966869 2561 flags.go:64] FLAG: --storage-driver-table="stats" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966872 2561 flags.go:64] FLAG: --storage-driver-user="root" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966875 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966878 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966881 2561 flags.go:64] FLAG: --system-cgroups="" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966883 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966889 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966891 2561 flags.go:64] FLAG: --tls-cert-file="" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966895 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966899 2561 flags.go:64] FLAG: --tls-min-version="" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966901 2561 flags.go:64] FLAG: --tls-private-key-file="" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966904 2561 flags.go:64] FLAG: --topology-manager-policy="none" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966907 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966910 2561 flags.go:64] FLAG: --topology-manager-scope="container" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966912 2561 flags.go:64] FLAG: --v="2" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966916 2561 flags.go:64] FLAG: --version="false" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966920 2561 flags.go:64] FLAG: --vmodule="" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966923 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Aug 01 05:43:07.976127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.966928 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967042 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967045 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967048 2561 feature_gate.go:328] unrecognized feature gate: Example Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967051 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967053 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967056 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967059 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967061 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967064 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967067 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967069 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967072 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967074 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967077 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967079 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967082 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967084 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967088 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967090 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 05:43:07.976940 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967094 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967098 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967101 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967108 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967111 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967114 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967117 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967120 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967123 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967126 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967129 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967131 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967137 2561 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967140 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967143 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967145 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967148 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967152 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967155 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967158 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 05:43:07.977821 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967161 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967164 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967167 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967170 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967172 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967175 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967177 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967180 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967182 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967185 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967187 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967190 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967193 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967195 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967197 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967200 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967203 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967206 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967208 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 05:43:07.978460 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967211 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967213 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967216 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967219 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967221 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967226 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967230 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967234 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967237 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967239 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967242 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967244 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967247 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967249 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967252 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967255 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967257 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967260 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967262 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 05:43:07.979255 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967277 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967280 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967282 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967285 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967287 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967290 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967293 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967295 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967298 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967301 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967303 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967307 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967309 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967312 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967315 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967317 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967320 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967323 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967329 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967332 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 05:43:07.980029 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967335 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.967337 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.967840 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.975858 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.975875 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.976567 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.976583 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976675 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976683 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976688 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976693 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976698 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976703 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976707 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976712 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 05:43:07.980687 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976716 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976720 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976725 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976729 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976734 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976738 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976742 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976746 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976752 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976756 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976761 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976765 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976769 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976774 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976778 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976785 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976791 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976796 2561 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976801 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 05:43:07.981057 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976806 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976810 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976816 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976821 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976826 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976831 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976835 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976842 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976848 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976852 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976859 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976864 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976870 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976876 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976881 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976885 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976890 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976894 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976898 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 05:43:07.981590 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976902 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976907 2561 feature_gate.go:328] unrecognized feature gate: Example Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976911 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976917 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976921 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976926 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976930 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976934 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976938 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976942 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976947 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976950 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976954 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976958 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976962 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976967 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976972 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976976 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976981 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976985 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 05:43:07.982092 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976990 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976994 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.976999 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977003 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977008 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977012 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977016 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977020 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977024 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977029 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977033 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977038 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977042 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977046 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977050 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977055 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977060 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977064 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977068 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977072 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 05:43:07.982745 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977077 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977081 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977085 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977089 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977093 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977098 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977103 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977108 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977112 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977116 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977120 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977125 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977129 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.977138 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977334 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Aug 01 05:43:07.983257 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977343 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977349 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977354 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977359 2561 feature_gate.go:328] unrecognized feature gate: Example Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977363 2561 feature_gate.go:328] unrecognized feature gate: Example2 Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977368 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977372 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977379 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977385 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977390 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977395 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977400 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977404 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977409 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977414 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977418 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977423 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977428 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977432 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977436 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Aug 01 05:43:07.983714 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977440 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977445 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977449 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977454 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977458 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977463 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977467 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977472 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977476 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977480 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977485 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977489 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977493 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977497 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977501 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977506 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977510 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977514 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977518 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977522 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Aug 01 05:43:07.984202 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977527 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977531 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977535 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977539 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977543 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977548 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977552 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977564 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977568 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977572 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977577 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977581 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977585 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977589 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977594 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977598 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977602 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977606 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977610 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977614 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Aug 01 05:43:07.984822 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977618 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977623 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977628 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977632 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977636 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977640 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977645 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977649 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977653 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977657 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977661 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977668 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977674 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977678 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977683 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977687 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977692 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977696 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977701 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Aug 01 05:43:07.985335 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977706 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977711 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977716 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977721 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977726 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977730 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977735 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977739 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977744 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977749 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977754 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977759 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977764 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977768 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977772 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977777 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977782 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977789 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Aug 01 05:43:07.985791 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:07.977794 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Aug 01 05:43:07.986235 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.977803 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Aug 01 05:43:07.986235 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.977946 2561 server.go:962] "Client rotation is on, will bootstrap in background" Aug 01 05:43:07.986235 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.982146 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Aug 01 05:43:07.986235 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.983539 2561 server.go:1019] "Starting client certificate rotation" Aug 01 05:43:07.986235 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.983645 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 01 05:43:07.986235 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.983691 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Aug 01 05:43:07.986235 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.986227 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 01 05:43:07.989863 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.989848 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Aug 01 05:43:07.997806 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:07.997787 2561 log.go:25] "Validated CRI v1 runtime API" Aug 01 05:43:08.000673 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.000652 2561 log.go:25] "Validated CRI v1 image API" Aug 01 05:43:08.002126 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.002110 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Aug 01 05:43:08.004110 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.004088 2561 fs.go:135] Filesystem UUIDs: map[11db85ee-ba45-4b54-b544-90a3d4b306cf:/dev/nvme0n1p3 6348ed3e-55dc-4d55-93d6-26828c74255a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Aug 01 05:43:08.004207 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.004109 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Aug 01 05:43:08.009118 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.008999 2561 manager.go:216] Machine: {Timestamp:2026-08-01 05:43:08.007732873 +0000 UTC m=+0.294880697 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121713 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b84c4eb7813e836011f515f6b87ef SystemUUID:ec2b84c4-eb78-13e8-3601-1f515f6b87ef BootID:ef031f25-8924-404b-a3fc-c86c775cadeb Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:f7:24:50:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:f7:24:50:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:8a:ee:1b:a2:2a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Aug 01 05:43:08.009118 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.009108 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Aug 01 05:43:08.009323 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.009204 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Aug 01 05:43:08.010585 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.010557 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Aug 01 05:43:08.010728 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.010588 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-6.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Aug 01 05:43:08.011222 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.011213 2561 topology_manager.go:138] "Creating topology manager with none policy" Aug 01 05:43:08.011257 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.011224 2561 container_manager_linux.go:309] "Creating device plugin manager" Aug 01 05:43:08.011257 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.011232 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 01 05:43:08.011407 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.011392 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 01 05:43:08.011930 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.011919 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Aug 01 05:43:08.012642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.012633 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Aug 01 05:43:08.015941 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.015929 2561 state_mem.go:36] "Initialized new in-memory state store" Aug 01 05:43:08.016060 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.016050 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Aug 01 05:43:08.016096 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.016080 2561 kubelet.go:486] "Attempting to sync node with API server" Aug 01 05:43:08.016096 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.016094 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Aug 01 05:43:08.016152 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.016116 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Aug 01 05:43:08.016152 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.016130 2561 kubelet.go:398] "Adding apiserver pod source" Aug 01 05:43:08.016152 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.016142 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Aug 01 05:43:08.016570 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.016553 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 01 05:43:08.016662 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.016578 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Aug 01 05:43:08.018590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.018576 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Aug 01 05:43:08.019882 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.019868 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Aug 01 05:43:08.019929 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.019899 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Aug 01 05:43:08.021317 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021306 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Aug 01 05:43:08.021355 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021324 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Aug 01 05:43:08.021355 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021330 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Aug 01 05:43:08.021355 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021335 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Aug 01 05:43:08.021355 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021344 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Aug 01 05:43:08.021355 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021349 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Aug 01 05:43:08.021355 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021357 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Aug 01 05:43:08.021518 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021362 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Aug 01 05:43:08.021518 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021378 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Aug 01 05:43:08.021518 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021384 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Aug 01 05:43:08.021518 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021396 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Aug 01 05:43:08.021518 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.021402 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Aug 01 05:43:08.022138 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.022128 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Aug 01 05:43:08.022138 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.022137 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Aug 01 05:43:08.024372 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.024355 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-6.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Aug 01 05:43:08.024372 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.024360 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Aug 01 05:43:08.024496 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.024420 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Aug 01 05:43:08.025230 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.025217 2561 server.go:1268] "Started kubelet" Aug 01 05:43:08.025391 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.025358 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Aug 01 05:43:08.025449 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.025387 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Aug 01 05:43:08.025494 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.025472 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Aug 01 05:43:08.026004 ip-10-0-138-6 systemd[1]: Started Kubernetes Kubelet. Aug 01 05:43:08.028813 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.028748 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Aug 01 05:43:08.030225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.030204 2561 server.go:310] "Adding debug handlers to kubelet server" Aug 01 05:43:08.030600 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.030578 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Aug 01 05:43:08.032406 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.032388 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4lkgx" Aug 01 05:43:08.034025 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034003 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Aug 01 05:43:08.034116 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034008 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Aug 01 05:43:08.034170 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.034155 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:08.034660 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034643 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Aug 01 05:43:08.034660 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034662 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Aug 01 05:43:08.034861 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034645 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Aug 01 05:43:08.034861 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.033758 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-6.ec2.internal.18c79813c9538f4e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-6.ec2.internal,UID:ip-10-0-138-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-6.ec2.internal,},FirstTimestamp:2026-08-01 05:43:08.025188174 +0000 UTC m=+0.312335997,LastTimestamp:2026-08-01 05:43:08.025188174 +0000 UTC m=+0.312335997,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-6.ec2.internal,}" Aug 01 05:43:08.034997 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034889 2561 factory.go:55] Registering systemd factory Aug 01 05:43:08.034997 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034903 2561 factory.go:223] Registration of the systemd container factory successfully Aug 01 05:43:08.034997 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034947 2561 reconstruct.go:97] "Volume reconstruction finished" Aug 01 05:43:08.034997 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.034957 2561 reconciler.go:29] "Reconciler: start to sync state" Aug 01 05:43:08.035216 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.035201 2561 factory.go:153] Registering CRI-O factory Aug 01 05:43:08.035290 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.035219 2561 factory.go:223] Registration of the crio container factory successfully Aug 01 05:43:08.035339 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.035292 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Aug 01 05:43:08.035339 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.035320 2561 factory.go:103] Registering Raw factory Aug 01 05:43:08.035339 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.035336 2561 manager.go:1196] Started watching for new ooms in manager Aug 01 05:43:08.035675 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.035663 2561 manager.go:349] Starting recovery of all containers Aug 01 05:43:08.040263 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.040239 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4lkgx" Aug 01 05:43:08.041206 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.041179 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Aug 01 05:43:08.041332 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.041309 2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-6.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Aug 01 05:43:08.045680 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.045667 2561 manager.go:354] Recovery completed Aug 01 05:43:08.050780 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.050768 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 05:43:08.052409 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.052395 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientMemory" Aug 01 05:43:08.052460 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.052420 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 05:43:08.052460 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.052430 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientPID" Aug 01 05:43:08.052905 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.052889 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Aug 01 05:43:08.052905 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.052899 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Aug 01 05:43:08.052905 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.052905 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 05:43:08.053067 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.052915 2561 state_mem.go:36] "Initialized new in-memory state store" Aug 01 05:43:08.053960 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.053943 2561 policy_none.go:49] "None policy: Start" Aug 01 05:43:08.054033 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.053966 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Aug 01 05:43:08.054033 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.053970 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientMemory" Aug 01 05:43:08.054033 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.053980 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Aug 01 05:43:08.054033 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.054008 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 05:43:08.054033 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.054025 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientPID" Aug 01 05:43:08.054744 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.054638 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-6.ec2.internal.18c79813caf2e71a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-6.ec2.internal,UID:ip-10-0-138-6.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-6.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-6.ec2.internal,},FirstTimestamp:2026-08-01 05:43:08.05240809 +0000 UTC m=+0.339555915,LastTimestamp:2026-08-01 05:43:08.05240809 +0000 UTC m=+0.339555915,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-6.ec2.internal,}" Aug 01 05:43:08.055178 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.055160 2561 policy_none.go:47] "Start" Aug 01 05:43:08.097930 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.097776 2561 manager.go:337] "Starting Device Plugin manager" Aug 01 05:43:08.098020 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.097951 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Aug 01 05:43:08.098020 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.097964 2561 server.go:87] "Starting device plugin registration server" Aug 01 05:43:08.098192 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.098180 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Aug 01 05:43:08.098240 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.098192 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Aug 01 05:43:08.098318 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.098298 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Aug 01 05:43:08.098390 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.098376 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Aug 01 05:43:08.098447 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.098391 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Aug 01 05:43:08.098859 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.098841 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Aug 01 05:43:08.098933 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.098896 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:08.194683 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.194653 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Aug 01 05:43:08.195906 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.195893 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Aug 01 05:43:08.195961 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.195928 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Aug 01 05:43:08.195961 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.195950 2561 kubelet.go:2448] "Starting kubelet main sync loop" Aug 01 05:43:08.196053 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.195982 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Aug 01 05:43:08.197880 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.197857 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 05:43:08.198416 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.198402 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 05:43:08.199867 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.199848 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientMemory" Aug 01 05:43:08.199953 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.199884 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 05:43:08.199953 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.199899 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientPID" Aug 01 05:43:08.199953 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.199929 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-6.ec2.internal" Aug 01 05:43:08.207113 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.207098 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-6.ec2.internal" Aug 01 05:43:08.207179 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.207118 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-6.ec2.internal\": node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:08.235965 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.235904 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:08.297104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.297064 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal"] Aug 01 05:43:08.297251 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.297168 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 05:43:08.298104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.298089 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientMemory" Aug 01 05:43:08.298186 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.298122 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 05:43:08.298186 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.298136 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientPID" Aug 01 05:43:08.299409 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.299394 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 05:43:08.299540 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.299521 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:08.299587 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.299551 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 05:43:08.300069 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.300053 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientMemory" Aug 01 05:43:08.300146 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.300055 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientMemory" Aug 01 05:43:08.300146 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.300081 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 05:43:08.300146 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.300094 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientPID" Aug 01 05:43:08.300303 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.300095 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 05:43:08.300303 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.300237 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientPID" Aug 01 05:43:08.301236 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.301221 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" Aug 01 05:43:08.301328 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.301260 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Aug 01 05:43:08.301984 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.301968 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientMemory" Aug 01 05:43:08.302035 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.302002 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasNoDiskPressure" Aug 01 05:43:08.302035 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:08.302018 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeHasSufficientPID" Aug 01 05:43:08.324971 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.324949 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-6.ec2.internal\" not found" node="ip-10-0-138-6.ec2.internal" Aug 01 05:43:08.329417 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:08.329402 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-6.ec2.internal\" not found" node="ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.226917 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.226904 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:10.226988 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.226912 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa6b1e7070ed1e0850ff0177f7a68881-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal\" (UID: \"fa6b1e7070ed1e0850ff0177f7a68881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.226988 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.226938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa6b1e7070ed1e0850ff0177f7a68881-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal\" (UID: \"fa6b1e7070ed1e0850ff0177f7a68881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.226988 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.226953 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b41a42c4a640d469582886dee01f9988-config\") pod \"kube-apiserver-proxy-ip-10-0-138-6.ec2.internal\" (UID: \"b41a42c4a640d469582886dee01f9988\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.327581 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.327553 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:10.327688 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.327585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa6b1e7070ed1e0850ff0177f7a68881-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal\" (UID: \"fa6b1e7070ed1e0850ff0177f7a68881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.327688 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.327609 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa6b1e7070ed1e0850ff0177f7a68881-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal\" (UID: \"fa6b1e7070ed1e0850ff0177f7a68881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.327688 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.327627 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b41a42c4a640d469582886dee01f9988-config\") pod \"kube-apiserver-proxy-ip-10-0-138-6.ec2.internal\" (UID: \"b41a42c4a640d469582886dee01f9988\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.327688 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.327674 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b41a42c4a640d469582886dee01f9988-config\") pod \"kube-apiserver-proxy-ip-10-0-138-6.ec2.internal\" (UID: \"b41a42c4a640d469582886dee01f9988\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.327835 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.327690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa6b1e7070ed1e0850ff0177f7a68881-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal\" (UID: \"fa6b1e7070ed1e0850ff0177f7a68881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.327835 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.327690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fa6b1e7070ed1e0850ff0177f7a68881-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal\" (UID: \"fa6b1e7070ed1e0850ff0177f7a68881\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.428277 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.428247 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:10.518477 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.518439 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.523538 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.523520 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.529017 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.528999 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:10.629470 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.629440 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:10.729903 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.729838 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:10.830244 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.830203 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-6.ec2.internal\" not found" Aug 01 05:43:10.846341 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.846322 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 05:43:10.874470 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.874447 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Aug 01 05:43:10.874843 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.874564 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 01 05:43:10.874843 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.874603 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Aug 01 05:43:10.887852 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.887836 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 05:43:10.907717 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.907698 2561 apiserver.go:52] "Watching apiserver" Aug 01 05:43:10.917600 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.917574 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Aug 01 05:43:10.918524 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.918506 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-gz82h","openshift-multus/network-metrics-daemon-hhc8q","openshift-network-diagnostics/network-check-target-7tpxx","openshift-network-operator/iptables-alerter-d6pz4","openshift-ovn-kubernetes/ovnkube-node-7r9lp","kube-system/konnectivity-agent-dfhgz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd","openshift-cluster-node-tuning-operator/tuned-r2c9t","openshift-image-registry/node-ca-qkx6h","openshift-multus/multus-k6sxh","kube-system/global-pull-secret-syncer-wkpzk","openshift-dns/node-resolver-nhvgl"] Aug 01 05:43:10.920566 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.920511 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.921664 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.921643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:10.921772 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.921712 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:10.922648 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.922628 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:10.922733 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.922692 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:10.923085 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.923068 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Aug 01 05:43:10.923147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.923087 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Aug 01 05:43:10.923202 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.923193 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Aug 01 05:43:10.923485 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.923464 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Aug 01 05:43:10.923580 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.923471 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2jrbj\"" Aug 01 05:43:10.923580 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.923565 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Aug 01 05:43:10.923696 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.923672 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:10.924785 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.924770 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.925128 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.925113 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Aug 01 05:43:10.925226 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.925137 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.925772 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.925749 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Aug 01 05:43:10.926094 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.925854 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Aug 01 05:43:10.926094 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.925868 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Aug 01 05:43:10.926094 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.925860 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:10.926094 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.926054 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tp5f8\"" Aug 01 05:43:10.926987 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.926973 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Aug 01 05:43:10.927136 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.927121 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:10.927250 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.927220 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Aug 01 05:43:10.927250 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.927244 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Aug 01 05:43:10.927363 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.927305 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Aug 01 05:43:10.927659 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.927646 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Aug 01 05:43:10.927817 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.927801 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hg282\"" Aug 01 05:43:10.927880 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.927836 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Aug 01 05:43:10.928495 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.928482 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:10.928566 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.928535 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Aug 01 05:43:10.928658 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.928641 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hvpcz\"" Aug 01 05:43:10.928771 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.928759 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Aug 01 05:43:10.929147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.929133 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Aug 01 05:43:10.929341 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.929323 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-568dw\"" Aug 01 05:43:10.929530 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.929517 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Aug 01 05:43:10.929749 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.929737 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Aug 01 05:43:10.929845 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.929832 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:10.930698 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930679 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-cni-bin\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.930796 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930705 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-system-cni-dir\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.930796 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-run-netns\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.930796 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-env-overrides\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.930796 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7e1f7d9-54f1-44de-b231-fb41d2ef95e9-agent-certs\") pod \"konnectivity-agent-dfhgz\" (UID: \"f7e1f7d9-54f1-44de-b231-fb41d2ef95e9\") " pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930833 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7e1f7d9-54f1-44de-b231-fb41d2ef95e9-konnectivity-ca\") pod \"konnectivity-agent-dfhgz\" (UID: \"f7e1f7d9-54f1-44de-b231-fb41d2ef95e9\") " pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930864 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930906 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-os-release\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930920 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4frn7\"" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930924 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930938 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq24t\" (UniqueName: \"kubernetes.io/projected/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-kube-api-access-bq24t\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.930962 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-ovnkube-config\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931012 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndwvq\" (UniqueName: \"kubernetes.io/projected/375d8949-979e-4b00-9d5b-b75d6f276596-kube-api-access-ndwvq\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d841c62-35da-434f-bbbf-5baac81af9ad-iptables-alerter-script\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs9wg\" (UniqueName: \"kubernetes.io/projected/8d841c62-35da-434f-bbbf-5baac81af9ad-kube-api-access-zs9wg\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-slash\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-run-ovn-kubernetes\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-cni-netd\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/375d8949-979e-4b00-9d5b-b75d6f276596-ovn-node-metrics-cert\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-ovnkube-script-lib\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931302 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k6sxh" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhrs4\" (UniqueName: \"kubernetes.io/projected/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-kube-api-access-xhrs4\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-socket-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931371 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-device-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-systemd-units\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-systemd\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.931474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931485 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-sys-fs\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931510 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zft6\" (UniqueName: \"kubernetes.io/projected/3367c581-2e3c-408e-a4a9-addab880d580-kube-api-access-7zft6\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-kubelet\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931611 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-etc-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931649 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cnibin\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931682 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-ovn\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931701 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-log-socket\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d841c62-35da-434f-bbbf-5baac81af9ad-host-slash\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931760 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-registration-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931931 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Aug 01 05:43:10.932082 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7zkqd\"" Aug 01 05:43:10.932723 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931983 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Aug 01 05:43:10.932723 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.931894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-var-lib-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.932723 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.932483 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-node-log\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:10.932723 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.932453 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:10.932932 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.932913 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Aug 01 05:43:10.932976 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:10.932940 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:10.934607 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.934016 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:10.934994 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.934973 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Aug 01 05:43:10.935060 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.934989 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-31 05:38:09 +0000 UTC" deadline="2028-03-01 16:14:30.510997047 +0000 UTC" Aug 01 05:43:10.935060 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.935051 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13882h31m19.575950347s" Aug 01 05:43:10.935144 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.934975 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xspn6\"" Aug 01 05:43:10.936113 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.936097 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Aug 01 05:43:10.937243 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.937213 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 01 05:43:10.937331 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.937262 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fxcr8\"" Aug 01 05:43:10.937331 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.937292 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal"] Aug 01 05:43:10.937331 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.937303 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" Aug 01 05:43:10.937529 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.937483 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Aug 01 05:43:10.943800 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.943784 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Aug 01 05:43:10.945414 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.945401 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Aug 01 05:43:10.945500 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.945486 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal"] Aug 01 05:43:10.962602 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.962584 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wx22r" Aug 01 05:43:10.970784 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:10.970770 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wx22r" Aug 01 05:43:11.027418 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.027400 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Aug 01 05:43:11.032633 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-system-cni-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.032742 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032637 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-cni-bin\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.032742 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-cni-multus\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.032742 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-var-lib-kubelet\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.032742 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-hostroot\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.032742 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-multus-certs\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.032742 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032724 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-tmp-dir\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032761 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhrs4\" (UniqueName: \"kubernetes.io/projected/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-kube-api-access-xhrs4\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032779 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-device-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032815 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-etc-kubernetes\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-kubelet\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032872 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-device-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032918 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-kubelet\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-etc-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.032992 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-systemd\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba62bfc3-b408-4a41-92f4-db31ffe596ca-host\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033045 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-etc-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033058 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-socket-dir-parent\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033088 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-kubelet\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.033119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cnibin\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-ovn\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033155 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cnibin\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033176 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-ovn\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-log-socket\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033254 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033280 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-registration-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033323 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-log-socket\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-cni-bin\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033361 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-registration-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033395 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-kubernetes\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033395 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-cni-bin\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033413 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-system-cni-dir\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033439 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-run-netns\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033467 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-system-cni-dir\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-env-overrides\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.033762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7e1f7d9-54f1-44de-b231-fb41d2ef95e9-agent-certs\") pod \"konnectivity-agent-dfhgz\" (UID: \"f7e1f7d9-54f1-44de-b231-fb41d2ef95e9\") " pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033548 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7e1f7d9-54f1-44de-b231-fb41d2ef95e9-konnectivity-ca\") pod \"konnectivity-agent-dfhgz\" (UID: \"f7e1f7d9-54f1-44de-b231-fb41d2ef95e9\") " pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033572 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-lib-modules\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033601 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-run-netns\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq24t\" (UniqueName: \"kubernetes.io/projected/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-kube-api-access-bq24t\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-ovnkube-config\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033664 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndwvq\" (UniqueName: \"kubernetes.io/projected/375d8949-979e-4b00-9d5b-b75d6f276596-kube-api-access-ndwvq\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033719 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-cni-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-k8s-cni-cncf-io\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75dwj\" (UniqueName: \"kubernetes.io/projected/542953d0-ab33-4cc3-8069-493a8c14d1c1-kube-api-access-75dwj\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033793 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-slash\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033816 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-run-ovn-kubernetes\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033839 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-cni-netd\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-ovnkube-script-lib\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033897 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-cni-netd\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.034613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033907 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-slash\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033909 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-run\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-tmp\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.033886 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-run-ovn-kubernetes\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-os-release\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-daemon-config\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034064 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-sys\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54bfe892-21bb-4ece-b41c-f7b533281c1a-kubelet-config\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034114 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54bfe892-21bb-4ece-b41c-f7b533281c1a-dbus\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-hosts-file\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034160 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-socket-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034256 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-systemd-units\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-systemd\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-modprobe-d\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034329 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-tuned\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba62bfc3-b408-4a41-92f4-db31ffe596ca-serviceca\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.035511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034365 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-cnibin\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-sys-fs\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zft6\" (UniqueName: \"kubernetes.io/projected/3367c581-2e3c-408e-a4a9-addab880d580-kube-api-access-7zft6\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034723 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-systemd-units\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.034597 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034647 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-sys-fs\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034552 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-systemd\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034786 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n4ll\" (UniqueName: \"kubernetes.io/projected/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-kube-api-access-4n4ll\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034795 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-run-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034796 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-ovnkube-config\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.034915 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs podName:f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f nodeName:}" failed. No retries permitted until 2026-08-01 05:43:11.534858288 +0000 UTC m=+1.931042424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs") pod "network-metrics-daemon-hhc8q" (UID: "f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034948 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-ovnkube-script-lib\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-conf-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.036393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035009 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d841c62-35da-434f-bbbf-5baac81af9ad-host-slash\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.034976 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035059 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035110 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7e1f7d9-54f1-44de-b231-fb41d2ef95e9-konnectivity-ca\") pod \"konnectivity-agent-dfhgz\" (UID: \"f7e1f7d9-54f1-44de-b231-fb41d2ef95e9\") " pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035127 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035115 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8d841c62-35da-434f-bbbf-5baac81af9ad-host-slash\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035144 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-socket-dir\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035141 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-var-lib-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035192 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-var-lib-openvswitch\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035196 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-node-log\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035223 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysctl-d\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhr6h\" (UniqueName: \"kubernetes.io/projected/ba62bfc3-b408-4a41-92f4-db31ffe596ca-kube-api-access-hhr6h\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035288 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-netns\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035318 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3367c581-2e3c-408e-a4a9-addab880d580-etc-selinux\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-os-release\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035373 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-os-release\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.036915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035423 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysconfig\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysctl-conf\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035455 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7x9n\" (UniqueName: \"kubernetes.io/projected/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-kube-api-access-h7x9n\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035466 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035474 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542953d0-ab33-4cc3-8069-493a8c14d1c1-cni-binary-copy\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035556 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cni-binary-copy\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d841c62-35da-434f-bbbf-5baac81af9ad-iptables-alerter-script\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035614 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs9wg\" (UniqueName: \"kubernetes.io/projected/8d841c62-35da-434f-bbbf-5baac81af9ad-kube-api-access-zs9wg\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/375d8949-979e-4b00-9d5b-b75d6f276596-ovn-node-metrics-cert\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035647 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-host\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035690 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/375d8949-979e-4b00-9d5b-b75d6f276596-node-log\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.035831 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.036337 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/375d8949-979e-4b00-9d5b-b75d6f276596-env-overrides\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.037420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.036438 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8d841c62-35da-434f-bbbf-5baac81af9ad-iptables-alerter-script\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:11.038341 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.038322 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/375d8949-979e-4b00-9d5b-b75d6f276596-ovn-node-metrics-cert\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.038419 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.038410 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7e1f7d9-54f1-44de-b231-fb41d2ef95e9-agent-certs\") pod \"konnectivity-agent-dfhgz\" (UID: \"f7e1f7d9-54f1-44de-b231-fb41d2ef95e9\") " pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:11.048209 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.048187 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 05:43:11.048380 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.048213 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 05:43:11.048380 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.048226 2561 projected.go:196] Error preparing data for projected volume kube-api-access-k2c8h for pod openshift-network-diagnostics/network-check-target-7tpxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:11.048380 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.048308 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h podName:56ff8bc5-1382-49d6-8c80-27b2f5f144f9 nodeName:}" failed. No retries permitted until 2026-08-01 05:43:11.548290657 +0000 UTC m=+1.944474794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k2c8h" (UniqueName: "kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h") pod "network-check-target-7tpxx" (UID: "56ff8bc5-1382-49d6-8c80-27b2f5f144f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:11.049480 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.049455 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq24t\" (UniqueName: \"kubernetes.io/projected/2f0b550e-d2f8-4904-9a2e-bfcb327bc035-kube-api-access-bq24t\") pod \"multus-additional-cni-plugins-gz82h\" (UID: \"2f0b550e-d2f8-4904-9a2e-bfcb327bc035\") " pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.049706 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.049675 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhrs4\" (UniqueName: \"kubernetes.io/projected/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-kube-api-access-xhrs4\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:11.049948 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.049914 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndwvq\" (UniqueName: \"kubernetes.io/projected/375d8949-979e-4b00-9d5b-b75d6f276596-kube-api-access-ndwvq\") pod \"ovnkube-node-7r9lp\" (UID: \"375d8949-979e-4b00-9d5b-b75d6f276596\") " pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.050065 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.050050 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zft6\" (UniqueName: \"kubernetes.io/projected/3367c581-2e3c-408e-a4a9-addab880d580-kube-api-access-7zft6\") pod \"aws-ebs-csi-driver-node-hfwnd\" (UID: \"3367c581-2e3c-408e-a4a9-addab880d580\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.050474 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.050456 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs9wg\" (UniqueName: \"kubernetes.io/projected/8d841c62-35da-434f-bbbf-5baac81af9ad-kube-api-access-zs9wg\") pod \"iptables-alerter-d6pz4\" (UID: \"8d841c62-35da-434f-bbbf-5baac81af9ad\") " pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:11.136554 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-systemd\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.136554 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba62bfc3-b408-4a41-92f4-db31ffe596ca-host\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-socket-dir-parent\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-kubelet\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136625 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-kubernetes\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-lib-modules\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136640 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-systemd\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136643 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ba62bfc3-b408-4a41-92f4-db31ffe596ca-host\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136666 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-kubelet\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136692 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-kubernetes\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136692 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-cni-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-k8s-cni-cncf-io\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.136730 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:11.136738 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136736 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-socket-dir-parent\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136742 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75dwj\" (UniqueName: \"kubernetes.io/projected/542953d0-ab33-4cc3-8069-493a8c14d1c1-kube-api-access-75dwj\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136735 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-lib-modules\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136763 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-k8s-cni-cncf-io\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.136792 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret podName:54bfe892-21bb-4ece-b41c-f7b533281c1a nodeName:}" failed. No retries permitted until 2026-08-01 05:43:11.636769639 +0000 UTC m=+2.032953758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret") pod "global-pull-secret-syncer-wkpzk" (UID: "54bfe892-21bb-4ece-b41c-f7b533281c1a") : object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136801 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-cni-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136814 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-run\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136845 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-tmp\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136867 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-os-release\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136871 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-run\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-daemon-config\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-sys\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136949 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-os-release\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54bfe892-21bb-4ece-b41c-f7b533281c1a-kubelet-config\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136980 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54bfe892-21bb-4ece-b41c-f7b533281c1a-dbus\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.136989 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-sys\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137000 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-hosts-file\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.137348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-modprobe-d\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137047 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/54bfe892-21bb-4ece-b41c-f7b533281c1a-kubelet-config\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137052 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-hosts-file\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-tuned\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137030 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/54bfe892-21bb-4ece-b41c-f7b533281c1a-dbus\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba62bfc3-b408-4a41-92f4-db31ffe596ca-serviceca\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137100 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-cnibin\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137120 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-modprobe-d\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137184 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-cnibin\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n4ll\" (UniqueName: \"kubernetes.io/projected/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-kube-api-access-4n4ll\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-conf-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137308 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysctl-d\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhr6h\" (UniqueName: \"kubernetes.io/projected/ba62bfc3-b408-4a41-92f4-db31ffe596ca-kube-api-access-hhr6h\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-netns\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137385 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysconfig\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysctl-conf\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7x9n\" (UniqueName: \"kubernetes.io/projected/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-kube-api-access-h7x9n\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137467 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542953d0-ab33-4cc3-8069-493a8c14d1c1-cni-binary-copy\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137470 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-daemon-config\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-host\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-system-cni-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-cni-bin\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137558 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-netns\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137558 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ba62bfc3-b408-4a41-92f4-db31ffe596ca-serviceca\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137605 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-multus-conf-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137608 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-cni-bin\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137632 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-host\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-cni-multus\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137668 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-system-cni-dir\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137670 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-var-lib-kubelet\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-hostroot\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137709 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysctl-d\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137716 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysconfig\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137527 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-sysctl-conf\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-multus-certs\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137759 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-var-lib-cni-multus\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.138642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137768 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-tmp-dir\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137772 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-host-run-multus-certs\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137714 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-var-lib-kubelet\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137769 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-hostroot\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137797 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-etc-kubernetes\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.137825 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/542953d0-ab33-4cc3-8069-493a8c14d1c1-etc-kubernetes\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.138043 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-tmp-dir\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.138097 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/542953d0-ab33-4cc3-8069-493a8c14d1c1-cni-binary-copy\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.139091 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-tmp\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.139212 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.139187 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-etc-tuned\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.144963 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.144941 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75dwj\" (UniqueName: \"kubernetes.io/projected/542953d0-ab33-4cc3-8069-493a8c14d1c1-kube-api-access-75dwj\") pod \"multus-k6sxh\" (UID: \"542953d0-ab33-4cc3-8069-493a8c14d1c1\") " pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.145088 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.145069 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n4ll\" (UniqueName: \"kubernetes.io/projected/86badb5c-f1d6-470c-b107-faf3ed3e8c3a-kube-api-access-4n4ll\") pod \"node-resolver-nhvgl\" (UID: \"86badb5c-f1d6-470c-b107-faf3ed3e8c3a\") " pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.145526 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.145509 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhr6h\" (UniqueName: \"kubernetes.io/projected/ba62bfc3-b408-4a41-92f4-db31ffe596ca-kube-api-access-hhr6h\") pod \"node-ca-qkx6h\" (UID: \"ba62bfc3-b408-4a41-92f4-db31ffe596ca\") " pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.145611 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.145527 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7x9n\" (UniqueName: \"kubernetes.io/projected/5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3-kube-api-access-h7x9n\") pod \"tuned-r2c9t\" (UID: \"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3\") " pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.255171 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.255102 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gz82h" Aug 01 05:43:11.270123 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.270094 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-d6pz4" Aug 01 05:43:11.293385 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.293365 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:11.299514 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.299497 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 05:43:11.302065 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.302046 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 01 05:43:11.303708 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:11.303661 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod375d8949_979e_4b00_9d5b_b75d6f276596.slice/crio-86c83e863947c5841226e05ddf21337952bb4901e49d2530f0038a68c7ad3411 WatchSource:0}: Error finding container 86c83e863947c5841226e05ddf21337952bb4901e49d2530f0038a68c7ad3411: Status 404 returned error can't find the container with id 86c83e863947c5841226e05ddf21337952bb4901e49d2530f0038a68c7ad3411 Aug 01 05:43:11.316866 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.316841 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:11.324988 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:11.324966 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e1f7d9_54f1_44de_b231_fb41d2ef95e9.slice/crio-ea284779c9daea221ccbc59230e261edec235f2c28c0f19cc61b7babfaec7781 WatchSource:0}: Error finding container ea284779c9daea221ccbc59230e261edec235f2c28c0f19cc61b7babfaec7781: Status 404 returned error can't find the container with id ea284779c9daea221ccbc59230e261edec235f2c28c0f19cc61b7babfaec7781 Aug 01 05:43:11.335486 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.335469 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" Aug 01 05:43:11.346372 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:11.346349 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3367c581_2e3c_408e_a4a9_addab880d580.slice/crio-98ac776abb39c77af14c880db1b1f1322811ceea8c25c7fe9a7de4b9a65b6b29 WatchSource:0}: Error finding container 98ac776abb39c77af14c880db1b1f1322811ceea8c25c7fe9a7de4b9a65b6b29: Status 404 returned error can't find the container with id 98ac776abb39c77af14c880db1b1f1322811ceea8c25c7fe9a7de4b9a65b6b29 Aug 01 05:43:11.362367 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.362347 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" Aug 01 05:43:11.367990 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.367968 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qkx6h" Aug 01 05:43:11.369894 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:11.369872 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e94d9f2_84d1_43c7_bdc0_35c073c6eaa3.slice/crio-254cc45c6e2dda822d381fe1052a1ebbebd09aa5a66ede4ae84ea4cefacb1f12 WatchSource:0}: Error finding container 254cc45c6e2dda822d381fe1052a1ebbebd09aa5a66ede4ae84ea4cefacb1f12: Status 404 returned error can't find the container with id 254cc45c6e2dda822d381fe1052a1ebbebd09aa5a66ede4ae84ea4cefacb1f12 Aug 01 05:43:11.376164 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:11.376147 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba62bfc3_b408_4a41_92f4_db31ffe596ca.slice/crio-b8decb5460e19ea74ff06942b6f473a3dde9085fb616595202c6eb289498071b WatchSource:0}: Error finding container b8decb5460e19ea74ff06942b6f473a3dde9085fb616595202c6eb289498071b: Status 404 returned error can't find the container with id b8decb5460e19ea74ff06942b6f473a3dde9085fb616595202c6eb289498071b Aug 01 05:43:11.392246 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.392209 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-k6sxh" Aug 01 05:43:11.396958 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.396935 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nhvgl" Aug 01 05:43:11.402942 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:11.402921 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod542953d0_ab33_4cc3_8069_493a8c14d1c1.slice/crio-f3cf56ec6a7262b1a10b2adc102e93a7286f8ebb21b772ebb22e6919e7257940 WatchSource:0}: Error finding container f3cf56ec6a7262b1a10b2adc102e93a7286f8ebb21b772ebb22e6919e7257940: Status 404 returned error can't find the container with id f3cf56ec6a7262b1a10b2adc102e93a7286f8ebb21b772ebb22e6919e7257940 Aug 01 05:43:11.405402 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:11.405380 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86badb5c_f1d6_470c_b107_faf3ed3e8c3a.slice/crio-56e3be270d6fa27a25c2a7b89a0e2eac42618a03da67ef533600518a20376f5a WatchSource:0}: Error finding container 56e3be270d6fa27a25c2a7b89a0e2eac42618a03da67ef533600518a20376f5a: Status 404 returned error can't find the container with id 56e3be270d6fa27a25c2a7b89a0e2eac42618a03da67ef533600518a20376f5a Aug 01 05:43:11.542624 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.542553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:11.542754 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.542684 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:11.542754 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.542738 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs podName:f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f nodeName:}" failed. No retries permitted until 2026-08-01 05:43:12.542722658 +0000 UTC m=+2.938906775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs") pod "network-metrics-daemon-hhc8q" (UID: "f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:11.643417 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.643384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:11.643569 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.643444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:11.643569 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.643468 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:11.643569 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.643518 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret podName:54bfe892-21bb-4ece-b41c-f7b533281c1a nodeName:}" failed. No retries permitted until 2026-08-01 05:43:12.643505108 +0000 UTC m=+3.039689227 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret") pod "global-pull-secret-syncer-wkpzk" (UID: "54bfe892-21bb-4ece-b41c-f7b533281c1a") : object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:11.643569 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.643531 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 05:43:11.643569 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.643542 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 05:43:11.643569 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.643550 2561 projected.go:196] Error preparing data for projected volume kube-api-access-k2c8h for pod openshift-network-diagnostics/network-check-target-7tpxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:11.643833 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:11.643584 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h podName:56ff8bc5-1382-49d6-8c80-27b2f5f144f9 nodeName:}" failed. No retries permitted until 2026-08-01 05:43:12.643573315 +0000 UTC m=+3.039757431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2c8h" (UniqueName: "kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h") pod "network-check-target-7tpxx" (UID: "56ff8bc5-1382-49d6-8c80-27b2f5f144f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:11.938742 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:43:11.938683 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0b550e_d2f8_4904_9a2e_bfcb327bc035.slice/crio-601c32b688599688e9b6b605dbc33ad42620e711fc85668eaecc2061660f1633 WatchSource:0}: Error finding container 601c32b688599688e9b6b605dbc33ad42620e711fc85668eaecc2061660f1633: Status 404 returned error can't find the container with id 601c32b688599688e9b6b605dbc33ad42620e711fc85668eaecc2061660f1633 Aug 01 05:43:11.973980 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.973610 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-31 05:38:10 +0000 UTC" deadline="2028-01-10 22:18:34.162866613 +0000 UTC" Aug 01 05:43:11.973980 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:11.973672 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12664h35m22.189198678s" Aug 01 05:43:12.038769 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.038565 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 05:43:12.098635 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.098115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:12.098635 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.098252 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:12.100995 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.100904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz82h" event={"ID":"2f0b550e-d2f8-4904-9a2e-bfcb327bc035","Type":"ContainerStarted","Data":"601c32b688599688e9b6b605dbc33ad42620e711fc85668eaecc2061660f1633"} Aug 01 05:43:12.102759 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.102703 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nhvgl" event={"ID":"86badb5c-f1d6-470c-b107-faf3ed3e8c3a","Type":"ContainerStarted","Data":"56e3be270d6fa27a25c2a7b89a0e2eac42618a03da67ef533600518a20376f5a"} Aug 01 05:43:12.107050 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.106988 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k6sxh" event={"ID":"542953d0-ab33-4cc3-8069-493a8c14d1c1","Type":"ContainerStarted","Data":"f3cf56ec6a7262b1a10b2adc102e93a7286f8ebb21b772ebb22e6919e7257940"} Aug 01 05:43:12.114804 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.114758 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" event={"ID":"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3","Type":"ContainerStarted","Data":"254cc45c6e2dda822d381fe1052a1ebbebd09aa5a66ede4ae84ea4cefacb1f12"} Aug 01 05:43:12.119162 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.119119 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfhgz" event={"ID":"f7e1f7d9-54f1-44de-b231-fb41d2ef95e9","Type":"ContainerStarted","Data":"ea284779c9daea221ccbc59230e261edec235f2c28c0f19cc61b7babfaec7781"} Aug 01 05:43:12.123175 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.123067 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"86c83e863947c5841226e05ddf21337952bb4901e49d2530f0038a68c7ad3411"} Aug 01 05:43:12.139646 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.138648 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" event={"ID":"b41a42c4a640d469582886dee01f9988","Type":"ContainerStarted","Data":"96e9dbd9827cf0735089d94581f3bbb19b968eb144f7f26d66dde44a1547b1f3"} Aug 01 05:43:12.154914 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.154875 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" event={"ID":"fa6b1e7070ed1e0850ff0177f7a68881","Type":"ContainerStarted","Data":"181e458faf7a4a87ae538445e92486bd490795b0af5cf0a0a751e1440aac7ee8"} Aug 01 05:43:12.167165 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.167130 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qkx6h" event={"ID":"ba62bfc3-b408-4a41-92f4-db31ffe596ca","Type":"ContainerStarted","Data":"b8decb5460e19ea74ff06942b6f473a3dde9085fb616595202c6eb289498071b"} Aug 01 05:43:12.180745 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.180651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" event={"ID":"3367c581-2e3c-408e-a4a9-addab880d580","Type":"ContainerStarted","Data":"98ac776abb39c77af14c880db1b1f1322811ceea8c25c7fe9a7de4b9a65b6b29"} Aug 01 05:43:12.194955 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.194890 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d6pz4" event={"ID":"8d841c62-35da-434f-bbbf-5baac81af9ad","Type":"ContainerStarted","Data":"0b307e87f9dced8cbac6630538b1d4605e4bb746ac32263842a271d233ee6b0c"} Aug 01 05:43:12.550045 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.549454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:12.550045 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.549600 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:12.550045 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.549668 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs podName:f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f nodeName:}" failed. No retries permitted until 2026-08-01 05:43:14.549650217 +0000 UTC m=+4.945834339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs") pod "network-metrics-daemon-hhc8q" (UID: "f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:12.650708 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.650671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:12.650865 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.650755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:12.650940 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.650878 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:12.650996 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.650940 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret podName:54bfe892-21bb-4ece-b41c-f7b533281c1a nodeName:}" failed. No retries permitted until 2026-08-01 05:43:14.650921155 +0000 UTC m=+5.047105285 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret") pod "global-pull-secret-syncer-wkpzk" (UID: "54bfe892-21bb-4ece-b41c-f7b533281c1a") : object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:12.654723 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.651410 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 05:43:12.654723 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.651433 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 05:43:12.654723 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.651446 2561 projected.go:196] Error preparing data for projected volume kube-api-access-k2c8h for pod openshift-network-diagnostics/network-check-target-7tpxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:12.654723 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:12.651491 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h podName:56ff8bc5-1382-49d6-8c80-27b2f5f144f9 nodeName:}" failed. No retries permitted until 2026-08-01 05:43:14.651475343 +0000 UTC m=+5.047659471 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2c8h" (UniqueName: "kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h") pod "network-check-target-7tpxx" (UID: "56ff8bc5-1382-49d6-8c80-27b2f5f144f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:12.974368 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.974324 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-31 05:38:10 +0000 UTC" deadline="2028-05-11 10:36:28.367722474 +0000 UTC" Aug 01 05:43:12.974368 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:12.974366 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15580h53m15.393361357s" Aug 01 05:43:13.088246 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:13.087750 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:13.088246 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:13.087889 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:13.088246 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:13.087934 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:13.088246 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:13.088060 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:13.810842 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:13.810811 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Aug 01 05:43:14.087398 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:14.087314 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:14.089949 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.089917 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:14.567340 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:14.566741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:14.567340 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.566936 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:14.567340 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.566995 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs podName:f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f nodeName:}" failed. No retries permitted until 2026-08-01 05:43:18.566977095 +0000 UTC m=+8.963161235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs") pod "network-metrics-daemon-hhc8q" (UID: "f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:14.667785 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:14.667203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:14.667785 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:14.667270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:14.667785 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.667403 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:14.667785 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.667458 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret podName:54bfe892-21bb-4ece-b41c-f7b533281c1a nodeName:}" failed. No retries permitted until 2026-08-01 05:43:18.667440892 +0000 UTC m=+9.063625015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret") pod "global-pull-secret-syncer-wkpzk" (UID: "54bfe892-21bb-4ece-b41c-f7b533281c1a") : object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:14.667785 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.667629 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 05:43:14.667785 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.667653 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 05:43:14.667785 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.667666 2561 projected.go:196] Error preparing data for projected volume kube-api-access-k2c8h for pod openshift-network-diagnostics/network-check-target-7tpxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:14.667785 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:14.667734 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h podName:56ff8bc5-1382-49d6-8c80-27b2f5f144f9 nodeName:}" failed. No retries permitted until 2026-08-01 05:43:18.667717013 +0000 UTC m=+9.063901149 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2c8h" (UniqueName: "kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h") pod "network-check-target-7tpxx" (UID: "56ff8bc5-1382-49d6-8c80-27b2f5f144f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:15.087329 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:15.087203 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:15.087478 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:15.087356 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:15.087823 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:15.087739 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:15.087881 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:15.087856 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:16.089214 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:16.089179 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:16.089666 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:16.089332 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:17.087929 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:17.087893 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:17.088102 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:17.087939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:17.088102 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:17.088030 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:17.088419 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:17.088390 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:18.087194 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:18.087154 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:18.087563 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.087294 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:18.603645 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:18.603607 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:18.603819 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.603750 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:18.603819 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.603817 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs podName:f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f nodeName:}" failed. No retries permitted until 2026-08-01 05:43:26.603798441 +0000 UTC m=+16.999982565 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs") pod "network-metrics-daemon-hhc8q" (UID: "f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:18.704676 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:18.704633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:18.704853 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:18.704702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:18.704853 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.704845 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:18.704935 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.704863 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 05:43:18.704935 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.704882 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 05:43:18.704935 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.704893 2561 projected.go:196] Error preparing data for projected volume kube-api-access-k2c8h for pod openshift-network-diagnostics/network-check-target-7tpxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:18.704935 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.704909 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret podName:54bfe892-21bb-4ece-b41c-f7b533281c1a nodeName:}" failed. No retries permitted until 2026-08-01 05:43:26.7048909 +0000 UTC m=+17.101075038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret") pod "global-pull-secret-syncer-wkpzk" (UID: "54bfe892-21bb-4ece-b41c-f7b533281c1a") : object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:18.704935 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:18.704926 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h podName:56ff8bc5-1382-49d6-8c80-27b2f5f144f9 nodeName:}" failed. No retries permitted until 2026-08-01 05:43:26.704916747 +0000 UTC m=+17.101100886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2c8h" (UniqueName: "kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h") pod "network-check-target-7tpxx" (UID: "56ff8bc5-1382-49d6-8c80-27b2f5f144f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:19.087374 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:19.087341 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:19.087827 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:19.087388 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:19.087827 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:19.087471 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:19.087937 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:19.087902 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:20.088575 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:20.088537 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:20.089036 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:20.088684 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:21.087900 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:21.087814 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:21.087900 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:21.087850 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:21.088107 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:21.087930 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:21.088107 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:21.088019 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:22.087759 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:22.087721 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:22.088173 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:22.087866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:23.087648 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:23.087571 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:23.087811 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:23.087699 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:23.087811 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:23.087750 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:23.088182 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:23.087882 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:24.087306 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:24.087270 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:24.087469 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:24.087418 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:25.087174 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:25.087143 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:25.087174 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:25.087153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:25.087681 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:25.087277 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:25.087681 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:25.087436 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:26.087904 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:26.087871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:26.088308 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.088005 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:26.668028 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:26.667993 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:26.668191 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.668143 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:26.668257 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.668203 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs podName:f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f nodeName:}" failed. No retries permitted until 2026-08-01 05:43:42.668187557 +0000 UTC m=+33.064371675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs") pod "network-metrics-daemon-hhc8q" (UID: "f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:26.768540 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:26.768504 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:26.768713 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:26.768558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:26.768713 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.768667 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:26.768713 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.768695 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 05:43:26.768848 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.768724 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 05:43:26.768848 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.768729 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret podName:54bfe892-21bb-4ece-b41c-f7b533281c1a nodeName:}" failed. No retries permitted until 2026-08-01 05:43:42.768713738 +0000 UTC m=+33.164897864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret") pod "global-pull-secret-syncer-wkpzk" (UID: "54bfe892-21bb-4ece-b41c-f7b533281c1a") : object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:26.768848 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.768737 2561 projected.go:196] Error preparing data for projected volume kube-api-access-k2c8h for pod openshift-network-diagnostics/network-check-target-7tpxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:26.768848 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:26.768791 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h podName:56ff8bc5-1382-49d6-8c80-27b2f5f144f9 nodeName:}" failed. No retries permitted until 2026-08-01 05:43:42.76877547 +0000 UTC m=+33.164959606 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2c8h" (UniqueName: "kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h") pod "network-check-target-7tpxx" (UID: "56ff8bc5-1382-49d6-8c80-27b2f5f144f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:27.087938 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:27.087906 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:27.088415 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:27.087905 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:27.088415 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:27.088050 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:27.088415 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:27.088085 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:28.087506 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:28.087467 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:28.087688 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:28.087611 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:29.087863 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:29.087830 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:29.087863 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:29.087854 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:29.088331 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:29.087935 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:29.088331 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:29.088084 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:30.088985 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:30.088947 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:30.089406 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:30.089065 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:31.087272 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.087107 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:31.087370 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.087180 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:31.087410 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:31.087363 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:31.087507 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:31.087486 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:31.262156 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.261770 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-k6sxh" event={"ID":"542953d0-ab33-4cc3-8069-493a8c14d1c1","Type":"ContainerStarted","Data":"207b8ab0b691fd25df1e57d1413c6b6ccdb3ed81218c61f2c9d1c40503f83f71"} Aug 01 05:43:31.276493 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.276451 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" event={"ID":"5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3","Type":"ContainerStarted","Data":"ba5be5b7e786f100e63c21fd7981b8ef244cad8598aed55cf65771a14a6d3fe1"} Aug 01 05:43:31.283320 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.280911 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-k6sxh" podStartSLOduration=1.529715474 podStartE2EDuration="21.280890864s" totalImagesPullingTime="19.75117539s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:31.279302685 +0000 UTC m=+21.675486824" watchObservedRunningTime="2026-08-01 05:43:31.280890864 +0000 UTC m=+21.677075004" Aug 01 05:43:31.290912 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.290876 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"00a9df70836e54cdf2464a91c0a71c90ecf3d8ac2cbcb84402514fc946495b7b"} Aug 01 05:43:31.291019 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.291004 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"017b9eab9f5794f47cf9256338678ea6c669b5d3cec0983b6c6c75c3591e3224"} Aug 01 05:43:31.295746 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.295658 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r2c9t" podStartSLOduration=1.776895923 podStartE2EDuration="21.295638571s" totalImagesPullingTime="19.518742648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:31.294806352 +0000 UTC m=+21.690990493" watchObservedRunningTime="2026-08-01 05:43:31.295638571 +0000 UTC m=+21.691822712" Aug 01 05:43:31.297499 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.297469 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" event={"ID":"b41a42c4a640d469582886dee01f9988","Type":"ContainerStarted","Data":"f91a69bb1b83d95bce598ada5add08cf9643008179fc75b98da9f370808698da"} Aug 01 05:43:31.313870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:31.313668 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-6.ec2.internal" podStartSLOduration=21.313647902 podStartE2EDuration="21.313647902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:31.313420186 +0000 UTC m=+21.709604326" watchObservedRunningTime="2026-08-01 05:43:31.313647902 +0000 UTC m=+21.709832042" Aug 01 05:43:32.087725 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.087645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:32.087864 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:32.087818 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:32.301028 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.300992 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dfhgz" event={"ID":"f7e1f7d9-54f1-44de-b231-fb41d2ef95e9","Type":"ContainerStarted","Data":"fc7ac3934866c6ab733362ebd6374549b9e4ff4331e0aa71fc480ac3806de639"} Aug 01 05:43:32.304599 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.304568 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"9d62bf377b3585e2e3b8be8fb934976aae6977866c602c9b11df2c67a3537c3b"} Aug 01 05:43:32.304755 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.304656 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"b4fb9b9cb26d50a0143f05d0b74a82be7d8709612da0d46997ba165cb902fd33"} Aug 01 05:43:32.304755 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.304706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"063b5ce0b556702dea101b2bfc117e83c8406532a9500e5a171b45feeda2417d"} Aug 01 05:43:32.304755 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.304750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"80bc6fb06c58ba2dc083cf619a266cfe26ab09059f355ee1743e0031f800d084"} Aug 01 05:43:32.306370 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.306347 2561 generic.go:356] "Generic (PLEG): container finished" podID="fa6b1e7070ed1e0850ff0177f7a68881" containerID="0bf08852fb65e9519b40f8f67f686b01ca8331e5ca989d3c02b867ef7e00cec7" exitCode=0 Aug 01 05:43:32.306478 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.306438 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" event={"ID":"fa6b1e7070ed1e0850ff0177f7a68881","Type":"ContainerDied","Data":"0bf08852fb65e9519b40f8f67f686b01ca8331e5ca989d3c02b867ef7e00cec7"} Aug 01 05:43:32.307986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.307962 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qkx6h" event={"ID":"ba62bfc3-b408-4a41-92f4-db31ffe596ca","Type":"ContainerStarted","Data":"492344d1cc54aceb4d1c5ecfce80b7384b646bef694cfbef6b7ca493a4938ad1"} Aug 01 05:43:32.309524 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.309501 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" event={"ID":"3367c581-2e3c-408e-a4a9-addab880d580","Type":"ContainerStarted","Data":"0014bb5fc6dcef2f8741ab54d1482169d85ea23579392cfbc95b5edf00dcfd77"} Aug 01 05:43:32.310983 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.310964 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-d6pz4" event={"ID":"8d841c62-35da-434f-bbbf-5baac81af9ad","Type":"ContainerStarted","Data":"eecaad9d0832d3127d27fc3c317a4ed439ea954dbf26ffc0c3d64012ba3ef480"} Aug 01 05:43:32.312533 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.312506 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f0b550e-d2f8-4904-9a2e-bfcb327bc035" containerID="12cdaad8dd32cdcfadc0db85c2752434e2c2dd581fd68457d12b22fbda773a04" exitCode=0 Aug 01 05:43:32.312635 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.312585 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz82h" event={"ID":"2f0b550e-d2f8-4904-9a2e-bfcb327bc035","Type":"ContainerDied","Data":"12cdaad8dd32cdcfadc0db85c2752434e2c2dd581fd68457d12b22fbda773a04"} Aug 01 05:43:32.314415 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.314375 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dfhgz" podStartSLOduration=2.7841347880000002 podStartE2EDuration="22.314359806s" totalImagesPullingTime="19.530225018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:32.314107299 +0000 UTC m=+22.710291439" watchObservedRunningTime="2026-08-01 05:43:32.314359806 +0000 UTC m=+22.710543937" Aug 01 05:43:32.314609 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.314579 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nhvgl" event={"ID":"86badb5c-f1d6-470c-b107-faf3ed3e8c3a","Type":"ContainerStarted","Data":"fd820f9daef084af743635db9c8ab0579997bb9147548ea1733f42477cf024a2"} Aug 01 05:43:32.327010 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.326963 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-d6pz4" podStartSLOduration=2.741740267 podStartE2EDuration="22.326951811s" totalImagesPullingTime="19.585211544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:32.326371355 +0000 UTC m=+22.722555495" watchObservedRunningTime="2026-08-01 05:43:32.326951811 +0000 UTC m=+22.723135950" Aug 01 05:43:32.371173 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.371095 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qkx6h" podStartSLOduration=2.891667501 podStartE2EDuration="22.37108083s" totalImagesPullingTime="19.479413329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:32.357913768 +0000 UTC m=+22.754097906" watchObservedRunningTime="2026-08-01 05:43:32.37108083 +0000 UTC m=+22.767264966" Aug 01 05:43:32.384883 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.384840 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nhvgl" podStartSLOduration=2.9344882119999998 podStartE2EDuration="22.384825969s" totalImagesPullingTime="19.450337757s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:32.384800244 +0000 UTC m=+22.780984384" watchObservedRunningTime="2026-08-01 05:43:32.384825969 +0000 UTC m=+22.781010106" Aug 01 05:43:32.436775 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.436612 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:32.558954 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.558891 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:32.658351 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.658321 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:32.759790 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.759758 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:32.791020 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.791001 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Aug 01 05:43:32.860520 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:32.860485 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:33.001402 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.001266 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-01T05:43:32.791016238Z","UUID":"89f80e0b-f211-44f6-9ffa-10bbe2379207","Handler":null,"Name":"","Endpoint":""} Aug 01 05:43:33.002595 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.002579 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Aug 01 05:43:33.002676 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.002612 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Aug 01 05:43:33.087845 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.087809 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:33.088015 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.087853 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:33.088015 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:33.087940 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:33.088119 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:33.088036 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:33.318227 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.318155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" event={"ID":"fa6b1e7070ed1e0850ff0177f7a68881","Type":"ContainerStarted","Data":"631cd92f0e58a74d97fa04e28776bc94cc6ce2b958a775ac52120674daca49c1"} Aug 01 05:43:33.323396 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.323367 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" event={"ID":"3367c581-2e3c-408e-a4a9-addab880d580","Type":"ContainerStarted","Data":"0d2749b7aa7228300b45e87774cb87cca1bb15598df329d925bb04791db48722"} Aug 01 05:43:33.333891 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.333825 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-6.ec2.internal" podStartSLOduration=23.333810862 podStartE2EDuration="23.333810862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:33.333494708 +0000 UTC m=+23.729678849" watchObservedRunningTime="2026-08-01 05:43:33.333810862 +0000 UTC m=+23.729995000" Aug 01 05:43:33.606692 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.606597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:33.651999 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:33.651957 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:34.087928 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:34.087889 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:34.088141 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:34.088028 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:34.329902 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:34.329869 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"ef74cc386f72d183da33e50c4940e40974034b363c6eef03ff59fc24a2b86936"} Aug 01 05:43:34.799634 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:34.799598 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:34.899601 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:34.899565 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:35.087632 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:35.087562 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:35.087632 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:35.087596 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:35.087826 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:35.087681 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:35.087878 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:35.087827 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:35.334281 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:35.334228 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" event={"ID":"3367c581-2e3c-408e-a4a9-addab880d580","Type":"ContainerStarted","Data":"04a21d9b8985fa005792e1957d2362db3df4e1decc23deeb96a2e0bf72dff3a6"} Aug 01 05:43:35.350831 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:35.350741 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hfwnd" podStartSLOduration=3.138128677 podStartE2EDuration="25.350722046s" totalImagesPullingTime="22.212593369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:35.350408761 +0000 UTC m=+25.746592904" watchObservedRunningTime="2026-08-01 05:43:35.350722046 +0000 UTC m=+25.746906231" Aug 01 05:43:36.087590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:36.087556 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:36.087774 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:36.087696 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:36.144308 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:36.144274 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:36.144858 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:36.144838 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:36.336609 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:36.336527 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:36.337042 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:36.336928 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dfhgz" Aug 01 05:43:36.391807 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:36.391777 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:36.706252 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:36.706064 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:36.806293 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:36.806265 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:37.087457 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.087429 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:37.087554 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.087429 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:37.087602 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:37.087582 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:37.087649 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:37.087626 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:37.143045 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.142990 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:37.199961 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.199941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:37.281427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.281401 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:37.341447 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.341412 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" event={"ID":"375d8949-979e-4b00-9d5b-b75d6f276596","Type":"ContainerStarted","Data":"e66fece337d98e42535a35093ca4042920f07af5aef55105f33ce659c55dd6a3"} Aug 01 05:43:37.342115 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.341694 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:37.343638 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.343616 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f0b550e-d2f8-4904-9a2e-bfcb327bc035" containerID="4bba3fe0e2d6e99f751198d1d5102c5d937ee91868e501146c00676f7ab23021" exitCode=0 Aug 01 05:43:37.343760 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.343678 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz82h" event={"ID":"2f0b550e-d2f8-4904-9a2e-bfcb327bc035","Type":"ContainerDied","Data":"4bba3fe0e2d6e99f751198d1d5102c5d937ee91868e501146c00676f7ab23021"} Aug 01 05:43:37.357922 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.357898 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:37.368653 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.368617 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" podStartSLOduration=7.745552609 podStartE2EDuration="27.368605238s" totalImagesPullingTime="19.623052629s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:37.368311208 +0000 UTC m=+27.764495347" watchObservedRunningTime="2026-08-01 05:43:37.368605238 +0000 UTC m=+27.764789376" Aug 01 05:43:37.371469 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.371450 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:37.454154 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.454127 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:37.718381 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.718302 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:37.766062 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.766033 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:37.990063 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:37.989755 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:38.039917 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.039888 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:38.088127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.088101 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:38.088328 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:38.088199 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:38.314577 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.314355 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:38.346597 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.346577 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:38.347000 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.346655 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:38.362384 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.362360 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:43:38.394822 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.394742 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:38.688868 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.688839 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hhc8q"] Aug 01 05:43:38.689033 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.689004 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:38.689115 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:38.689095 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:38.691707 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.691683 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wkpzk"] Aug 01 05:43:38.691845 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.691789 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:38.691909 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:38.691885 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:38.692301 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.692281 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tpxx"] Aug 01 05:43:38.692385 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:38.692360 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:38.692449 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:38.692431 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:39.047737 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:39.047654 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:39.099437 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:39.099410 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:39.350706 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:39.350617 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f0b550e-d2f8-4904-9a2e-bfcb327bc035" containerID="e482b4489f750e6cdeccb741e5c5365e17fa700cda7c52bb5ff44c4fc905ce40" exitCode=0 Aug 01 05:43:39.350706 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:39.350697 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz82h" event={"ID":"2f0b550e-d2f8-4904-9a2e-bfcb327bc035","Type":"ContainerDied","Data":"e482b4489f750e6cdeccb741e5c5365e17fa700cda7c52bb5ff44c4fc905ce40"} Aug 01 05:43:39.888312 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:39.888279 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:40.088735 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:40.088707 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:40.088869 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:40.088822 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:40.088869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:40.088861 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:40.088985 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:40.088952 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:40.358418 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:40.358384 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f0b550e-d2f8-4904-9a2e-bfcb327bc035" containerID="cc6c21b8caeb06c4023dc276526a1b22110d1d8c0b97b4fb9e908f8236cfbaa6" exitCode=0 Aug 01 05:43:40.358808 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:40.358662 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz82h" event={"ID":"2f0b550e-d2f8-4904-9a2e-bfcb327bc035","Type":"ContainerDied","Data":"cc6c21b8caeb06c4023dc276526a1b22110d1d8c0b97b4fb9e908f8236cfbaa6"} Aug 01 05:43:41.087672 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:41.087590 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:41.087818 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:41.087712 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:41.419488 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:41.419449 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:41.562490 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:41.562443 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:41.665228 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:41.665195 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:41.763202 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:41.763122 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:42.087467 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:42.087393 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:42.087630 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.087535 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:42.087630 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:42.087594 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:42.087725 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.087685 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:42.320286 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:42.320248 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:42.449324 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:42.449271 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:42.691211 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:42.691175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:42.691405 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.691362 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:42.691461 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.691435 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs podName:f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f nodeName:}" failed. No retries permitted until 2026-08-01 05:44:14.691415297 +0000 UTC m=+65.087599428 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs") pod "network-metrics-daemon-hhc8q" (UID: "f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f") : object "openshift-multus"/"metrics-daemon-secret" not registered Aug 01 05:43:42.721636 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:42.721552 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:42.792213 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:42.792179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:42.792441 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:42.792277 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:42.792441 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.792360 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:42.792441 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.792381 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Aug 01 05:43:42.792441 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.792395 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Aug 01 05:43:42.792441 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.792404 2561 projected.go:196] Error preparing data for projected volume kube-api-access-k2c8h for pod openshift-network-diagnostics/network-check-target-7tpxx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:42.792710 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.792438 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret podName:54bfe892-21bb-4ece-b41c-f7b533281c1a nodeName:}" failed. No retries permitted until 2026-08-01 05:44:14.79241812 +0000 UTC m=+65.188602244 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret") pod "global-pull-secret-syncer-wkpzk" (UID: "54bfe892-21bb-4ece-b41c-f7b533281c1a") : object "kube-system"/"original-pull-secret" not registered Aug 01 05:43:42.792710 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:42.792466 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h podName:56ff8bc5-1382-49d6-8c80-27b2f5f144f9 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:14.792457808 +0000 UTC m=+65.188641926 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k2c8h" (UniqueName: "kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h") pod "network-check-target-7tpxx" (UID: "56ff8bc5-1382-49d6-8c80-27b2f5f144f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Aug 01 05:43:43.087762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:43.087685 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:43.087937 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:43.087799 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:43.127523 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:43.127487 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:43.718607 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:43.718572 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:44.087550 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:44.087473 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:44.087715 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:44.087608 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:44.087715 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:44.087649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:44.087826 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:44.087748 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:44.136639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:44.136593 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:44.319700 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:44.319673 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:44.523019 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:44.522971 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:44.623285 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:44.623251 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:44.674090 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:44.674054 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:44.920952 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:44.920924 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:45.087347 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:45.087323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:45.087465 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:45.087423 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:45.121084 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:45.121058 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:45.219364 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:45.219340 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:45.372182 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:45.372150 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f0b550e-d2f8-4904-9a2e-bfcb327bc035" containerID="e61918813c53e47089f94310b8266ea128f0cac95c9fee04cd6a158a2de8cd1b" exitCode=0 Aug 01 05:43:45.372345 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:45.372208 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz82h" event={"ID":"2f0b550e-d2f8-4904-9a2e-bfcb327bc035","Type":"ContainerDied","Data":"e61918813c53e47089f94310b8266ea128f0cac95c9fee04cd6a158a2de8cd1b"} Aug 01 05:43:45.517533 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:45.517509 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:45.722890 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:45.722812 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:45.780699 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:45.780665 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:46.087205 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:46.087122 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:46.087641 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:46.087272 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:46.087641 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:46.087315 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:46.087641 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:46.087408 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:46.116155 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:46.116125 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:46.162825 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:46.162795 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:46.377666 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:46.377597 2561 generic.go:356] "Generic (PLEG): container finished" podID="2f0b550e-d2f8-4904-9a2e-bfcb327bc035" containerID="064c990227dde03e8224357ae3b75961969f4c5a81bea2acf48ca4eb88c8fbe6" exitCode=0 Aug 01 05:43:46.377666 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:46.377662 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz82h" event={"ID":"2f0b550e-d2f8-4904-9a2e-bfcb327bc035","Type":"ContainerDied","Data":"064c990227dde03e8224357ae3b75961969f4c5a81bea2acf48ca4eb88c8fbe6"} Aug 01 05:43:46.522477 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:46.522445 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:46.716172 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:46.716144 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:47.087892 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:47.087813 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:47.088391 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:47.087921 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:47.321144 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:47.321113 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:47.382789 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:47.382719 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gz82h" event={"ID":"2f0b550e-d2f8-4904-9a2e-bfcb327bc035","Type":"ContainerStarted","Data":"95047e8e9ebf78fa4e9c88f54be71bd514aafd6dc9600205d35a4d2d329ba759"} Aug 01 05:43:47.405155 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:47.405112 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gz82h" podStartSLOduration=7.824322754 podStartE2EDuration="37.405098643s" totalImagesPullingTime="29.580775889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:43:47.404423186 +0000 UTC m=+37.800607325" watchObservedRunningTime="2026-08-01 05:43:47.405098643 +0000 UTC m=+37.801282774" Aug 01 05:43:47.718470 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:47.718429 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:48.087655 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:48.087579 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:48.087813 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:48.087706 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:48.087813 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:48.087766 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:48.087912 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:48.087869 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:48.118460 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:48.118429 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:48.522605 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:48.522567 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:48.702590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:48.702557 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:48.919630 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:48.919602 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:49.087821 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:49.087787 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:49.088004 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:49.087974 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:49.120460 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:49.120407 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:49.221940 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:49.221868 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:49.520604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:49.520519 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:50.087856 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:50.087827 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:50.088011 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:50.087909 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:50.088011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:50.087966 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:50.088339 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:50.088046 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:50.118804 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:50.118775 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:50.517478 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:50.517447 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:50.930121 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:50.930089 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:51.087791 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:51.087764 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:51.087943 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:51.087874 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:51.317909 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:51.317800 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:51.517902 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:51.517872 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:51.717774 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:51.717738 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:43:52.088108 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:52.088033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:52.088286 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:52.088156 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:52.088286 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:52.088228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:52.088411 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:52.088329 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:53.088024 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:53.087995 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:53.088408 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:53.088092 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:54.087386 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:54.087353 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:54.087611 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:54.087475 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:54.087611 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:54.087527 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:54.087685 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:54.087613 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:55.087180 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:55.087149 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:55.087570 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:55.087260 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:56.088093 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:56.088057 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:56.088538 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:56.088062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:56.088538 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:56.088168 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:56.088538 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:56.088307 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:57.087969 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:57.087939 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:57.088149 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:57.088056 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:43:58.087198 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:58.087166 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:43:58.087371 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:58.087299 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:43:58.087371 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:58.087357 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:43:58.087460 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:58.087442 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:43:59.087111 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:43:59.087082 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:43:59.087509 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:43:59.087177 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:44:00.087984 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:00.087948 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:44:00.088416 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:00.088057 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hhc8q" podUID="f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f" Aug 01 05:44:00.088416 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:00.088130 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:44:00.088416 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:00.088257 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7tpxx" podUID="56ff8bc5-1382-49d6-8c80-27b2f5f144f9" Aug 01 05:44:01.087604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.087570 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:44:01.087773 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:01.087676 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkpzk" podUID="54bfe892-21bb-4ece-b41c-f7b533281c1a" Aug 01 05:44:01.336664 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.336631 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:01.478095 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.478062 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:01.565799 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.565764 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:01.691739 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.691713 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:01.747324 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.747251 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:01.912167 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.912139 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-6.ec2.internal" event="NodeReady" Aug 01 05:44:01.912336 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.912294 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Aug 01 05:44:01.955344 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.955318 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-njf2l"] Aug 01 05:44:01.976083 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.976055 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7wkjl"] Aug 01 05:44:01.976207 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.976174 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:01.978894 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.978874 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hnlzk\"" Aug 01 05:44:01.979020 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.978875 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Aug 01 05:44:01.979020 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.978928 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Aug 01 05:44:01.994093 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.994070 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njf2l"] Aug 01 05:44:01.994206 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.994104 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7wkjl"] Aug 01 05:44:01.994206 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.994195 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7wkjl" Aug 01 05:44:01.996802 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.996782 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Aug 01 05:44:01.996914 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.996818 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Aug 01 05:44:01.997059 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.997043 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Aug 01 05:44:01.997123 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:01.997078 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ht78s\"" Aug 01 05:44:02.037021 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.036999 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-config-volume\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.037120 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.037025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-metrics-tls\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.037120 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.037043 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxl8h\" (UniqueName: \"kubernetes.io/projected/43301bca-3de0-4e68-9cf7-744f6f259b31-kube-api-access-fxl8h\") pod \"ingress-canary-7wkjl\" (UID: \"43301bca-3de0-4e68-9cf7-744f6f259b31\") " pod="openshift-ingress-canary/ingress-canary-7wkjl" Aug 01 05:44:02.037120 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.037113 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-tmp-dir\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.037222 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.037167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43301bca-3de0-4e68-9cf7-744f6f259b31-cert\") pod \"ingress-canary-7wkjl\" (UID: \"43301bca-3de0-4e68-9cf7-744f6f259b31\") " pod="openshift-ingress-canary/ingress-canary-7wkjl" Aug 01 05:44:02.037222 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.037210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krrxb\" (UniqueName: \"kubernetes.io/projected/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-kube-api-access-krrxb\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.065719 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.065691 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:02.087686 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.087665 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:44:02.087745 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.087699 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:44:02.090459 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.090439 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kdw7g\"" Aug 01 05:44:02.090580 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.090471 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 01 05:44:02.090580 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.090534 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2prdk\"" Aug 01 05:44:02.090735 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.090695 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 01 05:44:02.090812 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.090747 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 01 05:44:02.138451 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.138429 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krrxb\" (UniqueName: \"kubernetes.io/projected/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-kube-api-access-krrxb\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.138561 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.138460 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-config-volume\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.138561 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.138478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-metrics-tls\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.138561 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.138503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxl8h\" (UniqueName: \"kubernetes.io/projected/43301bca-3de0-4e68-9cf7-744f6f259b31-kube-api-access-fxl8h\") pod \"ingress-canary-7wkjl\" (UID: \"43301bca-3de0-4e68-9cf7-744f6f259b31\") " pod="openshift-ingress-canary/ingress-canary-7wkjl" Aug 01 05:44:02.138561 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.138543 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-tmp-dir\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.138762 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.138595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43301bca-3de0-4e68-9cf7-744f6f259b31-cert\") pod \"ingress-canary-7wkjl\" (UID: \"43301bca-3de0-4e68-9cf7-744f6f259b31\") " pod="openshift-ingress-canary/ingress-canary-7wkjl" Aug 01 05:44:02.139499 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.139480 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-tmp-dir\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.139587 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.139552 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-config-volume\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.142605 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.142586 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-metrics-tls\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.142755 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.142739 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43301bca-3de0-4e68-9cf7-744f6f259b31-cert\") pod \"ingress-canary-7wkjl\" (UID: \"43301bca-3de0-4e68-9cf7-744f6f259b31\") " pod="openshift-ingress-canary/ingress-canary-7wkjl" Aug 01 05:44:02.145808 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.145789 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxl8h\" (UniqueName: \"kubernetes.io/projected/43301bca-3de0-4e68-9cf7-744f6f259b31-kube-api-access-fxl8h\") pod \"ingress-canary-7wkjl\" (UID: \"43301bca-3de0-4e68-9cf7-744f6f259b31\") " pod="openshift-ingress-canary/ingress-canary-7wkjl" Aug 01 05:44:02.145879 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.145791 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krrxb\" (UniqueName: \"kubernetes.io/projected/b83e34bb-eea0-4cc2-9d58-e8de3c99080d-kube-api-access-krrxb\") pod \"dns-default-njf2l\" (UID: \"b83e34bb-eea0-4cc2-9d58-e8de3c99080d\") " pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.165842 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.165811 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:02.285249 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.285160 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:02.302559 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.302533 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7wkjl" Aug 01 05:44:02.445268 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.445223 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-njf2l"] Aug 01 05:44:02.448915 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:44:02.448884 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83e34bb_eea0_4cc2_9d58_e8de3c99080d.slice/crio-99aaab0b57f337b9c13cb7e78681a983b859f7b0dbab0d62a68848201e8ed7c6 WatchSource:0}: Error finding container 99aaab0b57f337b9c13cb7e78681a983b859f7b0dbab0d62a68848201e8ed7c6: Status 404 returned error can't find the container with id 99aaab0b57f337b9c13cb7e78681a983b859f7b0dbab0d62a68848201e8ed7c6 Aug 01 05:44:02.460102 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.460082 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7wkjl"] Aug 01 05:44:02.463656 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:44:02.463624 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43301bca_3de0_4e68_9cf7_744f6f259b31.slice/crio-18ba41f67ab92bbfb0f59146b74167d073868b1b72ecabadb407a3a0df9f7362 WatchSource:0}: Error finding container 18ba41f67ab92bbfb0f59146b74167d073868b1b72ecabadb407a3a0df9f7362: Status 404 returned error can't find the container with id 18ba41f67ab92bbfb0f59146b74167d073868b1b72ecabadb407a3a0df9f7362 Aug 01 05:44:02.644427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.644401 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:02.743824 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:02.743789 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:03.087957 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:03.087867 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:44:03.090566 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:03.090539 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 01 05:44:03.418039 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:03.418002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7wkjl" event={"ID":"43301bca-3de0-4e68-9cf7-744f6f259b31","Type":"ContainerStarted","Data":"18ba41f67ab92bbfb0f59146b74167d073868b1b72ecabadb407a3a0df9f7362"} Aug 01 05:44:03.419349 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:03.419322 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njf2l" event={"ID":"b83e34bb-eea0-4cc2-9d58-e8de3c99080d","Type":"ContainerStarted","Data":"99aaab0b57f337b9c13cb7e78681a983b859f7b0dbab0d62a68848201e8ed7c6"} Aug 01 05:44:04.423867 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:04.423825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njf2l" event={"ID":"b83e34bb-eea0-4cc2-9d58-e8de3c99080d","Type":"ContainerStarted","Data":"da00cbb7ec3dee858fb1faba7723eb7b8cf9055b5344770447f8264a5baa3057"} Aug 01 05:44:04.424332 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:04.423889 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-njf2l" event={"ID":"b83e34bb-eea0-4cc2-9d58-e8de3c99080d","Type":"ContainerStarted","Data":"6b73d3971c4c24f9fa4d5a22b36346c60e88453d39f3536f1b6ae6add8769352"} Aug 01 05:44:04.424332 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:04.423996 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:05.427547 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:05.427508 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7wkjl" event={"ID":"43301bca-3de0-4e68-9cf7-744f6f259b31","Type":"ContainerStarted","Data":"2b7dd89e531432f503bf8d23dd566bbc01d228b69cb85670883404223bae0eb0"} Aug 01 05:44:05.440999 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:05.440961 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7wkjl" podStartSLOduration=2.071288455 podStartE2EDuration="4.440945524s" totalImagesPullingTime="2.369657069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:05.440896261 +0000 UTC m=+55.837080400" watchObservedRunningTime="2026-08-01 05:44:05.440945524 +0000 UTC m=+55.837129668" Aug 01 05:44:05.441430 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:05.441396 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-njf2l" podStartSLOduration=2.913149497 podStartE2EDuration="4.441387635s" totalImagesPullingTime="1.528238138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:04.439863732 +0000 UTC m=+54.836047873" watchObservedRunningTime="2026-08-01 05:44:05.441387635 +0000 UTC m=+55.837571824" Aug 01 05:44:09.126628 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.126581 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:09.226959 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.226924 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:09.278370 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.278338 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb"] Aug 01 05:44:09.280788 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.280771 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" Aug 01 05:44:09.283226 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.283207 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Aug 01 05:44:09.283307 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.283257 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gfx5k\"" Aug 01 05:44:09.288900 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.288876 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb"] Aug 01 05:44:09.295293 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.295263 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:09.390038 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.389973 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efdf14f1-e365-4224-ad25-8bcf039652e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-7tkhb\" (UID: \"efdf14f1-e365-4224-ad25-8bcf039652e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" Aug 01 05:44:09.396268 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.396224 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:09.467320 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.467293 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-msxst"] Aug 01 05:44:09.469130 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.469115 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.471835 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.471799 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Aug 01 05:44:09.471835 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.471827 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Aug 01 05:44:09.472079 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.471898 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Aug 01 05:44:09.472079 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.471957 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rms26\"" Aug 01 05:44:09.472178 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.472164 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Aug 01 05:44:09.482340 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.482316 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-msxst"] Aug 01 05:44:09.488403 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.488384 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:09.490342 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.490322 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3f7d27a-a848-4229-81ce-386e082b4f22-crio-socket\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.490407 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.490356 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3f7d27a-a848-4229-81ce-386e082b4f22-data-volume\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.490407 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.490394 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.490468 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.490425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.490500 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.490467 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6g4z\" (UniqueName: \"kubernetes.io/projected/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-api-access-c6g4z\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.490500 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.490492 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efdf14f1-e365-4224-ad25-8bcf039652e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-7tkhb\" (UID: \"efdf14f1-e365-4224-ad25-8bcf039652e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" Aug 01 05:44:09.492680 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.492664 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/efdf14f1-e365-4224-ad25-8bcf039652e9-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-7tkhb\" (UID: \"efdf14f1-e365-4224-ad25-8bcf039652e9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" Aug 01 05:44:09.589402 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.589370 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" Aug 01 05:44:09.590851 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.590827 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g4z\" (UniqueName: \"kubernetes.io/projected/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-api-access-c6g4z\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.590943 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.590877 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3f7d27a-a848-4229-81ce-386e082b4f22-crio-socket\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.590943 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.590913 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3f7d27a-a848-4229-81ce-386e082b4f22-data-volume\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.591051 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.590950 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.591051 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.590978 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.591051 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.590996 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e3f7d27a-a848-4229-81ce-386e082b4f22-crio-socket\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.591486 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:09.591069 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 01 05:44:09.591486 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:09.591097 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 05:44:09.591486 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:09.591152 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm podName:e3f7d27a-a848-4229-81ce-386e082b4f22 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:10.091131543 +0000 UTC m=+60.487315684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-msxst" (UID: "e3f7d27a-a848-4229-81ce-386e082b4f22") : configmap "kube-rbac-proxy" not found Aug 01 05:44:09.591486 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:09.591171 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls podName:e3f7d27a-a848-4229-81ce-386e082b4f22 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:10.091160802 +0000 UTC m=+60.487344922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-msxst" (UID: "e3f7d27a-a848-4229-81ce-386e082b4f22") : secret "insights-runtime-extractor-tls" not found Aug 01 05:44:09.591486 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.591272 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e3f7d27a-a848-4229-81ce-386e082b4f22-data-volume\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.601299 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.601277 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6g4z\" (UniqueName: \"kubernetes.io/projected/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-api-access-c6g4z\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:09.687551 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.687525 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-bhmjp"] Aug 01 05:44:09.690204 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.690183 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-bhmjp" Aug 01 05:44:09.690829 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.690808 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:09.692806 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.692785 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wgb76\"" Aug 01 05:44:09.692806 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.692796 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Aug 01 05:44:09.693000 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.692797 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Aug 01 05:44:09.700498 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.700478 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-bhmjp"] Aug 01 05:44:09.713023 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.713001 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb"] Aug 01 05:44:09.716113 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:44:09.716082 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefdf14f1_e365_4224_ad25_8bcf039652e9.slice/crio-df9b3b927e55a5552181b8dccd20fa2175b843e41d2b139876b5f533e1920de6 WatchSource:0}: Error finding container df9b3b927e55a5552181b8dccd20fa2175b843e41d2b139876b5f533e1920de6: Status 404 returned error can't find the container with id df9b3b927e55a5552181b8dccd20fa2175b843e41d2b139876b5f533e1920de6 Aug 01 05:44:09.762481 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.762451 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:09.791661 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.791632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8f2r\" (UniqueName: \"kubernetes.io/projected/2b7b54aa-c0cc-4706-b611-e8dac31f1d75-kube-api-access-n8f2r\") pod \"downloads-77c974ffcf-bhmjp\" (UID: \"2b7b54aa-c0cc-4706-b611-e8dac31f1d75\") " pod="openshift-console/downloads-77c974ffcf-bhmjp" Aug 01 05:44:09.851858 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.851832 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:09.892585 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.892558 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8f2r\" (UniqueName: \"kubernetes.io/projected/2b7b54aa-c0cc-4706-b611-e8dac31f1d75-kube-api-access-n8f2r\") pod \"downloads-77c974ffcf-bhmjp\" (UID: \"2b7b54aa-c0cc-4706-b611-e8dac31f1d75\") " pod="openshift-console/downloads-77c974ffcf-bhmjp" Aug 01 05:44:09.902310 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.902288 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8f2r\" (UniqueName: \"kubernetes.io/projected/2b7b54aa-c0cc-4706-b611-e8dac31f1d75-kube-api-access-n8f2r\") pod \"downloads-77c974ffcf-bhmjp\" (UID: \"2b7b54aa-c0cc-4706-b611-e8dac31f1d75\") " pod="openshift-console/downloads-77c974ffcf-bhmjp" Aug 01 05:44:09.951154 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:09.951081 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.001856 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.001830 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-wgb76\"" Aug 01 05:44:10.009759 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.009738 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-bhmjp" Aug 01 05:44:10.020088 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.020063 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.094317 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.094286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:10.094434 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.094319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:10.094434 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:10.094419 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 05:44:10.094495 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:10.094462 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls podName:e3f7d27a-a848-4229-81ce-386e082b4f22 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:11.094450258 +0000 UTC m=+61.490634375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-msxst" (UID: "e3f7d27a-a848-4229-81ce-386e082b4f22") : secret "insights-runtime-extractor-tls" not found Aug 01 05:44:10.094545 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:10.094417 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 01 05:44:10.094583 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:10.094555 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm podName:e3f7d27a-a848-4229-81ce-386e082b4f22 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:11.09453643 +0000 UTC m=+61.490720570 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-msxst" (UID: "e3f7d27a-a848-4229-81ce-386e082b4f22") : configmap "kube-rbac-proxy" not found Aug 01 05:44:10.129326 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.129300 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-bhmjp"] Aug 01 05:44:10.132166 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:44:10.132142 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7b54aa_c0cc_4706_b611_e8dac31f1d75.slice/crio-d1785dbe32162661a5a036fe71be0ed6f6cef3edc169ab92e0e343146819c798 WatchSource:0}: Error finding container d1785dbe32162661a5a036fe71be0ed6f6cef3edc169ab92e0e343146819c798: Status 404 returned error can't find the container with id d1785dbe32162661a5a036fe71be0ed6f6cef3edc169ab92e0e343146819c798 Aug 01 05:44:10.143267 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.143226 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.244847 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.244764 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.371521 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.371494 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7r9lp" Aug 01 05:44:10.439550 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.439511 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njf2l_b83e34bb-eea0-4cc2-9d58-e8de3c99080d/dns/0.log" Aug 01 05:44:10.440967 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.440939 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-bhmjp" event={"ID":"2b7b54aa-c0cc-4706-b611-e8dac31f1d75","Type":"ContainerStarted","Data":"d1785dbe32162661a5a036fe71be0ed6f6cef3edc169ab92e0e343146819c798"} Aug 01 05:44:10.442081 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.442061 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" event={"ID":"efdf14f1-e365-4224-ad25-8bcf039652e9","Type":"ContainerStarted","Data":"df9b3b927e55a5552181b8dccd20fa2175b843e41d2b139876b5f533e1920de6"} Aug 01 05:44:10.480996 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.480953 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.581533 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.581427 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.637206 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.637149 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njf2l_b83e34bb-eea0-4cc2-9d58-e8de3c99080d/kube-rbac-proxy/0.log" Aug 01 05:44:10.682002 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.681967 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.782351 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.782306 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.835481 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.835408 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:10.985221 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:10.985193 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:11.101028 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.100939 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:11.101028 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.100986 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:11.101262 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:11.101064 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 01 05:44:11.101262 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:11.101119 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 05:44:11.101262 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:11.101137 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm podName:e3f7d27a-a848-4229-81ce-386e082b4f22 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:13.101118525 +0000 UTC m=+63.497302645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-msxst" (UID: "e3f7d27a-a848-4229-81ce-386e082b4f22") : configmap "kube-rbac-proxy" not found Aug 01 05:44:11.101262 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:11.101172 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls podName:e3f7d27a-a848-4229-81ce-386e082b4f22 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:13.101154179 +0000 UTC m=+63.497338296 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-msxst" (UID: "e3f7d27a-a848-4229-81ce-386e082b4f22") : secret "insights-runtime-extractor-tls" not found Aug 01 05:44:11.346949 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.346916 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:11.446357 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.446325 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:11.447146 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.447116 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" event={"ID":"efdf14f1-e365-4224-ad25-8bcf039652e9","Type":"ContainerStarted","Data":"9ab9dca489bd73b10e8eaf8bd3e715da63030526a3cafe3c10396de911269308"} Aug 01 05:44:11.447321 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.447302 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" Aug 01 05:44:11.452690 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.452670 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" Aug 01 05:44:11.462508 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.462462 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-7tkhb" podStartSLOduration=1.328519879 podStartE2EDuration="2.462441874s" totalImagesPullingTime="1.133921995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:11.461945403 +0000 UTC m=+61.858129570" watchObservedRunningTime="2026-08-01 05:44:11.462441874 +0000 UTC m=+61.858626008" Aug 01 05:44:11.551192 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.551156 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:11.636876 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.636844 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nhvgl_86badb5c-f1d6-470c-b107-faf3ed3e8c3a/dns-node-resolver/0.log" Aug 01 05:44:11.646811 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.646787 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:11.841150 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:11.841065 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:12.179756 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.179718 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:12.283094 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.283018 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:12.337226 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.337193 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-kgfqd"] Aug 01 05:44:12.339333 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.339313 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.341413 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.341379 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:12.341539 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.341473 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Aug 01 05:44:12.341822 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.341798 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Aug 01 05:44:12.343127 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.343089 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Aug 01 05:44:12.343268 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.343178 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6vf8m\"" Aug 01 05:44:12.343339 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.343317 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Aug 01 05:44:12.343437 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.343419 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Aug 01 05:44:12.348916 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.348870 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-kgfqd"] Aug 01 05:44:12.412101 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.412072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.412272 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.412151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.412272 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.412198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wngq\" (UniqueName: \"kubernetes.io/projected/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-kube-api-access-5wngq\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.412272 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.412216 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.513201 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.513124 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.513360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.513210 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.513360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.513304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wngq\" (UniqueName: \"kubernetes.io/projected/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-kube-api-access-5wngq\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.513360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.513332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.513360 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:12.513343 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Aug 01 05:44:12.513565 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:12.513417 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-tls podName:0b41cbbe-553b-4d7e-bfdf-67a2b9da610a nodeName:}" failed. No retries permitted until 2026-08-01 05:44:13.013394434 +0000 UTC m=+63.409578579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-kgfqd" (UID: "0b41cbbe-553b-4d7e-bfdf-67a2b9da610a") : secret "prometheus-operator-tls" not found Aug 01 05:44:12.514032 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.514011 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.515907 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.515883 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.522139 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.522090 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wngq\" (UniqueName: \"kubernetes.io/projected/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-kube-api-access-5wngq\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:12.740265 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.740216 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:12.797908 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.797830 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:12.836669 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.836642 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qkx6h_ba62bfc3-b408-4a41-92f4-db31ffe596ca/node-ca/0.log" Aug 01 05:44:12.926117 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:12.926086 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:13.017165 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.017135 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:13.019724 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.019699 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0b41cbbe-553b-4d7e-bfdf-67a2b9da610a-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-kgfqd\" (UID: \"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:13.117675 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.117590 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:13.117831 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.117722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:13.117831 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:13.117734 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Aug 01 05:44:13.117831 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:13.117812 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls podName:e3f7d27a-a848-4229-81ce-386e082b4f22 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:17.117795701 +0000 UTC m=+67.513979819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls") pod "insights-runtime-extractor-msxst" (UID: "e3f7d27a-a848-4229-81ce-386e082b4f22") : secret "insights-runtime-extractor-tls" not found Aug 01 05:44:13.117831 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:13.117817 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Aug 01 05:44:13.118032 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:13.117877 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm podName:e3f7d27a-a848-4229-81ce-386e082b4f22 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:17.117861752 +0000 UTC m=+67.514045885 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm") pod "insights-runtime-extractor-msxst" (UID: "e3f7d27a-a848-4229-81ce-386e082b4f22") : configmap "kube-rbac-proxy" not found Aug 01 05:44:13.126974 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.126937 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:13.250743 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.250711 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" Aug 01 05:44:13.326832 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.326795 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:13.381701 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.381613 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-kgfqd"] Aug 01 05:44:13.384478 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:44:13.384449 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b41cbbe_553b_4d7e_bfdf_67a2b9da610a.slice/crio-d5de78965d07087026a28446b01642efcb0efae13f56c749150bf50a9cda283e WatchSource:0}: Error finding container d5de78965d07087026a28446b01642efcb0efae13f56c749150bf50a9cda283e: Status 404 returned error can't find the container with id d5de78965d07087026a28446b01642efcb0efae13f56c749150bf50a9cda283e Aug 01 05:44:13.436692 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.436647 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7wkjl_43301bca-3de0-4e68-9cf7-744f6f259b31/serve-healthcheck-canary/0.log" Aug 01 05:44:13.453496 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:13.453467 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" event={"ID":"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a","Type":"ContainerStarted","Data":"d5de78965d07087026a28446b01642efcb0efae13f56c749150bf50a9cda283e"} Aug 01 05:44:14.429887 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.429858 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-njf2l" Aug 01 05:44:14.600270 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.600209 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:14.653305 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.653264 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:14.731806 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.731724 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:44:14.734262 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.734225 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Aug 01 05:44:14.744835 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.744812 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f-metrics-certs\") pod \"network-metrics-daemon-hhc8q\" (UID: \"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f\") " pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:44:14.832340 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.832304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:44:14.832495 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.832367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:44:14.834772 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.834746 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Aug 01 05:44:14.834920 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.834739 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Aug 01 05:44:14.845242 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.845201 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/54bfe892-21bb-4ece-b41c-f7b533281c1a-original-pull-secret\") pod \"global-pull-secret-syncer-wkpzk\" (UID: \"54bfe892-21bb-4ece-b41c-f7b533281c1a\") " pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:44:14.845387 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.845354 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Aug 01 05:44:14.855895 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:14.855864 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2c8h\" (UniqueName: \"kubernetes.io/projected/56ff8bc5-1382-49d6-8c80-27b2f5f144f9-kube-api-access-k2c8h\") pod \"network-check-target-7tpxx\" (UID: \"56ff8bc5-1382-49d6-8c80-27b2f5f144f9\") " pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:44:15.004528 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.004458 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2prdk\"" Aug 01 05:44:15.011121 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.011095 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kdw7g\"" Aug 01 05:44:15.012094 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.012077 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:44:15.017949 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.017931 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hhc8q" Aug 01 05:44:15.102732 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.100649 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkpzk" Aug 01 05:44:15.188821 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.188756 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7tpxx"] Aug 01 05:44:15.216890 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.216481 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hhc8q"] Aug 01 05:44:15.273218 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.273148 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wkpzk"] Aug 01 05:44:15.278191 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:44:15.278158 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54bfe892_21bb_4ece_b41c_f7b533281c1a.slice/crio-f32b0a6718963470c691d3755f86dad75abd8434ea552cfd08007a2a7a334abd WatchSource:0}: Error finding container f32b0a6718963470c691d3755f86dad75abd8434ea552cfd08007a2a7a334abd: Status 404 returned error can't find the container with id f32b0a6718963470c691d3755f86dad75abd8434ea552cfd08007a2a7a334abd Aug 01 05:44:15.401645 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.401597 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:15.461459 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.461425 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhc8q" event={"ID":"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f","Type":"ContainerStarted","Data":"ecbaab90da1cdbeaf3c1c7fae1204fecd30ca25f0a3745d75e6451079bc1e2fe"} Aug 01 05:44:15.462651 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.462624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tpxx" event={"ID":"56ff8bc5-1382-49d6-8c80-27b2f5f144f9","Type":"ContainerStarted","Data":"dd47cebf523685a43791b9e85ea8d68de45719953592bb0101b171642da900eb"} Aug 01 05:44:15.464320 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.464293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" event={"ID":"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a","Type":"ContainerStarted","Data":"e099ca9a5ccc609234f6512226c68528e63fbef42298a2ea246d20fc09fda478"} Aug 01 05:44:15.464436 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.464342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" event={"ID":"0b41cbbe-553b-4d7e-bfdf-67a2b9da610a","Type":"ContainerStarted","Data":"b224b9a6d86ab68579333a4f443953946512eaa118415ffc8703b6ffc67162fa"} Aug 01 05:44:15.465301 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.465279 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wkpzk" event={"ID":"54bfe892-21bb-4ece-b41c-f7b533281c1a","Type":"ContainerStarted","Data":"f32b0a6718963470c691d3755f86dad75abd8434ea552cfd08007a2a7a334abd"} Aug 01 05:44:15.486245 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.486185 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-kgfqd" podStartSLOduration=1.828416774 podStartE2EDuration="3.486166014s" totalImagesPullingTime="1.65774924s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:15.484534813 +0000 UTC m=+65.880718952" watchObservedRunningTime="2026-08-01 05:44:15.486166014 +0000 UTC m=+65.882350146" Aug 01 05:44:15.576748 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.576611 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:15.760527 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:15.760471 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:17.152426 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.152384 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:17.152915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.152444 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:17.153428 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.153368 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e3f7d27a-a848-4229-81ce-386e082b4f22-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:17.157552 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.157521 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e3f7d27a-a848-4229-81ce-386e082b4f22-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-msxst\" (UID: \"e3f7d27a-a848-4229-81ce-386e082b4f22\") " pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:17.280354 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.280122 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rms26\"" Aug 01 05:44:17.288481 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.288272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-msxst" Aug 01 05:44:17.466879 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.466741 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-msxst"] Aug 01 05:44:17.472623 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:44:17.472588 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f7d27a_a848_4229_81ce_386e082b4f22.slice/crio-244e027e302a72d95fef1fd8d8bb188d41fd7494596ae431841f889399ea9dfe WatchSource:0}: Error finding container 244e027e302a72d95fef1fd8d8bb188d41fd7494596ae431841f889399ea9dfe: Status 404 returned error can't find the container with id 244e027e302a72d95fef1fd8d8bb188d41fd7494596ae431841f889399ea9dfe Aug 01 05:44:17.478621 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.478548 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:17.481777 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.481751 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhc8q" event={"ID":"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f","Type":"ContainerStarted","Data":"d131603ebb761042e5f5d715385db8de49339b18c014f2db1df891d5449eb0ca"} Aug 01 05:44:17.481879 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.481798 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hhc8q" event={"ID":"f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f","Type":"ContainerStarted","Data":"d4e8d8d5858718663379ff25a6c7448f7b43e7b36ad0eb64712001098bcd4f70"} Aug 01 05:44:17.483399 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.483336 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-msxst" event={"ID":"e3f7d27a-a848-4229-81ce-386e082b4f22","Type":"ContainerStarted","Data":"244e027e302a72d95fef1fd8d8bb188d41fd7494596ae431841f889399ea9dfe"} Aug 01 05:44:17.503861 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.503629 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hhc8q" podStartSLOduration=66.282377561 podStartE2EDuration="1m7.503607212s" totalImagesPullingTime="1.221229651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:17.502339853 +0000 UTC m=+67.898523993" watchObservedRunningTime="2026-08-01 05:44:17.503607212 +0000 UTC m=+67.899791354" Aug 01 05:44:17.558839 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.558781 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:17.659356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.659275 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:17.722444 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.721076 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89"] Aug 01 05:44:17.723662 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.723586 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.728195 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.727686 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Aug 01 05:44:17.728195 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.727993 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tbkqb\"" Aug 01 05:44:17.729812 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.729702 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Aug 01 05:44:17.736610 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.736518 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89"] Aug 01 05:44:17.743482 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.743459 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c"] Aug 01 05:44:17.745860 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.745839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.749150 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.749127 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Aug 01 05:44:17.749490 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.749139 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Aug 01 05:44:17.749670 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.749533 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d4bl8\"" Aug 01 05:44:17.750029 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.749864 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Aug 01 05:44:17.750455 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.750387 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:17.753037 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.751818 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c6hmm"] Aug 01 05:44:17.754106 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.754086 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.758571 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.757138 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Aug 01 05:44:17.758571 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.757284 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Aug 01 05:44:17.758571 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.757460 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6j7nq\"" Aug 01 05:44:17.758571 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.757702 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Aug 01 05:44:17.760851 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.760831 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c"] Aug 01 05:44:17.820313 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.820277 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:17.859618 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.859618 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859591 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-tls\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.859848 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859639 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.859848 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-wtmp\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.859848 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859700 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d64ed186-4a7a-40b0-a36a-b84931d651f6-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.859848 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859735 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.859848 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.859848 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.860147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.860147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859916 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-root\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.860147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859956 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgnd2\" (UniqueName: \"kubernetes.io/projected/ca172704-89ee-49fe-8d1d-a1b29cb3a140-kube-api-access-cgnd2\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.860147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.859991 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca172704-89ee-49fe-8d1d-a1b29cb3a140-metrics-client-ca\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.860147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.860021 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/274ca062-20d2-4b1d-8024-1b4423f625bf-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.860147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.860044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8k6\" (UniqueName: \"kubernetes.io/projected/274ca062-20d2-4b1d-8024-1b4423f625bf-kube-api-access-zd8k6\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.860147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.860087 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.860147 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.860117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4s89\" (UniqueName: \"kubernetes.io/projected/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-api-access-x4s89\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.860551 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.860155 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-textfile\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.860551 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.860182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d64ed186-4a7a-40b0-a36a-b84931d651f6-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.860551 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.860207 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-sys\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.919971 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.919907 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961255 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/274ca062-20d2-4b1d-8024-1b4423f625bf-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961313 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8k6\" (UniqueName: \"kubernetes.io/projected/274ca062-20d2-4b1d-8024-1b4423f625bf-kube-api-access-zd8k6\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961359 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961390 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4s89\" (UniqueName: \"kubernetes.io/projected/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-api-access-x4s89\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-textfile\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d64ed186-4a7a-40b0-a36a-b84931d651f6-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-sys\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961502 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961542 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-tls\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961570 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-wtmp\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.961639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961632 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d64ed186-4a7a-40b0-a36a-b84931d651f6-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961660 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961693 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961717 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961741 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961763 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-root\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961783 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgnd2\" (UniqueName: \"kubernetes.io/projected/ca172704-89ee-49fe-8d1d-a1b29cb3a140-kube-api-access-cgnd2\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.961808 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca172704-89ee-49fe-8d1d-a1b29cb3a140-metrics-client-ca\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.962104 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/274ca062-20d2-4b1d-8024-1b4423f625bf-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.962356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.962323 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d64ed186-4a7a-40b0-a36a-b84931d651f6-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.962820 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.962408 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca172704-89ee-49fe-8d1d-a1b29cb3a140-metrics-client-ca\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.962820 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.962474 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-sys\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.962820 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.962774 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-textfile\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.963192 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.963165 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.963349 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.963326 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-wtmp\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.963435 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.963390 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-accelerators-collector-config\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.963435 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:17.963425 2561 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Aug 01 05:44:17.963547 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.963457 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca172704-89ee-49fe-8d1d-a1b29cb3a140-root\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.963547 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:17.963485 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-tls podName:274ca062-20d2-4b1d-8024-1b4423f625bf nodeName:}" failed. No retries permitted until 2026-08-01 05:44:18.463465571 +0000 UTC m=+68.859649692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-7kq89" (UID: "274ca062-20d2-4b1d-8024-1b4423f625bf") : secret "openshift-state-metrics-tls" not found Aug 01 05:44:17.963651 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.963556 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d64ed186-4a7a-40b0-a36a-b84931d651f6-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.965377 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.965295 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.966949 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.966923 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.967032 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.966981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.969809 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.969784 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:17.970083 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.970040 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca172704-89ee-49fe-8d1d-a1b29cb3a140-node-exporter-tls\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.977517 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.977430 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8k6\" (UniqueName: \"kubernetes.io/projected/274ca062-20d2-4b1d-8024-1b4423f625bf-kube-api-access-zd8k6\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:17.978463 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.978439 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgnd2\" (UniqueName: \"kubernetes.io/projected/ca172704-89ee-49fe-8d1d-a1b29cb3a140-kube-api-access-cgnd2\") pod \"node-exporter-c6hmm\" (UID: \"ca172704-89ee-49fe-8d1d-a1b29cb3a140\") " pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:17.978568 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:17.978532 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4s89\" (UniqueName: \"kubernetes.io/projected/d64ed186-4a7a-40b0-a36a-b84931d651f6-kube-api-access-x4s89\") pod \"kube-state-metrics-6bd9664c4-8fc6c\" (UID: \"d64ed186-4a7a-40b0-a36a-b84931d651f6\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:18.020348 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.020310 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:18.062941 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.062348 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" Aug 01 05:44:18.072524 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.072497 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c6hmm" Aug 01 05:44:18.120286 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.120206 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:18.223577 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.223529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:18.466380 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.466265 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:18.469129 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.469106 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/274ca062-20d2-4b1d-8024-1b4423f625bf-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-7kq89\" (UID: \"274ca062-20d2-4b1d-8024-1b4423f625bf\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:18.489634 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.489585 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-msxst" event={"ID":"e3f7d27a-a848-4229-81ce-386e082b4f22","Type":"ContainerStarted","Data":"33aa1efe7e2ec57228b06a747a29a2a6c594cd9cc973d13c98447e8267f649d4"} Aug 01 05:44:18.637901 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.637852 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" Aug 01 05:44:18.745538 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.745422 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:18.819514 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.819479 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:44:18.822690 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.822306 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:18.823100 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.823079 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.827757 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827706 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 01 05:44:18.827757 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827750 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 01 05:44:18.827936 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827753 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 01 05:44:18.827936 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827796 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 01 05:44:18.827936 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827752 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 01 05:44:18.827936 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827797 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 01 05:44:18.827936 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827752 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 01 05:44:18.828194 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827954 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rgjx7\"" Aug 01 05:44:18.828194 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827962 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 01 05:44:18.828194 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.827969 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 01 05:44:18.838177 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.838153 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:44:18.869731 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.869699 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.869895 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.869737 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.869895 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.869813 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.869895 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.869856 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870054 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.869918 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870054 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.870040 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870137 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.870082 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870137 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.870122 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870251 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.870148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqxqn\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-kube-api-access-lqxqn\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870251 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.870185 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-config-out\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870251 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.870212 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-web-config\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870412 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.870266 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.870412 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.870292 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-config-volume\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.970921 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.970883 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.970921 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.970929 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqxqn\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-kube-api-access-lqxqn\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971169 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.970967 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-config-out\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971169 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.970995 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-web-config\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971169 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971026 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971169 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-config-volume\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971511 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971565 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971639 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971630 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971937 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971658 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971937 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.971691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.971937 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:18.971774 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle podName:64dafae2-4857-4252-ac3b-137180beaf55 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:19.471717525 +0000 UTC m=+69.867901656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "64dafae2-4857-4252-ac3b-137180beaf55") : configmap references non-existent config key: ca-bundle.crt Aug 01 05:44:18.972253 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.972216 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.973065 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:18.973040 2561 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Aug 01 05:44:18.973172 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:18.973110 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls podName:64dafae2-4857-4252-ac3b-137180beaf55 nodeName:}" failed. No retries permitted until 2026-08-01 05:44:19.473088734 +0000 UTC m=+69.869272872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "64dafae2-4857-4252-ac3b-137180beaf55") : secret "alertmanager-main-tls" not found Aug 01 05:44:18.973873 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.973846 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.974343 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.974315 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-web-config\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.974472 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.974432 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-config-out\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.974657 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.974622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-tls-assets\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.974750 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.974728 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.975255 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.975209 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.975371 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.975352 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-config-volume\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.975931 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.975605 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.981298 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.981197 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:18.983420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:18.983397 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqxqn\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-kube-api-access-lqxqn\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:19.160223 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.160188 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:19.381224 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.381194 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d6d856744-vqgdf"] Aug 01 05:44:19.384507 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.384484 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.387345 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.387152 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Aug 01 05:44:19.387345 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.387241 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Aug 01 05:44:19.387500 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.387363 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Aug 01 05:44:19.387500 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.387390 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Aug 01 05:44:19.387500 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.387403 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wqdpr\"" Aug 01 05:44:19.387500 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.387363 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Aug 01 05:44:19.394467 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.394446 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6d856744-vqgdf"] Aug 01 05:44:19.477023 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.476941 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:19.477023 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.476993 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9r5p\" (UniqueName: \"kubernetes.io/projected/893d42e5-15ec-42b2-b14c-c344164c91da-kube-api-access-z9r5p\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.477271 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.477071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-oauth-serving-cert\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.477271 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.477138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:19.477271 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.477176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-serving-cert\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.477271 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.477210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-oauth-config\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.477271 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.477260 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-console-config\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.477494 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.477285 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-service-ca\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.477996 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.477961 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:19.480189 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.480161 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:19.577976 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.577934 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9r5p\" (UniqueName: \"kubernetes.io/projected/893d42e5-15ec-42b2-b14c-c344164c91da-kube-api-access-z9r5p\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.578156 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.578006 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-oauth-serving-cert\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.578156 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.578057 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-serving-cert\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.578156 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.578082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-oauth-config\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.578156 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.578108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-console-config\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.578403 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.578288 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-service-ca\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.578860 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.578801 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-oauth-serving-cert\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.578860 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.578853 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-console-config\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.579002 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.578979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-service-ca\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.581327 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.581307 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-serving-cert\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.582426 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.582390 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-oauth-config\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.585619 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.585592 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9r5p\" (UniqueName: \"kubernetes.io/projected/893d42e5-15ec-42b2-b14c-c344164c91da-kube-api-access-z9r5p\") pod \"console-d6d856744-vqgdf\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.697349 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.697304 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:19.737391 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.737312 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:44:19.746360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.746329 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-69f475d4cb-46qpk"] Aug 01 05:44:19.750116 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.750097 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.753157 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.753129 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Aug 01 05:44:19.753433 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.753414 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Aug 01 05:44:19.754055 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.753723 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1gkm73deujmid\"" Aug 01 05:44:19.754055 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.753798 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Aug 01 05:44:19.754055 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.753566 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zcwkz\"" Aug 01 05:44:19.754055 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.753566 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Aug 01 05:44:19.754055 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.753627 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Aug 01 05:44:19.762915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.762783 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69f475d4cb-46qpk"] Aug 01 05:44:19.881338 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.881297 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b346db4e-464b-49fd-970b-24904b3e3bc5-metrics-client-ca\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.881516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.881362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.881516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.881396 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.881516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.881427 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.881516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.881473 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-tls\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.881516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.881500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-grpc-tls\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.881755 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.881587 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hvl4\" (UniqueName: \"kubernetes.io/projected/b346db4e-464b-49fd-970b-24904b3e3bc5-kube-api-access-6hvl4\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.881755 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.881711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.982363 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.982322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hvl4\" (UniqueName: \"kubernetes.io/projected/b346db4e-464b-49fd-970b-24904b3e3bc5-kube-api-access-6hvl4\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.982562 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.982380 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.982562 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.982432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b346db4e-464b-49fd-970b-24904b3e3bc5-metrics-client-ca\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.982562 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.982472 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.982562 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.982503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.982562 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.982534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.982826 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.982582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-tls\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.982826 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.982608 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-grpc-tls\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.983347 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.983295 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b346db4e-464b-49fd-970b-24904b3e3bc5-metrics-client-ca\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.985571 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.985522 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.986033 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.985979 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.986181 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.986158 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.986725 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.986692 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-grpc-tls\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.988016 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.987946 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-tls\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.988553 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.988512 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b346db4e-464b-49fd-970b-24904b3e3bc5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:19.990599 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:19.990578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hvl4\" (UniqueName: \"kubernetes.io/projected/b346db4e-464b-49fd-970b-24904b3e3bc5-kube-api-access-6hvl4\") pod \"thanos-querier-69f475d4cb-46qpk\" (UID: \"b346db4e-464b-49fd-970b-24904b3e3bc5\") " pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:20.063827 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:20.063597 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:20.665730 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:20.665676 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:20.766339 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:20.766293 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:21.110769 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:21.110736 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:21.210891 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:21.210819 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:21.278073 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:21.278040 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:22.021894 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.020686 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-769cfbc494-mvm8w"] Aug 01 05:44:22.024554 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.024525 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.027133 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.027108 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Aug 01 05:44:22.027287 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.027217 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Aug 01 05:44:22.028458 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.028422 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ll6c5\"" Aug 01 05:44:22.028580 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.028560 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Aug 01 05:44:22.028672 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.028640 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5vtb7rj8pcqbo\"" Aug 01 05:44:22.028743 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.028728 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Aug 01 05:44:22.033357 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.033334 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-769cfbc494-mvm8w"] Aug 01 05:44:22.099120 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.099089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.099316 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.099138 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-client-ca-bundle\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.099316 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.099184 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-audit-log\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.099316 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.099219 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-secret-metrics-server-client-certs\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.099482 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.099310 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-secret-metrics-server-tls\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.099482 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.099346 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-metrics-server-audit-profiles\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.099482 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.099374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmdj6\" (UniqueName: \"kubernetes.io/projected/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-kube-api-access-vmdj6\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.200473 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.200432 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-secret-metrics-server-client-certs\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.200652 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.200499 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-secret-metrics-server-tls\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.200652 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.200530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-metrics-server-audit-profiles\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.200652 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.200557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmdj6\" (UniqueName: \"kubernetes.io/projected/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-kube-api-access-vmdj6\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.200652 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.200616 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.200853 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.200653 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-client-ca-bundle\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.200853 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.200706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-audit-log\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.201119 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.201088 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-audit-log\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.201567 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.201547 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-metrics-server-audit-profiles\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.201670 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.201610 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.203198 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.203178 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-secret-metrics-server-tls\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.203385 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.203361 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-client-ca-bundle\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.203626 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.203606 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-secret-metrics-server-client-certs\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.208046 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.208024 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmdj6\" (UniqueName: \"kubernetes.io/projected/91d7d46e-44c1-43e0-a9f6-5cb832029ec8-kube-api-access-vmdj6\") pod \"metrics-server-769cfbc494-mvm8w\" (UID: \"91d7d46e-44c1-43e0-a9f6-5cb832029ec8\") " pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.337172 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.337086 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:22.482042 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.481996 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:22.499545 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.499513 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj"] Aug 01 05:44:22.503086 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.503062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:22.505618 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.505595 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Aug 01 05:44:22.505739 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.505596 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pv7lv\"" Aug 01 05:44:22.509572 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.509553 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj"] Aug 01 05:44:22.544977 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.544943 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:22.604344 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.604257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndwks\" (UniqueName: \"kubernetes.io/projected/34668055-10ab-4a09-83ea-79bad5c73dfc-kube-api-access-ndwks\") pod \"monitoring-plugin-6dffbbd67-mlfnj\" (UID: \"34668055-10ab-4a09-83ea-79bad5c73dfc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:22.604344 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.604328 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34668055-10ab-4a09-83ea-79bad5c73dfc-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-mlfnj\" (UID: \"34668055-10ab-4a09-83ea-79bad5c73dfc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:22.682070 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.682036 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:22.705186 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.705157 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34668055-10ab-4a09-83ea-79bad5c73dfc-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-mlfnj\" (UID: \"34668055-10ab-4a09-83ea-79bad5c73dfc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:22.705364 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.705270 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndwks\" (UniqueName: \"kubernetes.io/projected/34668055-10ab-4a09-83ea-79bad5c73dfc-kube-api-access-ndwks\") pod \"monitoring-plugin-6dffbbd67-mlfnj\" (UID: \"34668055-10ab-4a09-83ea-79bad5c73dfc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:22.705364 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:22.705321 2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Aug 01 05:44:22.705474 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:44:22.705398 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34668055-10ab-4a09-83ea-79bad5c73dfc-monitoring-plugin-cert podName:34668055-10ab-4a09-83ea-79bad5c73dfc nodeName:}" failed. No retries permitted until 2026-08-01 05:44:23.205375263 +0000 UTC m=+73.601559396 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/34668055-10ab-4a09-83ea-79bad5c73dfc-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-mlfnj" (UID: "34668055-10ab-4a09-83ea-79bad5c73dfc") : secret "monitoring-plugin-cert" not found Aug 01 05:44:22.714593 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.714572 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndwks\" (UniqueName: \"kubernetes.io/projected/34668055-10ab-4a09-83ea-79bad5c73dfc-kube-api-access-ndwks\") pod \"monitoring-plugin-6dffbbd67-mlfnj\" (UID: \"34668055-10ab-4a09-83ea-79bad5c73dfc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:22.782795 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:22.782757 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:23.184881 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.184847 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:23.210946 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.210915 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34668055-10ab-4a09-83ea-79bad5c73dfc-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-mlfnj\" (UID: \"34668055-10ab-4a09-83ea-79bad5c73dfc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:23.213564 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.213536 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34668055-10ab-4a09-83ea-79bad5c73dfc-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-mlfnj\" (UID: \"34668055-10ab-4a09-83ea-79bad5c73dfc\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:23.417204 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.417171 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:23.535590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.535510 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:23.636161 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.636119 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:23.874606 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.874518 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:23.938427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.938393 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:44:23.942588 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.942562 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:23.943975 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.943615 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:23.945316 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.945291 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 01 05:44:23.945425 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.945381 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 01 05:44:23.945752 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.945715 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 01 05:44:23.945752 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.945732 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 01 05:44:23.946045 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.946025 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 01 05:44:23.946351 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.946331 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 01 05:44:23.949049 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.946344 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 01 05:44:23.949049 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.946345 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 01 05:44:23.949049 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.948595 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 01 05:44:23.949049 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.948629 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 01 05:44:23.949049 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.948662 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cq7jn\"" Aug 01 05:44:23.949049 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.948792 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 01 05:44:23.949049 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.948811 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 01 05:44:23.949049 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.948915 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-frh4ed77e1h6h\"" Aug 01 05:44:23.949394 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.949120 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 01 05:44:23.950694 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.950671 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 01 05:44:23.959307 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:23.959214 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:44:24.020848 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.020811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.020860 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.020896 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.020919 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.020980 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021319 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021052 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021319 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021093 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021319 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021119 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7z8\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-kube-api-access-fv7z8\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021319 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021167 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-config\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021319 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021200 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021319 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021319 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021340 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021409 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021445 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021478 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021506 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021527 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021551 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.021604 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.021578 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.122471 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.122434 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.122471 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.122474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.122703 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.122503 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.122887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.122937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.122982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123072 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123119 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123179 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7z8\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-kube-api-access-fv7z8\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123279 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-config\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123300 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123304 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123365 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124910 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124910 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123414 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124910 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.123664 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124910 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.124052 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.124910 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.124586 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.125757 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.125603 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.127182 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.126588 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.127897 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.127603 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.128998 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.128968 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.129100 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.129063 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.129577 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.129551 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.130818 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.130745 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.131652 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.131526 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-web-config\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.131652 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.131591 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.132210 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.131796 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-config\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.132210 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.132169 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.132943 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.132900 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.133422 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.133382 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.134744 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.134696 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-config-out\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.136769 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.136747 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7z8\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-kube-api-access-fv7z8\") pod \"prometheus-k8s-0\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.257853 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.257820 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:24.962895 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:24.962840 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:25.063561 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:25.063521 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:28.374888 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.374845 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6d856744-vqgdf"] Aug 01 05:44:28.385577 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:44:28.385531 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod893d42e5_15ec_42b2_b14c_c344164c91da.slice/crio-19cdd4a19e994270f9ecc05fe78cd15eb98a326b0b4dd2ce90ad8f8617d69737 WatchSource:0}: Error finding container 19cdd4a19e994270f9ecc05fe78cd15eb98a326b0b4dd2ce90ad8f8617d69737: Status 404 returned error can't find the container with id 19cdd4a19e994270f9ecc05fe78cd15eb98a326b0b4dd2ce90ad8f8617d69737 Aug 01 05:44:28.410944 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.405033 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89"] Aug 01 05:44:28.410944 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.407833 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c"] Aug 01 05:44:28.529073 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.528196 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7tpxx" event={"ID":"56ff8bc5-1382-49d6-8c80-27b2f5f144f9","Type":"ContainerStarted","Data":"d855212995ebbae23f872f5931031ede1ceb81c72bb7d5998d8e9a07afd22b7b"} Aug 01 05:44:28.529073 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.529014 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:44:28.535274 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.535166 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-msxst" event={"ID":"e3f7d27a-a848-4229-81ce-386e082b4f22","Type":"ContainerStarted","Data":"b3003a0b98176e1822aedda62fff94859ed216828c2613d4319ba2640928bd22"} Aug 01 05:44:28.542172 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.542067 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" event={"ID":"274ca062-20d2-4b1d-8024-1b4423f625bf","Type":"ContainerStarted","Data":"2b8076f7c72be317d9668d963eebb5b1b552aec7ba431a1f48bff0d99c913d29"} Aug 01 05:44:28.542172 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.542121 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" event={"ID":"274ca062-20d2-4b1d-8024-1b4423f625bf","Type":"ContainerStarted","Data":"509fc413a194ffaa19cb481150023353d0ad69730490cf00fb953511ed84a6c9"} Aug 01 05:44:28.546771 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.546735 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-bhmjp" event={"ID":"2b7b54aa-c0cc-4706-b611-e8dac31f1d75","Type":"ContainerStarted","Data":"92c2a632c8493bce5f432018316f7586193aa148297b099a88e6a1f8fcc84653"} Aug 01 05:44:28.549383 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.549367 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-bhmjp" Aug 01 05:44:28.549851 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.549812 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7tpxx" podStartSLOduration=65.760625111 podStartE2EDuration="1m18.549795549s" totalImagesPullingTime="12.789170438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:28.545069422 +0000 UTC m=+78.941253562" watchObservedRunningTime="2026-08-01 05:44:28.549795549 +0000 UTC m=+78.945979686" Aug 01 05:44:28.550823 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.550780 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6d856744-vqgdf" event={"ID":"893d42e5-15ec-42b2-b14c-c344164c91da","Type":"ContainerStarted","Data":"19cdd4a19e994270f9ecc05fe78cd15eb98a326b0b4dd2ce90ad8f8617d69737"} Aug 01 05:44:28.552749 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.552727 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" event={"ID":"d64ed186-4a7a-40b0-a36a-b84931d651f6","Type":"ContainerStarted","Data":"be6f15157adefc50fac78b9595c2aa43670a5c2fec42a9c865abc5418c411cb6"} Aug 01 05:44:28.554414 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.554373 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6hmm" event={"ID":"ca172704-89ee-49fe-8d1d-a1b29cb3a140","Type":"ContainerStarted","Data":"4af9638cf7759c47f0089d96eb429bc5ccdce210ff1ede7455a0212de3813f06"} Aug 01 05:44:28.559646 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.559117 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wkpzk" event={"ID":"54bfe892-21bb-4ece-b41c-f7b533281c1a","Type":"ContainerStarted","Data":"01a6b65dfae8d3355d109a9934e4074116e5f00bcca1ecfb2896e69d1c27ef15"} Aug 01 05:44:28.564705 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.564685 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-bhmjp" Aug 01 05:44:28.566080 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.566029 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-bhmjp" podStartSLOduration=1.5636009149999999 podStartE2EDuration="19.566013704s" totalImagesPullingTime="18.002412789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:28.564368213 +0000 UTC m=+78.960552350" watchObservedRunningTime="2026-08-01 05:44:28.566013704 +0000 UTC m=+78.962197848" Aug 01 05:44:28.601700 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.601103 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wkpzk" podStartSLOduration=65.838065845 podStartE2EDuration="1m18.601079414s" totalImagesPullingTime="12.763013569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:28.583387039 +0000 UTC m=+78.979571179" watchObservedRunningTime="2026-08-01 05:44:28.601079414 +0000 UTC m=+78.997263555" Aug 01 05:44:28.674434 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.671688 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:44:28.674434 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.671841 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj"] Aug 01 05:44:28.678205 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.675190 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-769cfbc494-mvm8w"] Aug 01 05:44:28.690984 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.688510 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-69f475d4cb-46qpk"] Aug 01 05:44:28.696304 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.696276 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:44:28.763595 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.763469 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:28.863787 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:28.863708 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:29.603695 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:29.603587 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" event={"ID":"274ca062-20d2-4b1d-8024-1b4423f625bf","Type":"ContainerStarted","Data":"3ef209fee39d0782dfb161e39c5247235ba00a71a0a880d38fa9fa8cd6a14e80"} Aug 01 05:44:29.610102 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:29.610007 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" event={"ID":"91d7d46e-44c1-43e0-a9f6-5cb832029ec8","Type":"ContainerStarted","Data":"fbf3434f9bb8ca7d6644f1b9ff2df7cfbf12a296d34c21123eaf3a2eac74df0f"} Aug 01 05:44:29.615318 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:29.615215 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" event={"ID":"34668055-10ab-4a09-83ea-79bad5c73dfc","Type":"ContainerStarted","Data":"ebd51cf396e62774707cd5c5a6f773005469687bdc21ba4750516c6a601976fb"} Aug 01 05:44:29.619624 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:29.619594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerStarted","Data":"847dda79bbf84b33c4f6abeb3d380b8d1275902ae5c2a25fc5fc672a9b36e2ad"} Aug 01 05:44:29.623058 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:29.622968 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerStarted","Data":"311a04b4c1fe9f2fe4468eb7e5204d82f7d719f3655ce88ac9d157935804dd90"} Aug 01 05:44:29.639656 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:29.638800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" event={"ID":"b346db4e-464b-49fd-970b-24904b3e3bc5","Type":"ContainerStarted","Data":"9603939985d9b4fde8858d5a135da272a87ea9a9bba3ce483c65d17ea094891c"} Aug 01 05:44:32.542798 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:32.542620 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:32.643106 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:32.643031 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:33.109967 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:33.109925 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:33.159613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:33.159577 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:36.990217 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:36.990181 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:38.687583 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.687310 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" event={"ID":"34668055-10ab-4a09-83ea-79bad5c73dfc","Type":"ContainerStarted","Data":"6dbec4686b6bc090ac110f33edda627c66c67a8a790fa008d04355c53bbc7684"} Aug 01 05:44:38.687583 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.687524 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:38.689267 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.689242 2561 generic.go:356] "Generic (PLEG): container finished" podID="b5a19d3d-9434-4321-bb88-f79053450afa" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" exitCode=0 Aug 01 05:44:38.689409 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.689270 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerDied","Data":"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad"} Aug 01 05:44:38.691477 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.691349 2561 generic.go:356] "Generic (PLEG): container finished" podID="ca172704-89ee-49fe-8d1d-a1b29cb3a140" containerID="9ec78ddaf2771db079c9ad936d8a015256cda0f20e03c1049e1bcf15e5ff7a54" exitCode=0 Aug 01 05:44:38.691477 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.691430 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6hmm" event={"ID":"ca172704-89ee-49fe-8d1d-a1b29cb3a140","Type":"ContainerDied","Data":"9ec78ddaf2771db079c9ad936d8a015256cda0f20e03c1049e1bcf15e5ff7a54"} Aug 01 05:44:38.693170 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.693150 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" Aug 01 05:44:38.693289 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.693185 2561 generic.go:356] "Generic (PLEG): container finished" podID="64dafae2-4857-4252-ac3b-137180beaf55" containerID="6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608" exitCode=0 Aug 01 05:44:38.693289 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.693189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerDied","Data":"6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608"} Aug 01 05:44:38.697034 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.696141 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-msxst" event={"ID":"e3f7d27a-a848-4229-81ce-386e082b4f22","Type":"ContainerStarted","Data":"0f7d188a5006232ab68018c1402741bcca0c40852fa2f8eb55cf07febe318902"} Aug 01 05:44:38.698808 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.698785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6d856744-vqgdf" event={"ID":"893d42e5-15ec-42b2-b14c-c344164c91da","Type":"ContainerStarted","Data":"ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953"} Aug 01 05:44:38.700958 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.700932 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" event={"ID":"d64ed186-4a7a-40b0-a36a-b84931d651f6","Type":"ContainerStarted","Data":"3e092335d405f547591b4e410ae8ed5924c2af8a27146800b9e82b06a4e35a57"} Aug 01 05:44:38.701095 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.700976 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" event={"ID":"d64ed186-4a7a-40b0-a36a-b84931d651f6","Type":"ContainerStarted","Data":"dc76f9ead9996be7bf95e75fd1384759a2fca6b6f6b09129a29d7fe9bc686f82"} Aug 01 05:44:38.701095 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.701002 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" event={"ID":"d64ed186-4a7a-40b0-a36a-b84931d651f6","Type":"ContainerStarted","Data":"ac10ce03056c54a6882684ab81b2359cc990306fa34d40e95a23ac22db50e97b"} Aug 01 05:44:38.702206 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.702172 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-mlfnj" podStartSLOduration=7.765839729 podStartE2EDuration="16.702159488s" totalImagesPullingTime="8.936319759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:38.701744887 +0000 UTC m=+89.097929029" watchObservedRunningTime="2026-08-01 05:44:38.702159488 +0000 UTC m=+89.098343628" Aug 01 05:44:38.703801 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.703774 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" event={"ID":"b346db4e-464b-49fd-970b-24904b3e3bc5","Type":"ContainerStarted","Data":"ad988066a0687606050a8f14fec4bcead4607082c33f3d6fe114934a19723573"} Aug 01 05:44:38.703885 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.703827 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" event={"ID":"b346db4e-464b-49fd-970b-24904b3e3bc5","Type":"ContainerStarted","Data":"64dbd72d2dab7440d62a97ce1e037e71a56e77e4e0e6d7e855c73b21e9d719ac"} Aug 01 05:44:38.703885 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.703855 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" event={"ID":"b346db4e-464b-49fd-970b-24904b3e3bc5","Type":"ContainerStarted","Data":"f18b248bd869653edda2c0f92c7179690f04d49d54d02834aaa7dad75c66ff4a"} Aug 01 05:44:38.705798 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.705766 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" event={"ID":"274ca062-20d2-4b1d-8024-1b4423f625bf","Type":"ContainerStarted","Data":"1d9bb1f948f0a029dc121ca6d82a921df65c8e18a48f778cd90c5ee148d14597"} Aug 01 05:44:38.707203 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.707183 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" event={"ID":"91d7d46e-44c1-43e0-a9f6-5cb832029ec8","Type":"ContainerStarted","Data":"922b76c4f7e3fa190ad060e1a455c7f8691b557edd1cb25b9a3113e23e562fa0"} Aug 01 05:44:38.742116 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.742093 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6d856744-vqgdf"] Aug 01 05:44:38.779582 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.779463 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-msxst" podStartSLOduration=9.927826523 podStartE2EDuration="29.779445314s" totalImagesPullingTime="19.851618791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 05:44:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:38.779111738 +0000 UTC m=+89.175295877" watchObservedRunningTime="2026-08-01 05:44:38.779445314 +0000 UTC m=+89.175629454" Aug 01 05:44:38.817309 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.817254 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d6d856744-vqgdf" podStartSLOduration=10.58853291 podStartE2EDuration="19.817216841s" totalImagesPullingTime="9.228683931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:38.815901712 +0000 UTC m=+89.212085850" watchObservedRunningTime="2026-08-01 05:44:38.817216841 +0000 UTC m=+89.213400982" Aug 01 05:44:38.833425 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.833390 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:38.848118 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.848068 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-8fc6c" podStartSLOduration=12.642693211 podStartE2EDuration="21.848050107s" totalImagesPullingTime="9.205356896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:38.845831498 +0000 UTC m=+89.242015637" watchObservedRunningTime="2026-08-01 05:44:38.848050107 +0000 UTC m=+89.244234246" Aug 01 05:44:38.863628 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.863568 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" podStartSLOduration=7.930133854 podStartE2EDuration="16.863549929s" totalImagesPullingTime="8.933416075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:38.863166182 +0000 UTC m=+89.259350323" watchObservedRunningTime="2026-08-01 05:44:38.863549929 +0000 UTC m=+89.259734079" Aug 01 05:44:38.887516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.887435 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-7kq89" podStartSLOduration=12.925722309 podStartE2EDuration="21.887414208s" totalImagesPullingTime="8.961691899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:38.885379148 +0000 UTC m=+89.281563287" watchObservedRunningTime="2026-08-01 05:44:38.887414208 +0000 UTC m=+89.283598350" Aug 01 05:44:38.889931 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:38.889905 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:39.393361 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.393327 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:39.493248 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.493214 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:39.697963 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.697755 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:39.697963 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.697878 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:39.704676 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.704491 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:39.719476 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.719413 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" event={"ID":"b346db4e-464b-49fd-970b-24904b3e3bc5","Type":"ContainerStarted","Data":"4d65555fde85d4a9df069dc837cfbc9e10ae6b958000ea11076cb18091210bf8"} Aug 01 05:44:39.728387 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.728266 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6hmm" event={"ID":"ca172704-89ee-49fe-8d1d-a1b29cb3a140","Type":"ContainerStarted","Data":"d55ada3880cce49bf25e9b412e1e6521af1b4bbdd640e173f39d0942ca259bda"} Aug 01 05:44:39.728387 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.728330 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c6hmm" event={"ID":"ca172704-89ee-49fe-8d1d-a1b29cb3a140","Type":"ContainerStarted","Data":"8cbb0d7942555042c83c907642b061dc536605dc15cd5dff8bf696213de3ebb4"} Aug 01 05:44:39.736265 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.736200 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:44:39.748367 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:39.748315 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c6hmm" podStartSLOduration=13.178700406 podStartE2EDuration="22.748293892s" totalImagesPullingTime="9.466053933s" totalInitContainerRuntime="103.539553ms" isStatefulPod=true podCreationTimestamp="2026-08-01 05:44:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:39.74447472 +0000 UTC m=+90.140658859" watchObservedRunningTime="2026-08-01 05:44:39.748293892 +0000 UTC m=+90.144478033" Aug 01 05:44:40.736378 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:40.736335 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" event={"ID":"b346db4e-464b-49fd-970b-24904b3e3bc5","Type":"ContainerStarted","Data":"b3c0d14efbf692aa90f1dc4e8806f276040e57b45f4fc2b6b0d692941d0bc412"} Aug 01 05:44:40.736935 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:40.736422 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" event={"ID":"b346db4e-464b-49fd-970b-24904b3e3bc5","Type":"ContainerStarted","Data":"a19a5de8f245e5c6a450a0f5d1b1483052506d5389643f96cf9d4850151f9455"} Aug 01 05:44:40.757541 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:40.757482 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" podStartSLOduration=11.451440664 podStartE2EDuration="21.757465781s" totalImagesPullingTime="10.306025117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:40.755673113 +0000 UTC m=+91.151857255" watchObservedRunningTime="2026-08-01 05:44:40.757465781 +0000 UTC m=+91.153649920" Aug 01 05:44:41.742427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:41.742387 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:42.337907 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:42.337863 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:42.338083 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:42.337933 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:44:42.752641 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:42.752608 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerStarted","Data":"6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9"} Aug 01 05:44:42.753004 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:42.752694 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerStarted","Data":"c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11"} Aug 01 05:44:43.760743 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.760658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerStarted","Data":"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a"} Aug 01 05:44:43.760743 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.760737 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerStarted","Data":"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961"} Aug 01 05:44:43.761281 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.760776 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerStarted","Data":"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c"} Aug 01 05:44:43.761281 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.760819 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerStarted","Data":"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283"} Aug 01 05:44:43.761281 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.760862 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerStarted","Data":"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de"} Aug 01 05:44:43.761281 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.760904 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerStarted","Data":"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1"} Aug 01 05:44:43.763917 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.763886 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerStarted","Data":"895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa"} Aug 01 05:44:43.764050 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.763955 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerStarted","Data":"799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b"} Aug 01 05:44:43.764050 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.764003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerStarted","Data":"ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f"} Aug 01 05:44:43.764050 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.764040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerStarted","Data":"38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09"} Aug 01 05:44:43.788624 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.788562 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.616491839 podStartE2EDuration="20.788542297s" totalImagesPullingTime="13.138488305s" totalInitContainerRuntime="33.562153ms" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:43.786491585 +0000 UTC m=+94.182675760" watchObservedRunningTime="2026-08-01 05:44:43.788542297 +0000 UTC m=+94.184726440" Aug 01 05:44:43.810607 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:43.810562 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=13.053756798 podStartE2EDuration="25.810547907s" totalImagesPullingTime="12.737754843s" totalInitContainerRuntime="19.036266ms" isStatefulPod=false podCreationTimestamp="2026-08-01 05:44:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:44:43.80850092 +0000 UTC m=+94.204685058" watchObservedRunningTime="2026-08-01 05:44:43.810547907 +0000 UTC m=+94.206732045" Aug 01 05:44:44.258827 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:44.258791 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:44:44.599162 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:44.599077 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:44.644793 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:44.644763 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:47.759272 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:47.759220 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-69f475d4cb-46qpk" Aug 01 05:44:56.894432 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:56.894372 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:56.944885 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:56.944850 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:59.599879 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:59.599845 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:44:59.651746 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:44:59.651711 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:00.650726 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:00.650686 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7tpxx" Aug 01 05:45:02.342419 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:02.342388 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:45:02.346090 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:02.346067 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-769cfbc494-mvm8w" Aug 01 05:45:05.762917 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:05.762841 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d6d856744-vqgdf" podUID="893d42e5-15ec-42b2-b14c-c344164c91da" containerName="console" containerID="cri-o://ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953" gracePeriod=15 Aug 01 05:45:06.036743 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.036674 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:45:06.139063 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139027 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9r5p\" (UniqueName: \"kubernetes.io/projected/893d42e5-15ec-42b2-b14c-c344164c91da-kube-api-access-z9r5p\") pod \"893d42e5-15ec-42b2-b14c-c344164c91da\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " Aug 01 05:45:06.139299 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139085 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-serving-cert\") pod \"893d42e5-15ec-42b2-b14c-c344164c91da\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " Aug 01 05:45:06.139299 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139119 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-service-ca\") pod \"893d42e5-15ec-42b2-b14c-c344164c91da\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " Aug 01 05:45:06.139299 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139137 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-oauth-config\") pod \"893d42e5-15ec-42b2-b14c-c344164c91da\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " Aug 01 05:45:06.139299 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139172 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-oauth-serving-cert\") pod \"893d42e5-15ec-42b2-b14c-c344164c91da\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " Aug 01 05:45:06.139299 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139217 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-console-config\") pod \"893d42e5-15ec-42b2-b14c-c344164c91da\" (UID: \"893d42e5-15ec-42b2-b14c-c344164c91da\") " Aug 01 05:45:06.139655 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139622 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-service-ca" (OuterVolumeSpecName: "service-ca") pod "893d42e5-15ec-42b2-b14c-c344164c91da" (UID: "893d42e5-15ec-42b2-b14c-c344164c91da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:06.139715 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139628 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "893d42e5-15ec-42b2-b14c-c344164c91da" (UID: "893d42e5-15ec-42b2-b14c-c344164c91da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:06.139715 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.139637 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-console-config" (OuterVolumeSpecName: "console-config") pod "893d42e5-15ec-42b2-b14c-c344164c91da" (UID: "893d42e5-15ec-42b2-b14c-c344164c91da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:06.141534 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.141509 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "893d42e5-15ec-42b2-b14c-c344164c91da" (UID: "893d42e5-15ec-42b2-b14c-c344164c91da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:06.141624 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.141557 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/893d42e5-15ec-42b2-b14c-c344164c91da-kube-api-access-z9r5p" (OuterVolumeSpecName: "kube-api-access-z9r5p") pod "893d42e5-15ec-42b2-b14c-c344164c91da" (UID: "893d42e5-15ec-42b2-b14c-c344164c91da"). InnerVolumeSpecName "kube-api-access-z9r5p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 05:45:06.141624 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.141568 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "893d42e5-15ec-42b2-b14c-c344164c91da" (UID: "893d42e5-15ec-42b2-b14c-c344164c91da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:06.240360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.240321 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9r5p\" (UniqueName: \"kubernetes.io/projected/893d42e5-15ec-42b2-b14c-c344164c91da-kube-api-access-z9r5p\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:06.240360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.240353 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-serving-cert\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:06.240360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.240362 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-service-ca\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:06.240360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.240372 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/893d42e5-15ec-42b2-b14c-c344164c91da-console-oauth-config\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:06.240618 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.240380 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-oauth-serving-cert\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:06.240618 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.240389 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/893d42e5-15ec-42b2-b14c-c344164c91da-console-config\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:06.812945 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.812912 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:06.858290 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.858256 2561 generic.go:356] "Generic (PLEG): container finished" podID="893d42e5-15ec-42b2-b14c-c344164c91da" containerID="ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953" exitCode=0 Aug 01 05:45:06.858440 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.858311 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6d856744-vqgdf" Aug 01 05:45:06.858440 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.858340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6d856744-vqgdf" event={"ID":"893d42e5-15ec-42b2-b14c-c344164c91da","Type":"ContainerDied","Data":"ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953"} Aug 01 05:45:06.858440 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.858401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6d856744-vqgdf" event={"ID":"893d42e5-15ec-42b2-b14c-c344164c91da","Type":"ContainerDied","Data":"19cdd4a19e994270f9ecc05fe78cd15eb98a326b0b4dd2ce90ad8f8617d69737"} Aug 01 05:45:06.858440 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.858423 2561 scope.go:117] "RemoveContainer" containerID="ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953" Aug 01 05:45:06.866825 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.866806 2561 scope.go:117] "RemoveContainer" containerID="ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953" Aug 01 05:45:06.867081 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:06.867064 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953\": container with ID starting with ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953 not found: ID does not exist" containerID="ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953" Aug 01 05:45:06.867145 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.867088 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953"} err="failed to get container status \"ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953\": rpc error: code = NotFound desc = could not find container \"ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953\": container with ID starting with ddd607eecfeb2a17e567ac420dfe55707cacbd1aa2962f10796285b60d8ff953 not found: ID does not exist" Aug 01 05:45:06.878153 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.878129 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6d856744-vqgdf"] Aug 01 05:45:06.879959 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.879939 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d6d856744-vqgdf"] Aug 01 05:45:06.881799 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.881781 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:06.930285 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:06.930255 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:08.092495 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:08.092462 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="893d42e5-15ec-42b2-b14c-c344164c91da" path="/var/lib/kubelet/pods/893d42e5-15ec-42b2-b14c-c344164c91da/volumes" Aug 01 05:45:24.258887 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:24.258849 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:24.345180 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:24.345151 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:24.944189 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:24.944162 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:36.937165 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:36.937082 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:37.365538 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:37.365453 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:37.988577 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:37.988545 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:45:37.989001 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:37.988811 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="alertmanager" containerID="cri-o://c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11" gracePeriod=120 Aug 01 05:45:37.989001 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:37.988879 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy-metric" containerID="cri-o://799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b" gracePeriod=120 Aug 01 05:45:37.989001 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:37.988929 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="prom-label-proxy" containerID="cri-o://895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa" gracePeriod=120 Aug 01 05:45:37.989001 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:37.988944 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy-web" containerID="cri-o://38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09" gracePeriod=120 Aug 01 05:45:37.989001 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:37.988957 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="config-reloader" containerID="cri-o://6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9" gracePeriod=120 Aug 01 05:45:37.989001 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:37.988981 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy" containerID="cri-o://ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f" gracePeriod=120 Aug 01 05:45:38.985729 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985692 2561 generic.go:356] "Generic (PLEG): container finished" podID="64dafae2-4857-4252-ac3b-137180beaf55" containerID="895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa" exitCode=0 Aug 01 05:45:38.985729 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985721 2561 generic.go:356] "Generic (PLEG): container finished" podID="64dafae2-4857-4252-ac3b-137180beaf55" containerID="799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b" exitCode=0 Aug 01 05:45:38.985729 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985727 2561 generic.go:356] "Generic (PLEG): container finished" podID="64dafae2-4857-4252-ac3b-137180beaf55" containerID="ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f" exitCode=0 Aug 01 05:45:38.985729 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985733 2561 generic.go:356] "Generic (PLEG): container finished" podID="64dafae2-4857-4252-ac3b-137180beaf55" containerID="6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9" exitCode=0 Aug 01 05:45:38.985729 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985738 2561 generic.go:356] "Generic (PLEG): container finished" podID="64dafae2-4857-4252-ac3b-137180beaf55" containerID="c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11" exitCode=0 Aug 01 05:45:38.986032 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985765 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerDied","Data":"895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa"} Aug 01 05:45:38.986032 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985854 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerDied","Data":"799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b"} Aug 01 05:45:38.986032 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985881 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerDied","Data":"ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f"} Aug 01 05:45:38.986032 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985906 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerDied","Data":"6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9"} Aug 01 05:45:38.986032 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:38.985929 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerDied","Data":"c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11"} Aug 01 05:45:39.228911 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.228890 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:39.325753 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325670 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-main-db\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.325753 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325709 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-metrics-client-ca\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.325753 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325727 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-web\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325756 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-cluster-tls-config\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325790 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-web-config\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325855 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325885 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325910 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-metric\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326011 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.325953 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-config-volume\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326351 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326016 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-config-out\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326351 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326045 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqxqn\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-kube-api-access-lqxqn\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326351 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326093 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326351 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326108 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:39.326351 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326143 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-tls-assets\") pod \"64dafae2-4857-4252-ac3b-137180beaf55\" (UID: \"64dafae2-4857-4252-ac3b-137180beaf55\") " Aug 01 05:45:39.326603 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326341 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:39.326603 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326449 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.326603 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326471 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64dafae2-4857-4252-ac3b-137180beaf55-metrics-client-ca\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.326868 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.326838 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 05:45:39.329532 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.329503 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 05:45:39.329710 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.329687 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:39.329805 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.329743 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-config-out" (OuterVolumeSpecName: "config-out") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 05:45:39.329805 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.329776 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:39.329920 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.329847 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-kube-api-access-lqxqn" (OuterVolumeSpecName: "kube-api-access-lqxqn") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "kube-api-access-lqxqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 05:45:39.330045 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.330024 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:39.330361 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.330334 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:39.330685 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.330669 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-config-volume" (OuterVolumeSpecName: "config-volume") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:39.334135 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.334113 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:39.340847 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.340823 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-web-config" (OuterVolumeSpecName: "web-config") pod "64dafae2-4857-4252-ac3b-137180beaf55" (UID: "64dafae2-4857-4252-ac3b-137180beaf55"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:39.427663 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427621 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427663 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427656 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427663 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427667 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-config-volume\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427676 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-config-out\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427685 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqxqn\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-kube-api-access-lqxqn\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427695 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-main-tls\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427703 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/64dafae2-4857-4252-ac3b-137180beaf55-tls-assets\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427712 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/64dafae2-4857-4252-ac3b-137180beaf55-alertmanager-main-db\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427720 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427729 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-cluster-tls-config\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.427870 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.427738 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/64dafae2-4857-4252-ac3b-137180beaf55-web-config\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:39.695654 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.695626 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:39.746758 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.746721 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:39.993362 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.993284 2561 generic.go:356] "Generic (PLEG): container finished" podID="64dafae2-4857-4252-ac3b-137180beaf55" containerID="38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09" exitCode=0 Aug 01 05:45:39.993362 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.993358 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:39.993516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.993368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerDied","Data":"38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09"} Aug 01 05:45:39.993516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.993441 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"64dafae2-4857-4252-ac3b-137180beaf55","Type":"ContainerDied","Data":"311a04b4c1fe9f2fe4468eb7e5204d82f7d719f3655ce88ac9d157935804dd90"} Aug 01 05:45:39.993516 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:39.993476 2561 scope.go:117] "RemoveContainer" containerID="895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa" Aug 01 05:45:40.001272 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.001163 2561 scope.go:117] "RemoveContainer" containerID="799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b" Aug 01 05:45:40.007830 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.007810 2561 scope.go:117] "RemoveContainer" containerID="ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f" Aug 01 05:45:40.014705 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.014687 2561 scope.go:117] "RemoveContainer" containerID="38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09" Aug 01 05:45:40.020023 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.019999 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:45:40.022242 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.022213 2561 scope.go:117] "RemoveContainer" containerID="6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9" Aug 01 05:45:40.025597 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.025577 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:45:40.030141 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.030125 2561 scope.go:117] "RemoveContainer" containerID="c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11" Aug 01 05:45:40.037916 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.037899 2561 scope.go:117] "RemoveContainer" containerID="6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608" Aug 01 05:45:40.045646 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.045633 2561 scope.go:117] "RemoveContainer" containerID="895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa" Aug 01 05:45:40.045888 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:40.045869 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa\": container with ID starting with 895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa not found: ID does not exist" containerID="895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa" Aug 01 05:45:40.045946 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.045894 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa"} err="failed to get container status \"895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa\": rpc error: code = NotFound desc = could not find container \"895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa\": container with ID starting with 895d4ed61cfff759eb5211ee9c554e8ccdb78d64d003f9b72f76727f82e175fa not found: ID does not exist" Aug 01 05:45:40.045946 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.045911 2561 scope.go:117] "RemoveContainer" containerID="799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b" Aug 01 05:45:40.046088 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:40.046073 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b\": container with ID starting with 799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b not found: ID does not exist" containerID="799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b" Aug 01 05:45:40.046125 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.046095 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b"} err="failed to get container status \"799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b\": rpc error: code = NotFound desc = could not find container \"799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b\": container with ID starting with 799e7e0fd3e8c01a9f26f3073a8ca75fa5df5c303dbf02365416b81251248d7b not found: ID does not exist" Aug 01 05:45:40.046125 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.046110 2561 scope.go:117] "RemoveContainer" containerID="ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f" Aug 01 05:45:40.046342 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:40.046324 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f\": container with ID starting with ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f not found: ID does not exist" containerID="ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f" Aug 01 05:45:40.046397 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.046347 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f"} err="failed to get container status \"ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f\": rpc error: code = NotFound desc = could not find container \"ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f\": container with ID starting with ee66548ef75f7ae5e77278e0fc9ba2d0f44c95db212f274a57bbf98efdc4aa9f not found: ID does not exist" Aug 01 05:45:40.046397 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.046364 2561 scope.go:117] "RemoveContainer" containerID="38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09" Aug 01 05:45:40.046672 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:40.046648 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09\": container with ID starting with 38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09 not found: ID does not exist" containerID="38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09" Aug 01 05:45:40.046769 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.046682 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09"} err="failed to get container status \"38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09\": rpc error: code = NotFound desc = could not find container \"38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09\": container with ID starting with 38136e64ace047b639af1566a6619911b7f15e4875ac04254be3e440b2b01f09 not found: ID does not exist" Aug 01 05:45:40.046769 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.046704 2561 scope.go:117] "RemoveContainer" containerID="6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9" Aug 01 05:45:40.047380 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:40.047255 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9\": container with ID starting with 6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9 not found: ID does not exist" containerID="6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9" Aug 01 05:45:40.047380 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.047292 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9"} err="failed to get container status \"6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9\": rpc error: code = NotFound desc = could not find container \"6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9\": container with ID starting with 6a19f1c528700b2508ace2b8bd0a91e3bf30f27a92e357e28ffb76ab6b15b8d9 not found: ID does not exist" Aug 01 05:45:40.047380 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.047314 2561 scope.go:117] "RemoveContainer" containerID="c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11" Aug 01 05:45:40.047699 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:40.047668 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11\": container with ID starting with c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11 not found: ID does not exist" containerID="c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11" Aug 01 05:45:40.047817 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.047699 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11"} err="failed to get container status \"c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11\": rpc error: code = NotFound desc = could not find container \"c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11\": container with ID starting with c427a948a67329afb388a68ac69f2fb26483f9e70f4f25f70eccc9d9b5938a11 not found: ID does not exist" Aug 01 05:45:40.047817 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.047720 2561 scope.go:117] "RemoveContainer" containerID="6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608" Aug 01 05:45:40.048010 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:40.047980 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608\": container with ID starting with 6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608 not found: ID does not exist" containerID="6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608" Aug 01 05:45:40.048066 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.048006 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608"} err="failed to get container status \"6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608\": rpc error: code = NotFound desc = could not find container \"6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608\": container with ID starting with 6db0701045a6fc1ab25d7d333d75977b2a3f97f8ed71b936ff9b06b64c36d608 not found: ID does not exist" Aug 01 05:45:40.049382 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049364 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:45:40.049727 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049712 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="893d42e5-15ec-42b2-b14c-c344164c91da" containerName="console" Aug 01 05:45:40.049768 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049731 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="893d42e5-15ec-42b2-b14c-c344164c91da" containerName="console" Aug 01 05:45:40.049768 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049752 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="alertmanager" Aug 01 05:45:40.049768 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049761 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="alertmanager" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049771 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy-web" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049780 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy-web" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049790 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy-metric" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049799 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy-metric" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049815 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="config-reloader" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049823 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="config-reloader" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049839 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049848 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy" Aug 01 05:45:40.049869 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049866 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="prom-label-proxy" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049876 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="prom-label-proxy" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049892 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="init-config-reloader" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049898 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="init-config-reloader" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049971 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy-metric" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.049985 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="config-reloader" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.050002 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="alertmanager" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.050011 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.050023 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="893d42e5-15ec-42b2-b14c-c344164c91da" containerName="console" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.050032 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="kube-rbac-proxy-web" Aug 01 05:45:40.050225 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.050039 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dafae2-4857-4252-ac3b-137180beaf55" containerName="prom-label-proxy" Aug 01 05:45:40.053533 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.053508 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.056313 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056291 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Aug 01 05:45:40.056424 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056404 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Aug 01 05:45:40.056593 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056578 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Aug 01 05:45:40.056669 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056622 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Aug 01 05:45:40.056729 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056664 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Aug 01 05:45:40.056729 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056670 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Aug 01 05:45:40.056833 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056818 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Aug 01 05:45:40.056979 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056955 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Aug 01 05:45:40.057043 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.056955 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rgjx7\"" Aug 01 05:45:40.060813 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.060793 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Aug 01 05:45:40.067602 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.067581 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:45:40.093338 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.093310 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64dafae2-4857-4252-ac3b-137180beaf55" path="/var/lib/kubelet/pods/64dafae2-4857-4252-ac3b-137180beaf55/volumes" Aug 01 05:45:40.133298 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133275 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133316 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f69459d6-d3e4-4567-813a-9d78246367e8-config-out\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133451 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f69459d6-d3e4-4567-813a-9d78246367e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133472 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f69459d6-d3e4-4567-813a-9d78246367e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133508 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nws62\" (UniqueName: \"kubernetes.io/projected/f69459d6-d3e4-4567-813a-9d78246367e8-kube-api-access-nws62\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133570 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133588 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-web-config\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133799 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133615 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69459d6-d3e4-4567-813a-9d78246367e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.133799 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.133643 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f69459d6-d3e4-4567-813a-9d78246367e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.234659 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234629 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f69459d6-d3e4-4567-813a-9d78246367e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234672 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f69459d6-d3e4-4567-813a-9d78246367e8-config-out\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234772 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234795 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f69459d6-d3e4-4567-813a-9d78246367e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234840 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f69459d6-d3e4-4567-813a-9d78246367e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234947 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nws62\" (UniqueName: \"kubernetes.io/projected/f69459d6-d3e4-4567-813a-9d78246367e8-kube-api-access-nws62\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.234982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.235003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-web-config\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.235033 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69459d6-d3e4-4567-813a-9d78246367e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235077 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.235062 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f69459d6-d3e4-4567-813a-9d78246367e8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.235768 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.235651 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f69459d6-d3e4-4567-813a-9d78246367e8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.236491 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.236435 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f69459d6-d3e4-4567-813a-9d78246367e8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.237715 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.237678 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f69459d6-d3e4-4567-813a-9d78246367e8-config-out\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.237838 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.237817 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.238675 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.238099 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f69459d6-d3e4-4567-813a-9d78246367e8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.238675 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.238287 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.238675 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.238519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.238675 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.238547 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-web-config\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.239013 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.238990 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.239489 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.239469 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.239607 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.239586 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f69459d6-d3e4-4567-813a-9d78246367e8-config-volume\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.243557 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.243513 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nws62\" (UniqueName: \"kubernetes.io/projected/f69459d6-d3e4-4567-813a-9d78246367e8-kube-api-access-nws62\") pod \"alertmanager-main-0\" (UID: \"f69459d6-d3e4-4567-813a-9d78246367e8\") " pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.365801 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.365767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Aug 01 05:45:40.502382 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.502357 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Aug 01 05:45:40.504511 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:45:40.504483 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69459d6_d3e4_4567_813a_9d78246367e8.slice/crio-19b941b2a843be64a191607ebf0bd550a85637ccf5f08b974c785c0006c0bc2f WatchSource:0}: Error finding container 19b941b2a843be64a191607ebf0bd550a85637ccf5f08b974c785c0006c0bc2f: Status 404 returned error can't find the container with id 19b941b2a843be64a191607ebf0bd550a85637ccf5f08b974c785c0006c0bc2f Aug 01 05:45:40.999924 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.999889 2561 generic.go:356] "Generic (PLEG): container finished" podID="f69459d6-d3e4-4567-813a-9d78246367e8" containerID="0349eb99810a4671dce0c54c0df6f685fbf8760f44ac29d515fe0c8438eb02e9" exitCode=0 Aug 01 05:45:41.000106 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:40.999978 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f69459d6-d3e4-4567-813a-9d78246367e8","Type":"ContainerDied","Data":"0349eb99810a4671dce0c54c0df6f685fbf8760f44ac29d515fe0c8438eb02e9"} Aug 01 05:45:41.000106 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:41.000062 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f69459d6-d3e4-4567-813a-9d78246367e8","Type":"ContainerStarted","Data":"19b941b2a843be64a191607ebf0bd550a85637ccf5f08b974c785c0006c0bc2f"} Aug 01 05:45:42.010420 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.010382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f69459d6-d3e4-4567-813a-9d78246367e8","Type":"ContainerStarted","Data":"5252b2b6234a165907c202ae1f8f172530a8ec30b32ed9a0e74adcdf1a39f2de"} Aug 01 05:45:42.010810 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.010453 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f69459d6-d3e4-4567-813a-9d78246367e8","Type":"ContainerStarted","Data":"95575d4f47d376a13d415cb6658aa77bd863cf545473f4146093c3342a59d735"} Aug 01 05:45:42.010810 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.010481 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f69459d6-d3e4-4567-813a-9d78246367e8","Type":"ContainerStarted","Data":"a2fe215baa5dc57d203aa24f13717f4a94ae6f5fc8b51e62c16fbc75fd9524de"} Aug 01 05:45:42.010810 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.010506 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f69459d6-d3e4-4567-813a-9d78246367e8","Type":"ContainerStarted","Data":"50754c4cc88507a2de824fd353a54ecc39740eaca282c577ce0caf9b42688e15"} Aug 01 05:45:42.010810 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.010530 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f69459d6-d3e4-4567-813a-9d78246367e8","Type":"ContainerStarted","Data":"87ac3bc5f8da5e0fb843a99cbc5929e509c5191a76b6be47aa7531ac9485a990"} Aug 01 05:45:42.010810 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.010555 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f69459d6-d3e4-4567-813a-9d78246367e8","Type":"ContainerStarted","Data":"b53dd9fdd9662fd69657089539b24a0574cb57b73ea260e49dc4c435256d875f"} Aug 01 05:45:42.021264 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.021213 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7546c9fbc-62b9x"] Aug 01 05:45:42.025350 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.025323 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.029154 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.029128 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Aug 01 05:45:42.029359 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.029278 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zsbt6\"" Aug 01 05:45:42.029359 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.029308 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Aug 01 05:45:42.029488 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.029408 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Aug 01 05:45:42.029488 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.029476 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Aug 01 05:45:42.029595 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.029578 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Aug 01 05:45:42.034054 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.034034 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Aug 01 05:45:42.038074 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.038055 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7546c9fbc-62b9x"] Aug 01 05:45:42.042885 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.042844 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.027914525 podStartE2EDuration="2.042828394s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.913869ms" isStatefulPod=false podCreationTimestamp="2026-08-01 05:45:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:45:42.038934865 +0000 UTC m=+152.435119021" watchObservedRunningTime="2026-08-01 05:45:42.042828394 +0000 UTC m=+152.439012533" Aug 01 05:45:42.154763 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.154725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-serving-certs-ca-bundle\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.154924 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.154782 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.154924 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.154809 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-federate-client-tls\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.154924 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.154835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-secret-telemeter-client\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.155075 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.154969 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.155075 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.155059 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-metrics-client-ca\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.155169 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.155085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgtqj\" (UniqueName: \"kubernetes.io/projected/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-kube-api-access-vgtqj\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.155222 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.155187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-telemeter-client-tls\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.256087 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.256047 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-serving-certs-ca-bundle\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.256087 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.256093 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.256342 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.256112 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-federate-client-tls\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.256446 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.256407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-secret-telemeter-client\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.256501 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.256474 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.256550 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.256510 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-metrics-client-ca\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.256607 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.256552 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgtqj\" (UniqueName: \"kubernetes.io/projected/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-kube-api-access-vgtqj\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.256607 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.256593 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-telemeter-client-tls\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.257381 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.257352 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-serving-certs-ca-bundle\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.257511 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.257478 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-metrics-client-ca\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.257890 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.257866 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.258839 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.258818 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.259188 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.259165 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-secret-telemeter-client\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.259188 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.259184 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-federate-client-tls\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.259417 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.259397 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-telemeter-client-tls\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.265426 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.265364 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgtqj\" (UniqueName: \"kubernetes.io/projected/6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34-kube-api-access-vgtqj\") pod \"telemeter-client-7546c9fbc-62b9x\" (UID: \"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34\") " pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.322623 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.322585 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:45:42.323040 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.322964 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="prometheus" containerID="cri-o://03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" gracePeriod=600 Aug 01 05:45:42.323040 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.322997 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" gracePeriod=600 Aug 01 05:45:42.323040 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.323009 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy-web" containerID="cri-o://ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" gracePeriod=600 Aug 01 05:45:42.323285 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.322994 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="thanos-sidecar" containerID="cri-o://6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" gracePeriod=600 Aug 01 05:45:42.323285 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.323014 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="config-reloader" containerID="cri-o://a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" gracePeriod=600 Aug 01 05:45:42.323285 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.322969 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy" containerID="cri-o://5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" gracePeriod=600 Aug 01 05:45:42.338720 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.338688 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" Aug 01 05:45:42.492416 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.492387 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7546c9fbc-62b9x"] Aug 01 05:45:42.494400 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:45:42.494369 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9f5ef3_fda5_4f4f_a3ee_5ba14c333c34.slice/crio-4f5b37306012750327bc2e4e91b39e20c6251577ed6d770cc7c5872c66b4bf7e WatchSource:0}: Error finding container 4f5b37306012750327bc2e4e91b39e20c6251577ed6d770cc7c5872c66b4bf7e: Status 404 returned error can't find the container with id 4f5b37306012750327bc2e4e91b39e20c6251577ed6d770cc7c5872c66b4bf7e Aug 01 05:45:42.576334 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.576303 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:42.662479 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662452 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-0\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662658 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662483 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-thanos-prometheus-http-client-file\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662658 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662506 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-config-out\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662658 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662546 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-web-config\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662658 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662577 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-db\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662658 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662624 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-serving-certs-ca-bundle\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662658 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662655 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-2\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662950 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662693 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662950 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662742 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662950 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662767 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-metrics-client-certs\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662950 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662800 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-kube-rbac-proxy\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662950 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662824 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-tls-assets\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662950 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662870 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-grpc-tls\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662950 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662896 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-metrics-client-ca\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.662950 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662927 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fv7z8\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-kube-api-access-fv7z8\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.663366 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662971 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-tls\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.663366 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.662995 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-config\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.663366 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663028 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-kubelet-serving-ca-bundle\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.663366 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663041 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:42.663366 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663058 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-trusted-ca-bundle\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.663366 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663099 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-1\") pod \"b5a19d3d-9434-4321-bb88-f79053450afa\" (UID: \"b5a19d3d-9434-4321-bb88-f79053450afa\") " Aug 01 05:45:42.663642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663507 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.663642 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663603 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:42.663767 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663742 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 05:45:42.663850 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663824 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:42.663902 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.663858 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:42.665418 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.665304 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.665562 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.665463 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:42.665839 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.665735 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 05:45:42.665914 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.665870 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.666037 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.666002 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:42.666429 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.666370 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Aug 01 05:45:42.666429 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.666382 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-config-out" (OuterVolumeSpecName: "config-out") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 05:45:42.666429 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.666393 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.667129 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.667101 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.667449 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.667426 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.668009 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.667975 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.668286 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.668246 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-kube-api-access-fv7z8" (OuterVolumeSpecName: "kube-api-access-fv7z8") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "kube-api-access-fv7z8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 05:45:42.668347 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.668260 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-config" (OuterVolumeSpecName: "config") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.668443 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.668423 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.676608 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.676585 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-web-config" (OuterVolumeSpecName: "web-config") pod "b5a19d3d-9434-4321-bb88-f79053450afa" (UID: "b5a19d3d-9434-4321-bb88-f79053450afa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Aug 01 05:45:42.764487 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764455 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-kube-rbac-proxy\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764487 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764482 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-tls-assets\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764487 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764492 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-grpc-tls\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764500 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-metrics-client-ca\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764510 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv7z8\" (UniqueName: \"kubernetes.io/projected/b5a19d3d-9434-4321-bb88-f79053450afa-kube-api-access-fv7z8\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764519 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764528 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-config\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764540 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764550 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764559 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764566 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764575 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764583 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-config-out\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764590 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-web-config\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764597 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-db\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764605 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b5a19d3d-9434-4321-bb88-f79053450afa-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764614 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764622 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:42.764697 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:42.764630 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b5a19d3d-9434-4321-bb88-f79053450afa-secret-metrics-client-certs\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 05:45:43.017343 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017310 2561 generic.go:356] "Generic (PLEG): container finished" podID="b5a19d3d-9434-4321-bb88-f79053450afa" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" exitCode=0 Aug 01 05:45:43.017343 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017336 2561 generic.go:356] "Generic (PLEG): container finished" podID="b5a19d3d-9434-4321-bb88-f79053450afa" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" exitCode=0 Aug 01 05:45:43.017343 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017342 2561 generic.go:356] "Generic (PLEG): container finished" podID="b5a19d3d-9434-4321-bb88-f79053450afa" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" exitCode=0 Aug 01 05:45:43.017343 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017348 2561 generic.go:356] "Generic (PLEG): container finished" podID="b5a19d3d-9434-4321-bb88-f79053450afa" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" exitCode=0 Aug 01 05:45:43.017343 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017354 2561 generic.go:356] "Generic (PLEG): container finished" podID="b5a19d3d-9434-4321-bb88-f79053450afa" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" exitCode=0 Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017359 2561 generic.go:356] "Generic (PLEG): container finished" podID="b5a19d3d-9434-4321-bb88-f79053450afa" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" exitCode=0 Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017382 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017391 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerDied","Data":"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a"} Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerDied","Data":"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961"} Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017565 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerDied","Data":"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c"} Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017584 2561 scope.go:117] "RemoveContainer" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017607 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerDied","Data":"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283"} Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017648 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerDied","Data":"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de"} Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017678 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerDied","Data":"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1"} Aug 01 05:45:43.017970 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.017711 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b5a19d3d-9434-4321-bb88-f79053450afa","Type":"ContainerDied","Data":"847dda79bbf84b33c4f6abeb3d380b8d1275902ae5c2a25fc5fc672a9b36e2ad"} Aug 01 05:45:43.018826 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.018806 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" event={"ID":"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34","Type":"ContainerStarted","Data":"4f5b37306012750327bc2e4e91b39e20c6251577ed6d770cc7c5872c66b4bf7e"} Aug 01 05:45:43.026523 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.026505 2561 scope.go:117] "RemoveContainer" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" Aug 01 05:45:43.033693 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.033677 2561 scope.go:117] "RemoveContainer" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" Aug 01 05:45:43.041963 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.041940 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:45:43.043953 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.043931 2561 scope.go:117] "RemoveContainer" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" Aug 01 05:45:43.046182 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.046160 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:45:43.052734 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.052705 2561 scope.go:117] "RemoveContainer" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" Aug 01 05:45:43.069416 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069392 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:45:43.069802 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069773 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy" Aug 01 05:45:43.069802 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069793 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069809 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="init-config-reloader" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069818 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="init-config-reloader" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069833 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="config-reloader" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069841 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="config-reloader" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069857 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="thanos-sidecar" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069866 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="thanos-sidecar" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069889 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="prometheus" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069897 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="prometheus" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069909 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy-web" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069917 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy-web" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069930 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy-thanos" Aug 01 05:45:43.069965 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.069938 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy-thanos" Aug 01 05:45:43.070510 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.070007 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="config-reloader" Aug 01 05:45:43.070510 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.070018 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="thanos-sidecar" Aug 01 05:45:43.070510 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.070028 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy-web" Aug 01 05:45:43.070510 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.070038 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="prometheus" Aug 01 05:45:43.070510 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.070046 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy" Aug 01 05:45:43.070510 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.070056 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" containerName="kube-rbac-proxy-thanos" Aug 01 05:45:43.074111 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.074090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.079379 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.077662 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Aug 01 05:45:43.079379 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.077769 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Aug 01 05:45:43.079379 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.077920 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Aug 01 05:45:43.079379 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.078136 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Aug 01 05:45:43.079379 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.078393 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Aug 01 05:45:43.079379 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.078578 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Aug 01 05:45:43.079379 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.078646 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Aug 01 05:45:43.079379 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.079000 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-frh4ed77e1h6h\"" Aug 01 05:45:43.079857 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.079495 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Aug 01 05:45:43.079857 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.079573 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Aug 01 05:45:43.079857 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.079701 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Aug 01 05:45:43.079857 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.079792 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Aug 01 05:45:43.080101 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.079885 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cq7jn\"" Aug 01 05:45:43.080172 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.080100 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Aug 01 05:45:43.081988 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.081957 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Aug 01 05:45:43.084680 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.084657 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Aug 01 05:45:43.085775 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.085755 2561 scope.go:117] "RemoveContainer" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" Aug 01 05:45:43.092437 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.092380 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:45:43.097757 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.097732 2561 scope.go:117] "RemoveContainer" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" Aug 01 05:45:43.106543 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.106523 2561 scope.go:117] "RemoveContainer" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" Aug 01 05:45:43.106837 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:43.106816 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": container with ID starting with cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a not found: ID does not exist" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" Aug 01 05:45:43.106915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.106845 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a"} err="failed to get container status \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": rpc error: code = NotFound desc = could not find container \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": container with ID starting with cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a not found: ID does not exist" Aug 01 05:45:43.106915 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.106870 2561 scope.go:117] "RemoveContainer" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" Aug 01 05:45:43.107294 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:43.107266 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": container with ID starting with 5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961 not found: ID does not exist" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" Aug 01 05:45:43.107407 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.107303 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961"} err="failed to get container status \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": rpc error: code = NotFound desc = could not find container \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": container with ID starting with 5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961 not found: ID does not exist" Aug 01 05:45:43.107407 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.107326 2561 scope.go:117] "RemoveContainer" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" Aug 01 05:45:43.107591 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:43.107555 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": container with ID starting with ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c not found: ID does not exist" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" Aug 01 05:45:43.107591 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.107579 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c"} err="failed to get container status \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": rpc error: code = NotFound desc = could not find container \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": container with ID starting with ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c not found: ID does not exist" Aug 01 05:45:43.107696 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.107595 2561 scope.go:117] "RemoveContainer" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" Aug 01 05:45:43.107848 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:43.107829 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": container with ID starting with 6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283 not found: ID does not exist" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" Aug 01 05:45:43.107905 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.107852 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283"} err="failed to get container status \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": rpc error: code = NotFound desc = could not find container \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": container with ID starting with 6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283 not found: ID does not exist" Aug 01 05:45:43.107905 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.107869 2561 scope.go:117] "RemoveContainer" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" Aug 01 05:45:43.108106 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:43.108090 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": container with ID starting with a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de not found: ID does not exist" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" Aug 01 05:45:43.108160 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.108110 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de"} err="failed to get container status \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": rpc error: code = NotFound desc = could not find container \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": container with ID starting with a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de not found: ID does not exist" Aug 01 05:45:43.108160 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.108124 2561 scope.go:117] "RemoveContainer" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" Aug 01 05:45:43.108600 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:43.108373 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": container with ID starting with 03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1 not found: ID does not exist" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" Aug 01 05:45:43.108600 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.108398 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1"} err="failed to get container status \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": rpc error: code = NotFound desc = could not find container \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": container with ID starting with 03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1 not found: ID does not exist" Aug 01 05:45:43.108600 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.108411 2561 scope.go:117] "RemoveContainer" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" Aug 01 05:45:43.108776 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:45:43.108643 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": container with ID starting with 0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad not found: ID does not exist" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" Aug 01 05:45:43.108776 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.108661 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad"} err="failed to get container status \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": rpc error: code = NotFound desc = could not find container \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": container with ID starting with 0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad not found: ID does not exist" Aug 01 05:45:43.108776 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.108679 2561 scope.go:117] "RemoveContainer" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" Aug 01 05:45:43.108983 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.108965 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a"} err="failed to get container status \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": rpc error: code = NotFound desc = could not find container \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": container with ID starting with cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a not found: ID does not exist" Aug 01 05:45:43.108983 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.108982 2561 scope.go:117] "RemoveContainer" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" Aug 01 05:45:43.109190 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.109172 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961"} err="failed to get container status \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": rpc error: code = NotFound desc = could not find container \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": container with ID starting with 5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961 not found: ID does not exist" Aug 01 05:45:43.109190 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.109189 2561 scope.go:117] "RemoveContainer" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" Aug 01 05:45:43.109594 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.109568 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c"} err="failed to get container status \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": rpc error: code = NotFound desc = could not find container \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": container with ID starting with ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c not found: ID does not exist" Aug 01 05:45:43.109728 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.109715 2561 scope.go:117] "RemoveContainer" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" Aug 01 05:45:43.110087 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.110062 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283"} err="failed to get container status \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": rpc error: code = NotFound desc = could not find container \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": container with ID starting with 6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283 not found: ID does not exist" Aug 01 05:45:43.110087 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.110084 2561 scope.go:117] "RemoveContainer" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" Aug 01 05:45:43.110365 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.110341 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de"} err="failed to get container status \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": rpc error: code = NotFound desc = could not find container \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": container with ID starting with a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de not found: ID does not exist" Aug 01 05:45:43.110433 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.110366 2561 scope.go:117] "RemoveContainer" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" Aug 01 05:45:43.110712 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.110682 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1"} err="failed to get container status \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": rpc error: code = NotFound desc = could not find container \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": container with ID starting with 03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1 not found: ID does not exist" Aug 01 05:45:43.110808 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.110714 2561 scope.go:117] "RemoveContainer" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" Aug 01 05:45:43.111372 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.111288 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad"} err="failed to get container status \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": rpc error: code = NotFound desc = could not find container \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": container with ID starting with 0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad not found: ID does not exist" Aug 01 05:45:43.111372 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.111313 2561 scope.go:117] "RemoveContainer" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" Aug 01 05:45:43.111876 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.111856 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a"} err="failed to get container status \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": rpc error: code = NotFound desc = could not find container \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": container with ID starting with cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a not found: ID does not exist" Aug 01 05:45:43.111977 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.111877 2561 scope.go:117] "RemoveContainer" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" Aug 01 05:45:43.112183 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.112159 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961"} err="failed to get container status \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": rpc error: code = NotFound desc = could not find container \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": container with ID starting with 5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961 not found: ID does not exist" Aug 01 05:45:43.112279 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.112186 2561 scope.go:117] "RemoveContainer" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" Aug 01 05:45:43.112522 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.112483 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c"} err="failed to get container status \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": rpc error: code = NotFound desc = could not find container \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": container with ID starting with ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c not found: ID does not exist" Aug 01 05:45:43.112522 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.112508 2561 scope.go:117] "RemoveContainer" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" Aug 01 05:45:43.112774 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.112734 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283"} err="failed to get container status \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": rpc error: code = NotFound desc = could not find container \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": container with ID starting with 6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283 not found: ID does not exist" Aug 01 05:45:43.112774 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.112761 2561 scope.go:117] "RemoveContainer" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" Aug 01 05:45:43.113200 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.113068 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de"} err="failed to get container status \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": rpc error: code = NotFound desc = could not find container \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": container with ID starting with a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de not found: ID does not exist" Aug 01 05:45:43.113200 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.113092 2561 scope.go:117] "RemoveContainer" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" Aug 01 05:45:43.113649 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.113616 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1"} err="failed to get container status \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": rpc error: code = NotFound desc = could not find container \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": container with ID starting with 03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1 not found: ID does not exist" Aug 01 05:45:43.113649 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.113642 2561 scope.go:117] "RemoveContainer" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" Aug 01 05:45:43.114201 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.113909 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad"} err="failed to get container status \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": rpc error: code = NotFound desc = could not find container \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": container with ID starting with 0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad not found: ID does not exist" Aug 01 05:45:43.114201 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.113934 2561 scope.go:117] "RemoveContainer" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" Aug 01 05:45:43.114355 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.114217 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a"} err="failed to get container status \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": rpc error: code = NotFound desc = could not find container \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": container with ID starting with cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a not found: ID does not exist" Aug 01 05:45:43.114355 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.114249 2561 scope.go:117] "RemoveContainer" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" Aug 01 05:45:43.115097 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.115029 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961"} err="failed to get container status \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": rpc error: code = NotFound desc = could not find container \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": container with ID starting with 5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961 not found: ID does not exist" Aug 01 05:45:43.115097 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.115052 2561 scope.go:117] "RemoveContainer" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" Aug 01 05:45:43.115385 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.115351 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c"} err="failed to get container status \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": rpc error: code = NotFound desc = could not find container \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": container with ID starting with ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c not found: ID does not exist" Aug 01 05:45:43.115479 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.115386 2561 scope.go:117] "RemoveContainer" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" Aug 01 05:45:43.115715 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.115697 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283"} err="failed to get container status \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": rpc error: code = NotFound desc = could not find container \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": container with ID starting with 6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283 not found: ID does not exist" Aug 01 05:45:43.115715 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.115714 2561 scope.go:117] "RemoveContainer" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" Aug 01 05:45:43.116017 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.115997 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de"} err="failed to get container status \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": rpc error: code = NotFound desc = could not find container \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": container with ID starting with a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de not found: ID does not exist" Aug 01 05:45:43.116017 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.116016 2561 scope.go:117] "RemoveContainer" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" Aug 01 05:45:43.116300 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.116268 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1"} err="failed to get container status \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": rpc error: code = NotFound desc = could not find container \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": container with ID starting with 03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1 not found: ID does not exist" Aug 01 05:45:43.116300 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.116292 2561 scope.go:117] "RemoveContainer" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" Aug 01 05:45:43.116555 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.116527 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad"} err="failed to get container status \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": rpc error: code = NotFound desc = could not find container \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": container with ID starting with 0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad not found: ID does not exist" Aug 01 05:45:43.116555 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.116554 2561 scope.go:117] "RemoveContainer" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" Aug 01 05:45:43.116792 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.116770 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a"} err="failed to get container status \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": rpc error: code = NotFound desc = could not find container \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": container with ID starting with cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a not found: ID does not exist" Aug 01 05:45:43.116864 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.116795 2561 scope.go:117] "RemoveContainer" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" Aug 01 05:45:43.117023 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.117008 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961"} err="failed to get container status \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": rpc error: code = NotFound desc = could not find container \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": container with ID starting with 5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961 not found: ID does not exist" Aug 01 05:45:43.117023 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.117023 2561 scope.go:117] "RemoveContainer" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" Aug 01 05:45:43.117337 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.117317 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c"} err="failed to get container status \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": rpc error: code = NotFound desc = could not find container \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": container with ID starting with ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c not found: ID does not exist" Aug 01 05:45:43.117423 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.117339 2561 scope.go:117] "RemoveContainer" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" Aug 01 05:45:43.117650 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.117622 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283"} err="failed to get container status \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": rpc error: code = NotFound desc = could not find container \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": container with ID starting with 6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283 not found: ID does not exist" Aug 01 05:45:43.117725 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.117650 2561 scope.go:117] "RemoveContainer" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" Aug 01 05:45:43.117881 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.117857 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de"} err="failed to get container status \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": rpc error: code = NotFound desc = could not find container \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": container with ID starting with a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de not found: ID does not exist" Aug 01 05:45:43.117881 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.117881 2561 scope.go:117] "RemoveContainer" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" Aug 01 05:45:43.118132 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.118109 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1"} err="failed to get container status \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": rpc error: code = NotFound desc = could not find container \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": container with ID starting with 03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1 not found: ID does not exist" Aug 01 05:45:43.118192 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.118135 2561 scope.go:117] "RemoveContainer" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" Aug 01 05:45:43.118471 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.118452 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad"} err="failed to get container status \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": rpc error: code = NotFound desc = could not find container \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": container with ID starting with 0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad not found: ID does not exist" Aug 01 05:45:43.118471 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.118471 2561 scope.go:117] "RemoveContainer" containerID="cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a" Aug 01 05:45:43.121547 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.119408 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a"} err="failed to get container status \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": rpc error: code = NotFound desc = could not find container \"cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a\": container with ID starting with cb1c22a72b04794758b3fdc71ca6c90fcf30bb8cb60eeb06147e1eecfc1e503a not found: ID does not exist" Aug 01 05:45:43.121547 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.119431 2561 scope.go:117] "RemoveContainer" containerID="5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961" Aug 01 05:45:43.121679 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.121661 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961"} err="failed to get container status \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": rpc error: code = NotFound desc = could not find container \"5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961\": container with ID starting with 5f5a06d5684204fd808f828d896515a912969ea5ee0b52cc8c7a25fb89474961 not found: ID does not exist" Aug 01 05:45:43.121724 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.121680 2561 scope.go:117] "RemoveContainer" containerID="ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c" Aug 01 05:45:43.122281 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.122254 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c"} err="failed to get container status \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": rpc error: code = NotFound desc = could not find container \"ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c\": container with ID starting with ca103145920694548e498e2ce59f12078ca75477801f75c669ca640b6695511c not found: ID does not exist" Aug 01 05:45:43.122372 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.122282 2561 scope.go:117] "RemoveContainer" containerID="6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283" Aug 01 05:45:43.122623 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.122586 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283"} err="failed to get container status \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": rpc error: code = NotFound desc = could not find container \"6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283\": container with ID starting with 6445e128a1e048efe29e48aa9bebe7bb78f5e8d94131cb5050e617135eb10283 not found: ID does not exist" Aug 01 05:45:43.122623 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.122613 2561 scope.go:117] "RemoveContainer" containerID="a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de" Aug 01 05:45:43.122917 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.122891 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de"} err="failed to get container status \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": rpc error: code = NotFound desc = could not find container \"a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de\": container with ID starting with a632dcb9266b189a5180e167003fd35bad871a808fb880bbe6976db1ddb449de not found: ID does not exist" Aug 01 05:45:43.122917 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.122913 2561 scope.go:117] "RemoveContainer" containerID="03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1" Aug 01 05:45:43.123184 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.123162 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1"} err="failed to get container status \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": rpc error: code = NotFound desc = could not find container \"03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1\": container with ID starting with 03b9e69a245c72083d51569f9dcd248216e4ef280afcfa6d1f80c1aad6c508d1 not found: ID does not exist" Aug 01 05:45:43.123184 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.123184 2561 scope.go:117] "RemoveContainer" containerID="0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad" Aug 01 05:45:43.123649 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.123625 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad"} err="failed to get container status \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": rpc error: code = NotFound desc = could not find container \"0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad\": container with ID starting with 0ad0558e094aeef9445a74446cb62577af3b218827041be772cc29bb43185aad not found: ID does not exist" Aug 01 05:45:43.168326 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168294 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-web-config\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168326 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168496 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168347 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168496 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168362 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168496 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t5mh\" (UniqueName: \"kubernetes.io/projected/5cea01a8-adcc-4d24-92c0-e8597c108886-kube-api-access-8t5mh\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168611 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168496 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168653 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168633 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168810 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168772 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168884 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168822 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cea01a8-adcc-4d24-92c0-e8597c108886-config-out\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168884 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168964 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168931 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.168998 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.168987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.169050 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.169015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.169122 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.169104 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.169228 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.169209 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.169298 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.169281 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.169343 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.169321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-config\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.169376 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.169361 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cea01a8-adcc-4d24-92c0-e8597c108886-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.169413 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.169379 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.169452 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.169415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270468 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270396 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-web-config\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270468 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270468 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270724 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270677 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270724 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t5mh\" (UniqueName: \"kubernetes.io/projected/5cea01a8-adcc-4d24-92c0-e8597c108886-kube-api-access-8t5mh\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270833 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270747 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270833 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270935 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270935 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cea01a8-adcc-4d24-92c0-e8597c108886-config-out\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270935 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.270935 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.271110 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270968 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.271110 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.270996 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.271110 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271030 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271343 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271407 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-config\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271470 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cea01a8-adcc-4d24-92c0-e8597c108886-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271498 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271524 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271655 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272104 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271848 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272573 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.272121 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272632 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.272599 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.272632 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.271350 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.273182 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.273154 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.273299 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.273196 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.275703 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.275647 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.276198 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.276170 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.276320 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.276270 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.276785 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.276623 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.276878 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.276795 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5cea01a8-adcc-4d24-92c0-e8597c108886-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.277778 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.277379 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5cea01a8-adcc-4d24-92c0-e8597c108886-config-out\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.277778 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.277487 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5cea01a8-adcc-4d24-92c0-e8597c108886-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.277778 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.277525 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-config\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.277974 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.277786 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-web-config\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.277974 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.277916 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.278073 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.277993 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.279393 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.279374 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5cea01a8-adcc-4d24-92c0-e8597c108886-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.279981 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.279964 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t5mh\" (UniqueName: \"kubernetes.io/projected/5cea01a8-adcc-4d24-92c0-e8597c108886-kube-api-access-8t5mh\") pod \"prometheus-k8s-0\" (UID: \"5cea01a8-adcc-4d24-92c0-e8597c108886\") " pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.392612 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.392574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:43.542646 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:43.542619 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Aug 01 05:45:43.544755 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:45:43.544722 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cea01a8_adcc_4d24_92c0_e8597c108886.slice/crio-0fdd2aad1f02411b781e8f6a79fa8e824956a2928192242a26ace86d58b95c7d WatchSource:0}: Error finding container 0fdd2aad1f02411b781e8f6a79fa8e824956a2928192242a26ace86d58b95c7d: Status 404 returned error can't find the container with id 0fdd2aad1f02411b781e8f6a79fa8e824956a2928192242a26ace86d58b95c7d Aug 01 05:45:44.026356 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:44.026324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerStarted","Data":"c17f046e2efe33e9094204344775b090d0f2103dbe83ebb9f70605238ece985d"} Aug 01 05:45:44.026798 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:44.026387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerStarted","Data":"0fdd2aad1f02411b781e8f6a79fa8e824956a2928192242a26ace86d58b95c7d"} Aug 01 05:45:44.097559 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:44.097525 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5a19d3d-9434-4321-bb88-f79053450afa" path="/var/lib/kubelet/pods/b5a19d3d-9434-4321-bb88-f79053450afa/volumes" Aug 01 05:45:45.032197 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:45.032153 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" event={"ID":"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34","Type":"ContainerStarted","Data":"2be1686f075894ea753a9f5125187c7cbfa0d1e232418e1ceefc2d670d2b5f04"} Aug 01 05:45:45.032618 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:45.032225 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" event={"ID":"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34","Type":"ContainerStarted","Data":"07bb92323ea89cc639957a564975b61ab0b9cd446383e8920906e0885878c79c"} Aug 01 05:45:45.032618 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:45.032269 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" event={"ID":"6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34","Type":"ContainerStarted","Data":"64d65576d0e469145899725f935d7e48e128610be5f140f4feb8e54936232bc3"} Aug 01 05:45:45.033654 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:45.033630 2561 generic.go:356] "Generic (PLEG): container finished" podID="5cea01a8-adcc-4d24-92c0-e8597c108886" containerID="c17f046e2efe33e9094204344775b090d0f2103dbe83ebb9f70605238ece985d" exitCode=0 Aug 01 05:45:45.033746 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:45.033706 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerDied","Data":"c17f046e2efe33e9094204344775b090d0f2103dbe83ebb9f70605238ece985d"} Aug 01 05:45:45.056673 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:45.056622 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7546c9fbc-62b9x" podStartSLOduration=1.501905271 podStartE2EDuration="3.056602619s" totalImagesPullingTime="1.554697348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:45:45.054027554 +0000 UTC m=+155.450211683" watchObservedRunningTime="2026-08-01 05:45:45.056602619 +0000 UTC m=+155.452786758" Aug 01 05:45:45.223073 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:45.222979 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:45.279054 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:45.279013 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:46.043427 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:46.043368 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerStarted","Data":"8db857758cdc0c1f758b58b65a885cd2fe322987c3a3f06a361b44fea6d66519"} Aug 01 05:45:46.043882 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:46.043450 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerStarted","Data":"71d1ade5f0a59b4021d38b6fc67cc7b4509e2aecc002e5a7e91d629433eecd24"} Aug 01 05:45:46.043882 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:46.043490 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerStarted","Data":"3de597f59dcb58e40477f1d008ca46d6ee679028ec0061ef71315d7a2058a266"} Aug 01 05:45:46.043882 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:46.043532 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerStarted","Data":"2d77d1d0d3832ee71091ea6adcdbfec23c1f99c9325d21d9f987e8e57c625381"} Aug 01 05:45:46.043882 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:46.043574 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerStarted","Data":"3f212b14ff90a6f22803b8c635bf4477fdfc4c4da1e316ed4d10c3edd292e6d2"} Aug 01 05:45:46.043882 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:46.043612 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5cea01a8-adcc-4d24-92c0-e8597c108886","Type":"ContainerStarted","Data":"ec40aa6970adc333b67f80dcabd72897013df4979c73a84ef61779493163b139"} Aug 01 05:45:46.075266 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:46.075194 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.051992885 podStartE2EDuration="3.075175228s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.182343ms" isStatefulPod=false podCreationTimestamp="2026-08-01 05:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:45:46.072767278 +0000 UTC m=+156.468951418" watchObservedRunningTime="2026-08-01 05:45:46.075175228 +0000 UTC m=+156.471359366" Aug 01 05:45:48.393151 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:48.393122 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:45:56.272203 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:56.272154 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:56.371865 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:56.371837 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:45:56.421372 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:45:56.421342 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:46:12.336863 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:46:12.336827 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:46:43.392904 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:46:43.392857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:46:43.408360 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:46:43.408335 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:46:44.286903 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:46:44.286873 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Aug 01 05:46:52.158765 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:46:52.158731 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:46:52.259182 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:46:52.259148 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:46:54.506410 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:46:54.506377 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:46:54.566796 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:46:54.566765 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:47:04.025881 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:47:04.025847 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:47:04.077520 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:47:04.077484 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:47:05.414449 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:47:05.414417 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:47:05.514956 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:47:05.514926 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:47:05.566227 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:47:05.566202 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:47:14.636971 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:47:14.636924 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:47:16.415566 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:47:16.415534 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:47:37.664803 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:47:37.664727 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:02.708590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:02.708553 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:02.759796 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:02.759753 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:09.949816 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:09.949786 2561 kubelet.go:1648] "Image garbage collection succeeded" Aug 01 05:48:11.280278 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:11.280220 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:11.381436 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:11.381410 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:32.635291 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:32.635252 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:33.964372 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:33.964335 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:36.243725 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:36.243696 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:36.292912 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:36.292882 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:38.490175 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:38.490133 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:38.591080 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:38.591044 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:40.578761 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:40.578727 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:40.783986 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:40.783956 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:40.838647 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:40.838568 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:45.351632 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.351599 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4f86v"] Aug 01 05:48:45.354091 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.354075 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:45.356405 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.356381 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-j2zqg\"" Aug 01 05:48:45.356541 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.356480 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Aug 01 05:48:45.357433 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.357413 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Aug 01 05:48:45.362690 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.362669 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4f86v"] Aug 01 05:48:45.432722 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.432688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdaec83a-3f41-4f26-95d2-3c834446bd43-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4f86v\" (UID: \"fdaec83a-3f41-4f26-95d2-3c834446bd43\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:45.432874 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.432753 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n58vl\" (UniqueName: \"kubernetes.io/projected/fdaec83a-3f41-4f26-95d2-3c834446bd43-kube-api-access-n58vl\") pod \"cert-manager-webhook-6486ffd997-4f86v\" (UID: \"fdaec83a-3f41-4f26-95d2-3c834446bd43\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:45.534061 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.534035 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdaec83a-3f41-4f26-95d2-3c834446bd43-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4f86v\" (UID: \"fdaec83a-3f41-4f26-95d2-3c834446bd43\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:45.534198 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.534104 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n58vl\" (UniqueName: \"kubernetes.io/projected/fdaec83a-3f41-4f26-95d2-3c834446bd43-kube-api-access-n58vl\") pod \"cert-manager-webhook-6486ffd997-4f86v\" (UID: \"fdaec83a-3f41-4f26-95d2-3c834446bd43\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:45.541607 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.541580 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fdaec83a-3f41-4f26-95d2-3c834446bd43-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4f86v\" (UID: \"fdaec83a-3f41-4f26-95d2-3c834446bd43\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:45.541709 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.541630 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n58vl\" (UniqueName: \"kubernetes.io/projected/fdaec83a-3f41-4f26-95d2-3c834446bd43-kube-api-access-n58vl\") pod \"cert-manager-webhook-6486ffd997-4f86v\" (UID: \"fdaec83a-3f41-4f26-95d2-3c834446bd43\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:45.674412 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.674381 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:45.797318 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.797293 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4f86v"] Aug 01 05:48:45.799790 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:48:45.799763 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfdaec83a_3f41_4f26_95d2_3c834446bd43.slice/crio-e3fdb2bbdd78bb25ba180a2c384f96034827b1a243ac019a80b3d8bd7c1c9c23 WatchSource:0}: Error finding container e3fdb2bbdd78bb25ba180a2c384f96034827b1a243ac019a80b3d8bd7c1c9c23: Status 404 returned error can't find the container with id e3fdb2bbdd78bb25ba180a2c384f96034827b1a243ac019a80b3d8bd7c1c9c23 Aug 01 05:48:45.801815 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:45.801796 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 01 05:48:46.751002 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:46.750944 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" event={"ID":"fdaec83a-3f41-4f26-95d2-3c834446bd43","Type":"ContainerStarted","Data":"e3fdb2bbdd78bb25ba180a2c384f96034827b1a243ac019a80b3d8bd7c1c9c23"} Aug 01 05:48:48.782365 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:48.782330 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:49.161370 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:49.161344 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:49.217268 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:49.217222 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:49.766071 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:49.766030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" event={"ID":"fdaec83a-3f41-4f26-95d2-3c834446bd43","Type":"ContainerStarted","Data":"5d52dc64da31104f2aaf1948b85a28c03c16a44b6f3913b664f0550c1b08220c"} Aug 01 05:48:49.766264 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:49.766228 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:49.782171 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:49.782126 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" podStartSLOduration=1.670618088 podStartE2EDuration="4.782112431s" totalImagesPullingTime="3.111494343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:48:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:48:49.780849555 +0000 UTC m=+340.177033696" watchObservedRunningTime="2026-08-01 05:48:49.782112431 +0000 UTC m=+340.178296570" Aug 01 05:48:55.771983 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:55.771953 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4f86v" Aug 01 05:48:59.902251 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:59.902210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:48:59.999252 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:48:59.999210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:10.187822 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:10.187741 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:10.286500 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:10.286473 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:11.545898 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.545868 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds"] Aug 01 05:49:11.549613 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.549592 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" Aug 01 05:49:11.551951 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.551935 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Aug 01 05:49:11.552833 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.552819 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Aug 01 05:49:11.552888 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.552849 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-dn8d5\"" Aug 01 05:49:11.557222 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.557201 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds"] Aug 01 05:49:11.558962 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.558941 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd2cc07-3f19-4eed-b045-84e99878d4b1-tmp\") pod \"jobset-operator-5bc45f897-kg7ds\" (UID: \"1dd2cc07-3f19-4eed-b045-84e99878d4b1\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" Aug 01 05:49:11.559055 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.559018 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdxsc\" (UniqueName: \"kubernetes.io/projected/1dd2cc07-3f19-4eed-b045-84e99878d4b1-kube-api-access-kdxsc\") pod \"jobset-operator-5bc45f897-kg7ds\" (UID: \"1dd2cc07-3f19-4eed-b045-84e99878d4b1\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" Aug 01 05:49:11.659567 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.659534 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd2cc07-3f19-4eed-b045-84e99878d4b1-tmp\") pod \"jobset-operator-5bc45f897-kg7ds\" (UID: \"1dd2cc07-3f19-4eed-b045-84e99878d4b1\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" Aug 01 05:49:11.659708 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.659595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdxsc\" (UniqueName: \"kubernetes.io/projected/1dd2cc07-3f19-4eed-b045-84e99878d4b1-kube-api-access-kdxsc\") pod \"jobset-operator-5bc45f897-kg7ds\" (UID: \"1dd2cc07-3f19-4eed-b045-84e99878d4b1\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" Aug 01 05:49:11.659940 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.659920 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd2cc07-3f19-4eed-b045-84e99878d4b1-tmp\") pod \"jobset-operator-5bc45f897-kg7ds\" (UID: \"1dd2cc07-3f19-4eed-b045-84e99878d4b1\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" Aug 01 05:49:11.667084 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.667054 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdxsc\" (UniqueName: \"kubernetes.io/projected/1dd2cc07-3f19-4eed-b045-84e99878d4b1-kube-api-access-kdxsc\") pod \"jobset-operator-5bc45f897-kg7ds\" (UID: \"1dd2cc07-3f19-4eed-b045-84e99878d4b1\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" Aug 01 05:49:11.859167 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.859090 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" Aug 01 05:49:11.978436 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:11.978413 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds"] Aug 01 05:49:11.980411 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:49:11.980380 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dd2cc07_3f19_4eed_b045_84e99878d4b1.slice/crio-2f6e348f3e4307d172ecac946a73e683d60d75a05cebe6b551770b838ba9f4c8 WatchSource:0}: Error finding container 2f6e348f3e4307d172ecac946a73e683d60d75a05cebe6b551770b838ba9f4c8: Status 404 returned error can't find the container with id 2f6e348f3e4307d172ecac946a73e683d60d75a05cebe6b551770b838ba9f4c8 Aug 01 05:49:12.864612 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:12.860248 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" event={"ID":"1dd2cc07-3f19-4eed-b045-84e99878d4b1","Type":"ContainerStarted","Data":"2f6e348f3e4307d172ecac946a73e683d60d75a05cebe6b551770b838ba9f4c8"} Aug 01 05:49:14.871409 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:14.871335 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" event={"ID":"1dd2cc07-3f19-4eed-b045-84e99878d4b1","Type":"ContainerStarted","Data":"03fd239548c78bc6a1d4f4d18d4b6c2de6fc443e91cd806c8f9fa79d50fbe246"} Aug 01 05:49:14.888436 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:14.888393 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-kg7ds" podStartSLOduration=1.2755447659999999 podStartE2EDuration="3.888378852s" totalImagesPullingTime="2.612834086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 05:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 05:49:14.887732474 +0000 UTC m=+365.283916614" watchObservedRunningTime="2026-08-01 05:49:14.888378852 +0000 UTC m=+365.284562991" Aug 01 05:49:20.627152 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:20.627120 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:22.640366 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:22.640339 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:30.904188 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:30.904155 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:30.952563 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:30.952533 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:32.661854 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:32.661818 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:32.820363 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:32.820331 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:32.874462 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:32.874430 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:44.075102 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:44.075069 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:44.172578 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:44.172547 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:49:44.273216 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:49:44.273182 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:50:13.016979 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:50:13.016947 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:50:25.471253 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:50:25.471199 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:50:25.556451 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:50:25.556421 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:50:25.610131 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:50:25.610100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:51:06.961331 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:06.961295 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:51:07.061811 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:07.061780 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:51:12.649567 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:12.649529 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:51:12.750946 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:12.750908 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:51:14.860740 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.860708 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq"] Aug 01 05:51:14.864308 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.864291 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:14.866887 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.866863 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Aug 01 05:51:14.867016 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.866955 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Aug 01 05:51:14.867791 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.867769 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:51:14.867902 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.867869 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-jk5gc\"" Aug 01 05:51:14.867902 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.867881 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Aug 01 05:51:14.867902 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.867871 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Aug 01 05:51:14.871564 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:14.871447 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq"] Aug 01 05:51:15.002264 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.002210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjtsv\" (UniqueName: \"kubernetes.io/projected/9adb71c7-af42-4012-b915-8c579771f586-kube-api-access-rjtsv\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.002425 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.002360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9adb71c7-af42-4012-b915-8c579771f586-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.002425 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.002404 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9adb71c7-af42-4012-b915-8c579771f586-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.103633 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.103598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjtsv\" (UniqueName: \"kubernetes.io/projected/9adb71c7-af42-4012-b915-8c579771f586-kube-api-access-rjtsv\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.103792 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.103646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9adb71c7-af42-4012-b915-8c579771f586-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.103792 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.103684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9adb71c7-af42-4012-b915-8c579771f586-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.104440 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.104414 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9adb71c7-af42-4012-b915-8c579771f586-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.106065 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.106044 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9adb71c7-af42-4012-b915-8c579771f586-cert\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.112774 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.112715 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjtsv\" (UniqueName: \"kubernetes.io/projected/9adb71c7-af42-4012-b915-8c579771f586-kube-api-access-rjtsv\") pod \"kubeflow-trainer-controller-manager-679c94ffcd-cwmbq\" (UID: \"9adb71c7-af42-4012-b915-8c579771f586\") " pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.174343 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.174311 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" Aug 01 05:51:15.301590 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.301514 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq"] Aug 01 05:51:15.304228 ip-10-0-138-6 kubenswrapper[2561]: W0801 05:51:15.304198 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9adb71c7_af42_4012_b915_8c579771f586.slice/crio-985b544910c4c77a0183b5ec5be0da2273a04107fb54cc579f9fc4f68da95baf WatchSource:0}: Error finding container 985b544910c4c77a0183b5ec5be0da2273a04107fb54cc579f9fc4f68da95baf: Status 404 returned error can't find the container with id 985b544910c4c77a0183b5ec5be0da2273a04107fb54cc579f9fc4f68da95baf Aug 01 05:51:15.321121 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.321100 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:51:15.361897 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:51:15.361864 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" event={"ID":"9adb71c7-af42-4012-b915-8c579771f586","Type":"ContainerStarted","Data":"985b544910c4c77a0183b5ec5be0da2273a04107fb54cc579f9fc4f68da95baf"} Aug 01 05:51:15.705478 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:15.705428 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 05:51:15.705654 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:15.705544 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-cwmbq_opendatahub(9adb71c7-af42-4012-b915-8c579771f586): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 05:51:15.705654 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:15.705578 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:51:16.367361 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:16.367312 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:51:32.350050 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:32.349962 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 05:51:32.350423 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:32.350071 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-cwmbq_opendatahub(9adb71c7-af42-4012-b915-8c579771f586): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 05:51:32.350423 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:32.350101 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:51:44.089547 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:44.089512 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:51:58.393563 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:58.393459 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 05:51:58.393931 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:58.393562 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-cwmbq_opendatahub(9adb71c7-af42-4012-b915-8c579771f586): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 05:51:58.393931 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:51:58.393597 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:52:10.091245 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:52:10.091063 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:52:22.088412 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:52:22.088317 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:52:36.838014 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:52:36.837983 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:52:37.088909 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:52:37.088880 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:52:51.385692 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:52:51.385598 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 05:52:51.386174 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:52:51.385714 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-cwmbq_opendatahub(9adb71c7-af42-4012-b915-8c579771f586): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 05:52:51.386174 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:52:51.385742 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:53:05.088484 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:53:05.088436 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:53:20.093261 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:53:20.091266 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:53:32.089139 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:53:32.088977 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:53:39.964069 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:53:39.964037 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:53:40.011366 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:53:40.011339 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:53:45.088711 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:53:45.088674 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:53:58.089101 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:53:58.088916 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 01 05:53:58.089445 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:53:58.089098 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:54:03.250920 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:54:03.250885 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:54:03.308508 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:54:03.308480 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:54:13.378187 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:54:13.378097 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 05:54:13.378651 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:54:13.378247 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-cwmbq_opendatahub(9adb71c7-af42-4012-b915-8c579771f586): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 05:54:13.378651 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:54:13.378294 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:54:25.088554 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:54:25.088485 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:54:38.089561 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:54:38.089529 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:54:51.088531 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:54:51.088482 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:54:52.864934 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:54:52.864902 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:55:03.675748 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:55:03.675712 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:55:05.088292 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:55:05.088265 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:55:20.090735 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:55:20.090631 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:55:32.093610 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:55:32.093575 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:55:44.089200 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:55:44.089168 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:55:59.089008 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:55:59.088983 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:56:11.089187 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:56:11.089154 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:56:26.088794 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:56:26.088761 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:56:41.089453 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:56:41.089422 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:56:52.089322 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:56:52.089282 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:57:05.597741 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:57:05.597689 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 05:57:05.598189 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:57:05.597812 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-cwmbq_opendatahub(9adb71c7-af42-4012-b915-8c579771f586): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 05:57:05.598189 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:57:05.597844 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:57:17.088869 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:57:17.088791 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:57:29.088966 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:57:29.088913 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:57:42.089492 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:57:42.089454 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:57:56.089532 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:57:56.089393 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:58:11.088576 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:58:11.088544 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:58:22.090434 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:58:22.088393 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:58:24.478992 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:58:24.478941 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 05:58:36.088971 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:58:36.088873 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:58:49.088587 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:58:49.088558 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:59:04.088866 ip-10-0-138-6 kubenswrapper[2561]: I0801 05:59:04.088842 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Aug 01 05:59:04.089118 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:59:04.089089 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:59:16.093648 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:59:16.093619 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:59:27.088669 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:59:27.088627 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:59:41.089019 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:59:41.088983 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 05:59:52.094297 ip-10-0-138-6 kubenswrapper[2561]: E0801 05:59:52.094174 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:00:07.089326 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:00:07.089276 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:00:21.088745 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:00:21.088698 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:00:34.088669 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:00:34.088580 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:00:46.088556 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:00:46.088513 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:00:59.089145 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:00:59.089114 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:01:11.088368 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:01:11.088270 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:01:26.088904 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:01:26.088872 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:01:27.058885 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.058851 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bmg8r/must-gather-nbbpw"] Aug 01 06:01:27.063303 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.063283 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:01:27.065599 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.065576 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bmg8r\"/\"kube-root-ca.crt\"" Aug 01 06:01:27.066601 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.066580 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bmg8r\"/\"openshift-service-ca.crt\"" Aug 01 06:01:27.066692 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.066635 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bmg8r\"/\"default-dockercfg-7dhzd\"" Aug 01 06:01:27.076469 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.076450 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bmg8r/must-gather-nbbpw"] Aug 01 06:01:27.106246 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.106210 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 06:01:27.119376 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.119355 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18b6c0c7-73ff-4434-8840-69703e57b283-must-gather-output\") pod \"must-gather-nbbpw\" (UID: \"18b6c0c7-73ff-4434-8840-69703e57b283\") " pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:01:27.119688 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.119657 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfnkh\" (UniqueName: \"kubernetes.io/projected/18b6c0c7-73ff-4434-8840-69703e57b283-kube-api-access-hfnkh\") pod \"must-gather-nbbpw\" (UID: \"18b6c0c7-73ff-4434-8840-69703e57b283\") " pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:01:27.220629 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.220598 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfnkh\" (UniqueName: \"kubernetes.io/projected/18b6c0c7-73ff-4434-8840-69703e57b283-kube-api-access-hfnkh\") pod \"must-gather-nbbpw\" (UID: \"18b6c0c7-73ff-4434-8840-69703e57b283\") " pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:01:27.220759 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.220659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18b6c0c7-73ff-4434-8840-69703e57b283-must-gather-output\") pod \"must-gather-nbbpw\" (UID: \"18b6c0c7-73ff-4434-8840-69703e57b283\") " pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:01:27.220940 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.220927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18b6c0c7-73ff-4434-8840-69703e57b283-must-gather-output\") pod \"must-gather-nbbpw\" (UID: \"18b6c0c7-73ff-4434-8840-69703e57b283\") " pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:01:27.228128 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.228101 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfnkh\" (UniqueName: \"kubernetes.io/projected/18b6c0c7-73ff-4434-8840-69703e57b283-kube-api-access-hfnkh\") pod \"must-gather-nbbpw\" (UID: \"18b6c0c7-73ff-4434-8840-69703e57b283\") " pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:01:27.275676 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.275623 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 06:01:27.372293 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.372197 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:01:27.501981 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.501806 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bmg8r/must-gather-nbbpw"] Aug 01 06:01:27.504185 ip-10-0-138-6 kubenswrapper[2561]: W0801 06:01:27.504158 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18b6c0c7_73ff_4434_8840_69703e57b283.slice/crio-12f56f0ed8dcfd1eb69fd6269538b7a5a04b1dad5dc1f1ebf1cf7ea317f4fd1c WatchSource:0}: Error finding container 12f56f0ed8dcfd1eb69fd6269538b7a5a04b1dad5dc1f1ebf1cf7ea317f4fd1c: Status 404 returned error can't find the container with id 12f56f0ed8dcfd1eb69fd6269538b7a5a04b1dad5dc1f1ebf1cf7ea317f4fd1c Aug 01 06:01:27.871063 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:27.871029 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" event={"ID":"18b6c0c7-73ff-4434-8840-69703e57b283","Type":"ContainerStarted","Data":"12f56f0ed8dcfd1eb69fd6269538b7a5a04b1dad5dc1f1ebf1cf7ea317f4fd1c"} Aug 01 06:01:34.911730 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:34.911693 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" event={"ID":"18b6c0c7-73ff-4434-8840-69703e57b283","Type":"ContainerStarted","Data":"359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4"} Aug 01 06:01:34.912227 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:34.911741 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" event={"ID":"18b6c0c7-73ff-4434-8840-69703e57b283","Type":"ContainerStarted","Data":"c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539"} Aug 01 06:01:34.927966 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:34.926464 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" podStartSLOduration=1.5322405460000001 podStartE2EDuration="7.926443631s" totalImagesPullingTime="6.394203085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-01 06:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 06:01:34.925014432 +0000 UTC m=+1105.321198570" watchObservedRunningTime="2026-08-01 06:01:34.926443631 +0000 UTC m=+1105.322627769" Aug 01 06:01:39.088940 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:01:39.088901 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:01:43.494855 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:01:43.494826 2561 ???:1] "http: TLS handshake error from 10.0.136.146:58112: EOF" Aug 01 06:01:51.088972 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:01:51.088943 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:02:04.089003 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:04.088973 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:02:19.118730 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:19.118693 2561 generic.go:356] "Generic (PLEG): container finished" podID="18b6c0c7-73ff-4434-8840-69703e57b283" containerID="c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539" exitCode=0 Aug 01 06:02:19.119083 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:19.118768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" event={"ID":"18b6c0c7-73ff-4434-8840-69703e57b283","Type":"ContainerDied","Data":"c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539"} Aug 01 06:02:19.119083 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:19.119072 2561 scope.go:117] "RemoveContainer" containerID="c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539" Aug 01 06:02:19.377023 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:19.376932 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bmg8r_must-gather-nbbpw_18b6c0c7-73ff-4434-8840-69703e57b283/gather/0.log" Aug 01 06:02:19.715506 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:19.715476 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 06:02:19.865415 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:19.865381 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 06:02:19.878362 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:19.878328 2561 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" image="quay.io/opendatahub/trainer:odh-3.5" Aug 01 06:02:19.878512 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:19.878450 2561 kuberuntime_manager.go:1459] "Unhandled Error" err="container manager start failed in pod kubeflow-trainer-controller-manager-679c94ffcd-cwmbq_opendatahub(9adb71c7-af42-4012-b915-8c579771f586): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown" logger="UnhandledError" Aug 01 06:02:19.878512 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:19.878493 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:02:20.047606 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:20.047530 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 06:02:22.591488 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:22.591450 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wkpzk_54bfe892-21bb-4ece-b41c-f7b533281c1a/global-pull-secret-syncer/0.log" Aug 01 06:02:22.628269 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:22.628218 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" Aug 01 06:02:22.763847 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:22.763817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-6.ec2.internal_b41a42c4a640d469582886dee01f9988/haproxy/0.log" Aug 01 06:02:24.692651 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:24.692621 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-bmg8r/must-gather-nbbpw"] Aug 01 06:02:24.693057 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:24.692804 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" containerName="copy" containerID="cri-o://359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4" gracePeriod=2 Aug 01 06:02:24.698927 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:24.698902 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-bmg8r/must-gather-nbbpw"] Aug 01 06:02:24.699283 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:24.699254 2561 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"18b6c0c7-73ff-4434-8840-69703e57b283\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-bmg8r\"/\"must-gather-nbbpw\": pods \"must-gather-nbbpw\" not found" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:02:24.932696 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:24.932672 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bmg8r_must-gather-nbbpw_18b6c0c7-73ff-4434-8840-69703e57b283/copy/0.log" Aug 01 06:02:24.935175 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:24.935158 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:02:24.937000 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:24.936977 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nbbpw\" is forbidden: User \"system:node:ip-10-0-138-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bmg8r\": no relationship found between node 'ip-10-0-138-6.ec2.internal' and this object" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:02:25.052651 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.052577 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfnkh\" (UniqueName: \"kubernetes.io/projected/18b6c0c7-73ff-4434-8840-69703e57b283-kube-api-access-hfnkh\") pod \"18b6c0c7-73ff-4434-8840-69703e57b283\" (UID: \"18b6c0c7-73ff-4434-8840-69703e57b283\") " Aug 01 06:02:25.052799 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.052706 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18b6c0c7-73ff-4434-8840-69703e57b283-must-gather-output\") pod \"18b6c0c7-73ff-4434-8840-69703e57b283\" (UID: \"18b6c0c7-73ff-4434-8840-69703e57b283\") " Aug 01 06:02:25.054795 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.054766 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18b6c0c7-73ff-4434-8840-69703e57b283-kube-api-access-hfnkh" (OuterVolumeSpecName: "kube-api-access-hfnkh") pod "18b6c0c7-73ff-4434-8840-69703e57b283" (UID: "18b6c0c7-73ff-4434-8840-69703e57b283"). InnerVolumeSpecName "kube-api-access-hfnkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Aug 01 06:02:25.054907 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.054826 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18b6c0c7-73ff-4434-8840-69703e57b283-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "18b6c0c7-73ff-4434-8840-69703e57b283" (UID: "18b6c0c7-73ff-4434-8840-69703e57b283"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Aug 01 06:02:25.096760 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.096733 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 06:02:25.150635 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.150612 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-bmg8r_must-gather-nbbpw_18b6c0c7-73ff-4434-8840-69703e57b283/copy/0.log" Aug 01 06:02:25.150945 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.150921 2561 generic.go:356] "Generic (PLEG): container finished" podID="18b6c0c7-73ff-4434-8840-69703e57b283" containerID="359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4" exitCode=143 Aug 01 06:02:25.150995 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.150978 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:02:25.151044 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.151028 2561 scope.go:117] "RemoveContainer" containerID="359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4" Aug 01 06:02:25.153106 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:25.153080 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nbbpw\" is forbidden: User \"system:node:ip-10-0-138-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bmg8r\": no relationship found between node 'ip-10-0-138-6.ec2.internal' and this object" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:02:25.153902 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.153869 2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/18b6c0c7-73ff-4434-8840-69703e57b283-must-gather-output\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 06:02:25.153902 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.153893 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfnkh\" (UniqueName: \"kubernetes.io/projected/18b6c0c7-73ff-4434-8840-69703e57b283-kube-api-access-hfnkh\") on node \"ip-10-0-138-6.ec2.internal\" DevicePath \"\"" Aug 01 06:02:25.159808 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.159791 2561 scope.go:117] "RemoveContainer" containerID="c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539" Aug 01 06:02:25.161034 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:25.161014 2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-nbbpw\" is forbidden: User \"system:node:ip-10-0-138-6.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-bmg8r\": no relationship found between node 'ip-10-0-138-6.ec2.internal' and this object" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" pod="openshift-must-gather-bmg8r/must-gather-nbbpw" Aug 01 06:02:25.170359 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.170340 2561 scope.go:117] "RemoveContainer" containerID="359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4" Aug 01 06:02:25.170609 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:25.170587 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4\": container with ID starting with 359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4 not found: ID does not exist" containerID="359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4" Aug 01 06:02:25.170681 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.170620 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4"} err="failed to get container status \"359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4\": rpc error: code = NotFound desc = could not find container \"359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4\": container with ID starting with 359e89578f1618993caa0e7b435ccc31a787075d58409ceda6f68067946672c4 not found: ID does not exist" Aug 01 06:02:25.170681 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.170643 2561 scope.go:117] "RemoveContainer" containerID="c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539" Aug 01 06:02:25.170900 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:25.170885 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539\": container with ID starting with c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539 not found: ID does not exist" containerID="c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539" Aug 01 06:02:25.170956 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.170908 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539"} err="failed to get container status \"c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539\": rpc error: code = NotFound desc = could not find container \"c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539\": container with ID starting with c89f188442baa57a70a15142514ac00b9aa4a9206c02431d480897af5cae8539 not found: ID does not exist" Aug 01 06:02:25.212526 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:25.212500 2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dfhgz_f7e1f7d9-54f1-44de-b231-fb41d2ef95e9/konnectivity-agent/0.log" limit=1024 Aug 01 06:02:26.093021 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.092988 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" path="/var/lib/kubelet/pods/18b6c0c7-73ff-4434-8840-69703e57b283/volumes" Aug 01 06:02:26.140366 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.140343 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f69459d6-d3e4-4567-813a-9d78246367e8/alertmanager/0.log" Aug 01 06:02:26.169964 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.169943 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f69459d6-d3e4-4567-813a-9d78246367e8/config-reloader/0.log" Aug 01 06:02:26.202523 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.202502 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f69459d6-d3e4-4567-813a-9d78246367e8/kube-rbac-proxy-web/0.log" Aug 01 06:02:26.235661 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.235638 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f69459d6-d3e4-4567-813a-9d78246367e8/kube-rbac-proxy/0.log" Aug 01 06:02:26.266267 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.266226 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f69459d6-d3e4-4567-813a-9d78246367e8/kube-rbac-proxy-metric/0.log" Aug 01 06:02:26.293513 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.293485 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f69459d6-d3e4-4567-813a-9d78246367e8/prom-label-proxy/0.log" Aug 01 06:02:26.328213 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.328191 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f69459d6-d3e4-4567-813a-9d78246367e8/init-config-reloader/0.log" Aug 01 06:02:26.392656 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.392596 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-8fc6c_d64ed186-4a7a-40b0-a36a-b84931d651f6/kube-state-metrics/0.log" Aug 01 06:02:26.417405 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.417382 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-8fc6c_d64ed186-4a7a-40b0-a36a-b84931d651f6/kube-rbac-proxy-main/0.log" Aug 01 06:02:26.448447 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.448419 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-8fc6c_d64ed186-4a7a-40b0-a36a-b84931d651f6/kube-rbac-proxy-self/0.log" Aug 01 06:02:26.477881 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.477859 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-769cfbc494-mvm8w_91d7d46e-44c1-43e0-a9f6-5cb832029ec8/metrics-server/0.log" Aug 01 06:02:26.505242 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.505220 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-mlfnj_34668055-10ab-4a09-83ea-79bad5c73dfc/monitoring-plugin/0.log" Aug 01 06:02:26.537639 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.537623 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6hmm_ca172704-89ee-49fe-8d1d-a1b29cb3a140/node-exporter/0.log" Aug 01 06:02:26.563392 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.563374 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6hmm_ca172704-89ee-49fe-8d1d-a1b29cb3a140/kube-rbac-proxy/0.log" Aug 01 06:02:26.589963 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.589947 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c6hmm_ca172704-89ee-49fe-8d1d-a1b29cb3a140/init-textfile/0.log" Aug 01 06:02:26.784621 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.784594 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7kq89_274ca062-20d2-4b1d-8024-1b4423f625bf/kube-rbac-proxy-main/0.log" Aug 01 06:02:26.808168 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.808121 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7kq89_274ca062-20d2-4b1d-8024-1b4423f625bf/kube-rbac-proxy-self/0.log" Aug 01 06:02:26.831346 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.831323 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-7kq89_274ca062-20d2-4b1d-8024-1b4423f625bf/openshift-state-metrics/0.log" Aug 01 06:02:26.873298 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.873279 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5cea01a8-adcc-4d24-92c0-e8597c108886/prometheus/0.log" Aug 01 06:02:26.901314 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.901296 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5cea01a8-adcc-4d24-92c0-e8597c108886/config-reloader/0.log" Aug 01 06:02:26.921223 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.921206 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5cea01a8-adcc-4d24-92c0-e8597c108886/thanos-sidecar/0.log" Aug 01 06:02:26.946170 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.946119 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5cea01a8-adcc-4d24-92c0-e8597c108886/kube-rbac-proxy-web/0.log" Aug 01 06:02:26.968593 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.968575 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5cea01a8-adcc-4d24-92c0-e8597c108886/kube-rbac-proxy/0.log" Aug 01 06:02:26.989712 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:26.989693 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5cea01a8-adcc-4d24-92c0-e8597c108886/kube-rbac-proxy-thanos/0.log" Aug 01 06:02:27.014077 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.014060 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5cea01a8-adcc-4d24-92c0-e8597c108886/init-config-reloader/0.log" Aug 01 06:02:27.042240 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.042217 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-kgfqd_0b41cbbe-553b-4d7e-bfdf-67a2b9da610a/prometheus-operator/0.log" Aug 01 06:02:27.062193 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.062173 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-kgfqd_0b41cbbe-553b-4d7e-bfdf-67a2b9da610a/kube-rbac-proxy/0.log" Aug 01 06:02:27.088860 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.088840 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-7tkhb_efdf14f1-e365-4224-ad25-8bcf039652e9/prometheus-operator-admission-webhook/0.log" Aug 01 06:02:27.119150 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.119131 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7546c9fbc-62b9x_6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34/telemeter-client/0.log" Aug 01 06:02:27.145801 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.145782 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7546c9fbc-62b9x_6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34/reload/0.log" Aug 01 06:02:27.168717 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.168701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7546c9fbc-62b9x_6a9f5ef3-fda5-4f4f-a3ee-5ba14c333c34/kube-rbac-proxy/0.log" Aug 01 06:02:27.194662 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.194645 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69f475d4cb-46qpk_b346db4e-464b-49fd-970b-24904b3e3bc5/thanos-query/0.log" Aug 01 06:02:27.213954 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.213904 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69f475d4cb-46qpk_b346db4e-464b-49fd-970b-24904b3e3bc5/kube-rbac-proxy-web/0.log" Aug 01 06:02:27.234319 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.234299 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69f475d4cb-46qpk_b346db4e-464b-49fd-970b-24904b3e3bc5/kube-rbac-proxy/0.log" Aug 01 06:02:27.261356 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.261335 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69f475d4cb-46qpk_b346db4e-464b-49fd-970b-24904b3e3bc5/prom-label-proxy/0.log" Aug 01 06:02:27.285353 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.285337 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69f475d4cb-46qpk_b346db4e-464b-49fd-970b-24904b3e3bc5/kube-rbac-proxy-rules/0.log" Aug 01 06:02:27.311825 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:27.311798 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-69f475d4cb-46qpk_b346db4e-464b-49fd-970b-24904b3e3bc5/kube-rbac-proxy-metrics/0.log" Aug 01 06:02:29.502913 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:29.502879 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-bhmjp_2b7b54aa-c0cc-4706-b611-e8dac31f1d75/download-server/0.log" Aug 01 06:02:30.550765 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.550731 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc"] Aug 01 06:02:30.551198 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.551060 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" containerName="gather" Aug 01 06:02:30.551198 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.551071 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" containerName="gather" Aug 01 06:02:30.551198 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.551081 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" containerName="copy" Aug 01 06:02:30.551198 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.551089 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" containerName="copy" Aug 01 06:02:30.551399 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.551283 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" containerName="gather" Aug 01 06:02:30.551399 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.551299 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="18b6c0c7-73ff-4434-8840-69703e57b283" containerName="copy" Aug 01 06:02:30.556377 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.556359 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.558502 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.558485 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-896p2\"/\"default-dockercfg-qlmts\"" Aug 01 06:02:30.559509 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.559485 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-896p2\"/\"kube-root-ca.crt\"" Aug 01 06:02:30.559610 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.559523 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-896p2\"/\"openshift-service-ca.crt\"" Aug 01 06:02:30.564692 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.564669 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc"] Aug 01 06:02:30.699996 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.699962 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52wp\" (UniqueName: \"kubernetes.io/projected/f1107f57-3651-4d7f-bdd5-3e335125c102-kube-api-access-f52wp\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.700168 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.700011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-lib-modules\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.700168 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.700039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-podres\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.700168 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.700102 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-sys\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.700168 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.700151 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-proc\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801538 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801443 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-lib-modules\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801538 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801496 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-podres\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801762 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801550 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-sys\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801762 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801595 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-proc\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801762 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-lib-modules\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801762 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52wp\" (UniqueName: \"kubernetes.io/projected/f1107f57-3651-4d7f-bdd5-3e335125c102-kube-api-access-f52wp\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801762 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801655 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-sys\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801762 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801670 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-podres\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.801762 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.801694 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f1107f57-3651-4d7f-bdd5-3e335125c102-proc\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.808579 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.808553 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52wp\" (UniqueName: \"kubernetes.io/projected/f1107f57-3651-4d7f-bdd5-3e335125c102-kube-api-access-f52wp\") pod \"perf-node-gather-daemonset-7ztjc\" (UID: \"f1107f57-3651-4d7f-bdd5-3e335125c102\") " pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.815974 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.815955 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njf2l_b83e34bb-eea0-4cc2-9d58-e8de3c99080d/dns/0.log" Aug 01 06:02:30.834027 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.834004 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-njf2l_b83e34bb-eea0-4cc2-9d58-e8de3c99080d/kube-rbac-proxy/0.log" Aug 01 06:02:30.866565 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.866545 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:30.949253 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.949189 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nhvgl_86badb5c-f1d6-470c-b107-faf3ed3e8c3a/dns-node-resolver/0.log" Aug 01 06:02:30.992344 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:30.992323 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc"] Aug 01 06:02:30.994593 ip-10-0-138-6 kubenswrapper[2561]: W0801 06:02:30.994568 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf1107f57_3651_4d7f_bdd5_3e335125c102.slice/crio-fd206574b6611fd6197c29e6215191f81288203f8727a1df011ec5ace6d88026 WatchSource:0}: Error finding container fd206574b6611fd6197c29e6215191f81288203f8727a1df011ec5ace6d88026: Status 404 returned error can't find the container with id fd206574b6611fd6197c29e6215191f81288203f8727a1df011ec5ace6d88026 Aug 01 06:02:31.088431 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:31.088404 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586" Aug 01 06:02:31.178816 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:31.178777 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" event={"ID":"f1107f57-3651-4d7f-bdd5-3e335125c102","Type":"ContainerStarted","Data":"fe917242454fc6acfd147ff7d2e6d6d3059d7063928f0b0703f3f0c881692fc9"} Aug 01 06:02:31.178985 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:31.178852 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" event={"ID":"f1107f57-3651-4d7f-bdd5-3e335125c102","Type":"ContainerStarted","Data":"fd206574b6611fd6197c29e6215191f81288203f8727a1df011ec5ace6d88026"} Aug 01 06:02:31.178985 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:31.178889 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:31.193012 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:31.192946 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" podStartSLOduration=1.192927058 podStartE2EDuration="1.192927058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-01 06:02:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-01 06:02:31.192383898 +0000 UTC m=+1161.588568049" watchObservedRunningTime="2026-08-01 06:02:31.192927058 +0000 UTC m=+1161.589111198" Aug 01 06:02:31.399772 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:31.399751 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qkx6h_ba62bfc3-b408-4a41-92f4-db31ffe596ca/node-ca/0.log" Aug 01 06:02:32.409413 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:32.409333 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7wkjl_43301bca-3de0-4e68-9cf7-744f6f259b31/serve-healthcheck-canary/0.log" Aug 01 06:02:32.886608 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:32.886538 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-msxst_e3f7d27a-a848-4229-81ce-386e082b4f22/kube-rbac-proxy/0.log" Aug 01 06:02:32.905197 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:32.905174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-msxst_e3f7d27a-a848-4229-81ce-386e082b4f22/exporter/0.log" Aug 01 06:02:32.924148 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:32.924128 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-msxst_e3f7d27a-a848-4229-81ce-386e082b4f22/extractor/0.log" Aug 01 06:02:34.524405 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:34.524378 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-kg7ds_1dd2cc07-3f19-4eed-b045-84e99878d4b1/jobset-operator/0.log" Aug 01 06:02:37.192585 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:37.192559 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-896p2/perf-node-gather-daemonset-7ztjc" Aug 01 06:02:39.107953 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.107925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz82h_2f0b550e-d2f8-4904-9a2e-bfcb327bc035/kube-multus-additional-cni-plugins/0.log" Aug 01 06:02:39.127268 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.127224 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz82h_2f0b550e-d2f8-4904-9a2e-bfcb327bc035/egress-router-binary-copy/0.log" Aug 01 06:02:39.147182 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.147159 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz82h_2f0b550e-d2f8-4904-9a2e-bfcb327bc035/cni-plugins/0.log" Aug 01 06:02:39.166378 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.166357 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz82h_2f0b550e-d2f8-4904-9a2e-bfcb327bc035/bond-cni-plugin/0.log" Aug 01 06:02:39.187458 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.187429 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz82h_2f0b550e-d2f8-4904-9a2e-bfcb327bc035/routeoverride-cni/0.log" Aug 01 06:02:39.211639 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.211618 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz82h_2f0b550e-d2f8-4904-9a2e-bfcb327bc035/whereabouts-cni-bincopy/0.log" Aug 01 06:02:39.235195 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.235175 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-gz82h_2f0b550e-d2f8-4904-9a2e-bfcb327bc035/whereabouts-cni/0.log" Aug 01 06:02:39.263118 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.263092 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-k6sxh_542953d0-ab33-4cc3-8069-493a8c14d1c1/kube-multus/0.log" Aug 01 06:02:39.375671 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.375590 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hhc8q_f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f/network-metrics-daemon/0.log" Aug 01 06:02:39.394858 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:39.394832 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hhc8q_f3b9bc89-b25a-4e34-b95a-52cbdcc6c55f/kube-rbac-proxy/0.log" Aug 01 06:02:40.308435 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:40.308408 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r9lp_375d8949-979e-4b00-9d5b-b75d6f276596/ovn-controller/0.log" Aug 01 06:02:40.325778 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:40.325756 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r9lp_375d8949-979e-4b00-9d5b-b75d6f276596/ovn-acl-logging/0.log" Aug 01 06:02:40.345746 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:40.345713 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r9lp_375d8949-979e-4b00-9d5b-b75d6f276596/kube-rbac-proxy-node/0.log" Aug 01 06:02:40.365400 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:40.365379 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r9lp_375d8949-979e-4b00-9d5b-b75d6f276596/kube-rbac-proxy-ovn-metrics/0.log" Aug 01 06:02:40.383394 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:40.383374 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r9lp_375d8949-979e-4b00-9d5b-b75d6f276596/northd/0.log" Aug 01 06:02:40.402518 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:40.402502 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r9lp_375d8949-979e-4b00-9d5b-b75d6f276596/nbdb/0.log" Aug 01 06:02:40.421261 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:40.421225 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r9lp_375d8949-979e-4b00-9d5b-b75d6f276596/sbdb/0.log" Aug 01 06:02:40.454858 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:40.454831 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7r9lp_375d8949-979e-4b00-9d5b-b75d6f276596/ovnkube-controller/0.log" Aug 01 06:02:41.570596 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:41.570566 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-7tpxx_56ff8bc5-1382-49d6-8c80-27b2f5f144f9/network-check-target-container/0.log" Aug 01 06:02:42.413534 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:42.413499 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-d6pz4_8d841c62-35da-434f-bbbf-5baac81af9ad/iptables-alerter/0.log" Aug 01 06:02:43.003356 ip-10-0-138-6 kubenswrapper[2561]: I0801 06:02:43.003330 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-r2c9t_5e94d9f2-84d1-43c7-bdc0-35c073c6eaa3/tuned/0.log" Aug 01 06:02:45.088986 ip-10-0-138-6 kubenswrapper[2561]: E0801 06:02:45.088957 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/trainer:odh-3.5\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/trainer:odh-3.5: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown; artifact err: get manifest: build image source: reading manifest odh-3.5 in quay.io/opendatahub/trainer: manifest unknown\"" pod="opendatahub/kubeflow-trainer-controller-manager-679c94ffcd-cwmbq" podUID="9adb71c7-af42-4012-b915-8c579771f586"