Jul 07 15:00:56.405293 ip-10-0-142-14 systemd[1]: Starting Kubernetes Kubelet... Jul 07 15:00:56.836684 ip-10-0-142-14 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:00:56.836684 ip-10-0-142-14 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 15:00:56.836684 ip-10-0-142-14 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:00:56.836684 ip-10-0-142-14 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 15:00:56.836684 ip-10-0-142-14 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 15:00:56.839603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.839453 2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 15:00:56.845395 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845377 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845397 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845403 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845407 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845411 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845414 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845419 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845423 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845426 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845430 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845433 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845436 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845439 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845442 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:00:56.845442 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845445 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845455 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845458 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845461 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845464 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845467 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845469 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845472 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845475 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845478 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845481 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845484 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845487 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845491 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845495 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845499 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845502 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845505 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845508 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845511 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:00:56.845836 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845514 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845516 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845519 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845522 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845526 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845529 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845531 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845534 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845537 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845539 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845542 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845544 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845547 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845550 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845555 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845558 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845561 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845564 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845567 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:00:56.846364 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845569 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845572 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845575 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845578 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845581 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845583 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845586 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845589 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845592 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845595 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845598 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845601 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845604 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845607 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845610 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845613 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845616 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845618 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845623 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845626 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:00:56.846886 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845629 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845631 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845634 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845637 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845641 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845643 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845646 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845650 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845653 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845656 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845659 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845661 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845664 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845667 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845670 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845673 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845676 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845678 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845682 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845685 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:00:56.847468 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845688 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845690 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845693 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845696 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845700 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.845702 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846490 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846498 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846501 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846506 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846510 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846514 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846517 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846520 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846524 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846527 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846529 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846532 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846535 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:00:56.848021 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846538 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846541 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846544 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846547 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846550 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846552 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846555 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846558 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846561 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846564 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846567 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846570 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846572 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846575 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846578 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846581 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846584 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846587 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846590 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846592 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:00:56.848535 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846595 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846598 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846602 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846604 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846607 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846610 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846615 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846618 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846620 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846623 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846626 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846629 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846632 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846636 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846639 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846642 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846645 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846648 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846650 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846654 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:00:56.849117 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846656 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846659 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846662 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846665 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846667 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846672 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846675 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846679 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846682 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846685 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846688 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846691 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846694 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846697 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846699 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846702 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846705 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846707 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846711 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:00:56.849660 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846714 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846717 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846720 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846722 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846725 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846731 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846734 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846738 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846741 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846744 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846747 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846750 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846752 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846755 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846758 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846761 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846763 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846766 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846769 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846772 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:00:56.850176 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846775 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846777 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846780 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846783 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846786 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846789 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.846791 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847218 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847224 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847228 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847231 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847235 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847238 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847241 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847244 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847247 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847250 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847255 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847258 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847260 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:00:56.850700 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847263 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847266 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847269 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847272 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847274 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847277 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847280 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847282 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847285 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847288 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847291 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847294 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847297 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847299 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847308 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847311 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847314 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847316 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847319 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847322 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:00:56.851247 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847324 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847327 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847330 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847333 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847336 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847339 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847342 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847345 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847348 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847352 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847354 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847357 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847360 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847363 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847366 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847368 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847371 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847374 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847377 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847381 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847384 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:00:56.851769 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847387 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847390 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847392 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847395 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847398 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847401 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847404 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847406 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847411 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847415 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847418 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847422 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847426 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847429 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847432 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847436 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847439 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847442 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:00:56.852362 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847446 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847449 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847453 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847456 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847459 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847462 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847465 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847467 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847470 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847473 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847476 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847479 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847482 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847485 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847489 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847492 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847495 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847498 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847501 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847504 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:00:56.852826 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847506 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847509 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847512 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847514 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847517 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847520 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.847523 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847604 2580 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847612 2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847619 2580 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847624 2580 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847630 2580 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847633 2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847637 2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847643 2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847646 2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847650 2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847653 2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847657 2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847660 2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847663 2580 flags.go:64] FLAG: --cgroup-root="" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847666 2580 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847669 2580 flags.go:64] FLAG: --client-ca-file="" Jul 07 15:00:56.853366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847672 2580 flags.go:64] FLAG: --cloud-provider="external" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847676 2580 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847681 2580 flags.go:64] FLAG: --cluster-domain="" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847684 2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847687 2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847691 2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847694 2580 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847698 2580 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847701 2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847705 2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847708 2580 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847711 2580 flags.go:64] FLAG: --contention-profiling="false" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847714 2580 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847717 2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847720 2580 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847724 2580 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847728 2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847731 2580 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847734 2580 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847737 2580 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847740 2580 flags.go:64] FLAG: --enable-server="true" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847744 2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847748 2580 flags.go:64] FLAG: --event-burst="100" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847753 2580 flags.go:64] FLAG: --event-qps="50" Jul 07 15:00:56.853946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847756 2580 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847759 2580 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847763 2580 flags.go:64] FLAG: --eviction-hard="" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847767 2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847770 2580 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847773 2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847776 2580 flags.go:64] FLAG: --eviction-soft="" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847779 2580 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847782 2580 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847785 2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847788 2580 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847792 2580 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847795 2580 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847798 2580 flags.go:64] FLAG: --feature-gates="" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847802 2580 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847805 2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847809 2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847812 2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847815 2580 flags.go:64] FLAG: --healthz-port="10248" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847818 2580 flags.go:64] FLAG: --help="false" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847821 2580 flags.go:64] FLAG: --hostname-override="ip-10-0-142-14.ec2.internal" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847825 2580 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847828 2580 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 15:00:56.854622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847831 2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847835 2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847839 2580 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847842 2580 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847845 2580 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847848 2580 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847851 2580 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847854 2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847859 2580 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847862 2580 flags.go:64] FLAG: --kube-reserved="" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847865 2580 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847868 2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847872 2580 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847875 2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847878 2580 flags.go:64] FLAG: --lock-file="" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847881 2580 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847884 2580 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847887 2580 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847893 2580 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847896 2580 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847899 2580 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847902 2580 flags.go:64] FLAG: --logging-format="text" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847905 2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847909 2580 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 15:00:56.855313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847912 2580 flags.go:64] FLAG: --manifest-url="" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847915 2580 flags.go:64] FLAG: --manifest-url-header="" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847919 2580 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847923 2580 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847927 2580 flags.go:64] FLAG: --max-pods="110" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847930 2580 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847933 2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847937 2580 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847940 2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847944 2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847947 2580 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847950 2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847958 2580 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847961 2580 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847964 2580 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847973 2580 flags.go:64] FLAG: --pod-cidr="" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847977 2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847983 2580 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847986 2580 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847990 2580 flags.go:64] FLAG: --pods-per-core="0" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847993 2580 flags.go:64] FLAG: --port="10250" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.847997 2580 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848000 2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06728628fa23fe166" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848003 2580 flags.go:64] FLAG: --qos-reserved="" Jul 07 15:00:56.855938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848006 2580 flags.go:64] FLAG: --read-only-port="10255" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848009 2580 flags.go:64] FLAG: --register-node="true" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848012 2580 flags.go:64] FLAG: --register-with-taints="" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848016 2580 flags.go:64] FLAG: --registry-burst="10" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848019 2580 flags.go:64] FLAG: --registry-qps="5" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848022 2580 flags.go:64] FLAG: --reserved-cpus="" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848025 2580 flags.go:64] FLAG: --reserved-memory="" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848033 2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848036 2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848040 2580 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848057 2580 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848060 2580 flags.go:64] FLAG: --runonce="false" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848063 2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848067 2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848070 2580 flags.go:64] FLAG: --seccomp-default="false" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848073 2580 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848076 2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848079 2580 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848082 2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848086 2580 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848089 2580 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848092 2580 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848095 2580 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848100 2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848103 2580 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 15:00:56.856597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848109 2580 flags.go:64] FLAG: --system-cgroups="" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848112 2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848118 2580 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848121 2580 flags.go:64] FLAG: --tls-cert-file="" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848125 2580 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848129 2580 flags.go:64] FLAG: --tls-min-version="" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848133 2580 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848136 2580 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848139 2580 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848142 2580 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848146 2580 flags.go:64] FLAG: --v="2" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848150 2580 flags.go:64] FLAG: --version="false" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848154 2580 flags.go:64] FLAG: --vmodule="" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848158 2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848162 2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848285 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848289 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848292 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848295 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848299 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848302 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848305 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848308 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:00:56.857286 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848311 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848314 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848316 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848319 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848322 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848325 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848327 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848333 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848336 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848340 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848343 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848346 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848349 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848351 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848354 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848357 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848360 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848363 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848366 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:00:56.857970 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848370 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848374 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848377 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848380 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848383 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848386 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848389 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848392 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848395 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848398 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848401 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848404 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848407 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848410 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848413 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848416 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848418 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848421 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848424 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848426 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:00:56.858783 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848431 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848434 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848438 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848441 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848445 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848447 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848451 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848453 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848456 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848459 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848461 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848464 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848467 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848470 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848472 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848475 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848478 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848480 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848483 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848486 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:00:56.859490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848488 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848491 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848494 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848497 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848499 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848502 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848505 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848507 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848510 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848513 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848516 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848518 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848524 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848526 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848551 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848555 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848558 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848562 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848565 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848568 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:00:56.860010 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848571 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848575 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848577 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848580 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848583 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848586 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848589 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848593 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848597 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848600 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848603 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.848607 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.848613 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.856271 2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 15:00:56.860543 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.856292 2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.857322 2580 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.857330 2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857397 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857402 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857406 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857409 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857412 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857415 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857419 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857423 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857426 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857429 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857432 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857435 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857438 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857441 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857444 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857447 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:00:56.860934 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857450 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857453 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857455 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857458 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857461 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857464 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857466 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857469 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857471 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857474 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857477 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857479 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857482 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857491 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857494 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857497 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857499 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857502 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857505 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857507 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:00:56.861443 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857510 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857513 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857515 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857518 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857521 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857524 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857527 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857530 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857533 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857536 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857539 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857541 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857544 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857547 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857549 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857552 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857555 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857558 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857560 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:00:56.861962 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857563 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857566 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857568 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857571 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857574 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857576 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857581 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857635 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857859 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857869 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857874 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857881 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857886 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857893 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857897 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857945 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857951 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857957 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857964 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:00:56.862490 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857969 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857977 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857988 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857993 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.857998 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858003 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858007 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858013 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858018 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858022 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858027 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858031 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858035 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858040 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858066 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858074 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858079 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858084 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858091 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:00:56.863000 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858098 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858103 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858139 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858144 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858148 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858154 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.858163 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858767 2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858778 2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858784 2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858789 2580 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858800 2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858805 2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858810 2580 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858815 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 15:00:56.863545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858826 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858830 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858835 2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858840 2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858845 2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858849 2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858854 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858858 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858863 2580 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858867 2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858872 2580 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858876 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858886 2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858891 2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858896 2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858900 2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858904 2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.858911 2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859431 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859579 2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 15:00:56.863954 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859584 2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859588 2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859591 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859595 2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859598 2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859602 2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859605 2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859610 2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859612 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859615 2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859618 2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859622 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859624 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859628 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859630 2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859633 2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859636 2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859639 2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859642 2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 15:00:56.864607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859645 2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859648 2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859651 2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859654 2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859657 2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859659 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859662 2580 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859665 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859668 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859671 2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859674 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859677 2580 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859682 2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859685 2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859689 2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859692 2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859695 2580 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859698 2580 feature_gate.go:328] unrecognized feature gate: Example Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859701 2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859704 2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 15:00:56.865115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859708 2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859710 2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859713 2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859716 2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859718 2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859721 2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859727 2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859731 2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859734 2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859738 2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859741 2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859744 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859747 2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859750 2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859753 2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859757 2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859761 2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859764 2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859767 2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 15:00:56.865636 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859770 2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859773 2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859776 2580 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859780 2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859782 2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859786 2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859789 2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859791 2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859794 2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859797 2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859800 2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859803 2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:56.859805 2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.859812 2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 15:00:56.866151 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.859985 2580 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 15:00:56.866515 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.862356 2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 15:00:56.866515 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.865041 2580 server.go:1019] "Starting client certificate rotation" Jul 07 15:00:56.866515 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.865168 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:00:56.866515 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.865203 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 15:00:56.867981 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.867966 2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:00:56.885432 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.885350 2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 15:00:56.896999 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.896970 2580 log.go:25] "Validated CRI v1 runtime API" Jul 07 15:00:56.899487 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.899468 2580 log.go:25] "Validated CRI v1 image API" Jul 07 15:00:56.900411 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.900394 2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 15:00:56.906557 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.906502 2580 fs.go:135] Filesystem UUIDs: map[0c80197d-9b0e-4380-bc20-9d02af8f6849:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a1c3a305-eee0-4df4-974e-448ac93ff120:/dev/nvme0n1p4] Jul 07 15:00:56.906557 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.906538 2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 15:00:56.911047 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.911028 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:00:56.912265 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.912141 2580 manager.go:216] Machine: {Timestamp:2026-07-07 15:00:56.910598462 +0000 UTC m=+0.385435205 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097392 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2de3cd17251793b2989f67459abb91 SystemUUID:ec2de3cd-1725-1793-b298-9f67459abb91 BootID:6f8ce4d4-a3a8-4ca4-8fb4-9d05acc36d8b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:04:40:ed:1c:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:04:40:ed:1c:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:fa:8c:e3:5b:9a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 15:00:56.912265 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.912264 2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 15:00:56.912392 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.912354 2580 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 15:00:56.917519 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.917487 2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 15:00:56.917679 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.917522 2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-14.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 15:00:56.918851 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.918840 2580 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 15:00:56.918887 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.918853 2580 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 15:00:56.918887 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.918862 2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:00:56.919537 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.919525 2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 15:00:56.920896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.920886 2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 15:00:56.924166 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924154 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:00:56.924293 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924283 2580 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 15:00:56.924324 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924316 2580 kubelet.go:486] "Attempting to sync node with API server" Jul 07 15:00:56.924360 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924332 2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 15:00:56.924360 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924345 2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 15:00:56.924360 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924355 2580 kubelet.go:398] "Adding apiserver pod source" Jul 07 15:00:56.924458 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924364 2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 15:00:56.924955 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924931 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:00:56.925100 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.924963 2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 15:00:56.928870 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.928838 2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 15:00:56.930966 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.930948 2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 15:00:56.931036 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.930982 2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 15:00:56.932737 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932722 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 15:00:56.932737 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932740 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932746 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932753 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932762 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932768 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932779 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932789 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932798 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932804 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932812 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 15:00:56.932842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.932819 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 15:00:56.933625 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.933606 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 15:00:56.933625 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.933617 2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 15:00:56.937173 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.937160 2580 server.go:1268] "Started kubelet" Jul 07 15:00:56.937334 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.937270 2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 15:00:56.937422 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.937358 2580 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 15:00:56.937469 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.937451 2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 15:00:56.938049 ip-10-0-142-14 systemd[1]: Started Kubernetes Kubelet. Jul 07 15:00:56.938746 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.938697 2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 15:00:56.939106 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.939073 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 15:00:56.939219 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.939159 2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-14.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 15:00:56.939476 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.939451 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 15:00:56.939707 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.939688 2580 server.go:310] "Adding debug handlers to kubelet server" Jul 07 15:00:56.943625 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.943605 2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 15:00:56.944745 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.944729 2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 15:00:56.944836 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.944805 2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 15:00:56.944892 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.943875 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-14.ec2.internal.18c00a022f37fe42 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-14.ec2.internal,UID:ip-10-0-142-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-14.ec2.internal,},FirstTimestamp:2026-07-07 15:00:56.93712749 +0000 UTC m=+0.411964232,LastTimestamp:2026-07-07 15:00:56.93712749 +0000 UTC m=+0.411964232,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-14.ec2.internal,}" Jul 07 15:00:56.944892 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.944873 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:56.945344 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.945322 2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 15:00:56.945344 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.945339 2580 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 15:00:56.945452 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.945355 2580 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 15:00:56.945551 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.945509 2580 reconstruct.go:97] "Volume reconstruction finished" Jul 07 15:00:56.945551 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.945517 2580 reconciler.go:29] "Reconciler: start to sync state" Jul 07 15:00:56.945782 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.945762 2580 factory.go:55] Registering systemd factory Jul 07 15:00:56.945862 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.945785 2580 factory.go:223] Registration of the systemd container factory successfully Jul 07 15:00:56.946068 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.946026 2580 factory.go:153] Registering CRI-O factory Jul 07 15:00:56.946068 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.946047 2580 factory.go:223] Registration of the crio container factory successfully Jul 07 15:00:56.946194 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.946098 2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 15:00:56.946194 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.946125 2580 factory.go:103] Registering Raw factory Jul 07 15:00:56.946194 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.946140 2580 manager.go:1196] Started watching for new ooms in manager Jul 07 15:00:56.946842 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.946828 2580 manager.go:349] Starting recovery of all containers Jul 07 15:00:56.949677 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.949197 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kqwmm" Jul 07 15:00:56.952012 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.951979 2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 15:00:56.952577 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.952550 2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-14.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 15:00:56.954514 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.954411 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 15:00:56.956752 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.956581 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kqwmm" Jul 07 15:00:56.958745 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.958716 2580 manager.go:354] Recovery completed Jul 07 15:00:56.961667 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.961639 2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 15:00:56.965366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.965353 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:00:56.967545 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.967529 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:00:56.967622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.967559 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:00:56.967622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.967574 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:00:56.968202 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.968188 2580 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 15:00:56.968202 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.968197 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:00:56.968202 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.968203 2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 15:00:56.968345 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.968223 2580 state_mem.go:36] "Initialized new in-memory state store" Jul 07 15:00:56.968938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.968912 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:00:56.968938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.968940 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:00:56.969042 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.968949 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:00:56.969571 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.969557 2580 policy_none.go:49] "None policy: Start" Jul 07 15:00:56.969606 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.969577 2580 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 15:00:56.969606 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.969588 2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 15:00:56.970666 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:56.970652 2580 policy_none.go:47] "Start" Jul 07 15:00:56.971006 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:56.970938 2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-14.ec2.internal.18c00a0231081e39 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-14.ec2.internal,UID:ip-10-0-142-14.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-14.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-14.ec2.internal,},FirstTimestamp:2026-07-07 15:00:56.967544377 +0000 UTC m=+0.442381122,LastTimestamp:2026-07-07 15:00:56.967544377 +0000 UTC m=+0.442381122,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-14.ec2.internal,}" Jul 07 15:00:57.002676 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.002660 2580 manager.go:337] "Starting Device Plugin manager" Jul 07 15:00:57.002763 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.002695 2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 15:00:57.002763 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.002706 2580 server.go:87] "Starting device plugin registration server" Jul 07 15:00:57.002952 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.002942 2580 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 15:00:57.003007 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.002954 2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 15:00:57.003118 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.003103 2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 15:00:57.003200 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.003189 2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 15:00:57.003251 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.003203 2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 15:00:57.003844 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.003822 2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 15:00:57.003924 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.003882 2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.092194 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.092159 2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 15:00:57.093663 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.092208 2580 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 15:00:57.093663 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.092233 2580 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 15:00:57.093663 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.092269 2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 15:00:57.094535 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.094515 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:00:57.103792 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.103766 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:00:57.104706 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.104691 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:00:57.104784 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.104723 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:00:57.104784 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.104739 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:00:57.104784 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.104766 2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.120092 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.120073 2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.120210 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.120098 2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-14.ec2.internal\": node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.192435 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.192335 2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal"] Jul 07 15:00:57.192435 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.192422 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:00:57.193404 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.193386 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:00:57.193478 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.193419 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:00:57.193478 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.193432 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:00:57.194875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.194861 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:00:57.195013 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.194994 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.195084 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.195029 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:00:57.195298 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.195280 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.195666 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.195648 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:00:57.195718 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.195682 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:00:57.195718 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.195693 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:00:57.195792 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.195646 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:00:57.195792 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.195758 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:00:57.195792 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.195772 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:00:57.197194 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.197180 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.197264 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.197207 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:00:57.197911 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.197893 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:00:57.198029 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.197926 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:00:57.198029 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.197941 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:00:57.223092 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.223058 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-14.ec2.internal\" not found" node="ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.228013 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.227991 2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-14.ec2.internal\" not found" node="ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.247281 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.247249 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/84e1a630562b1b5cdfa159e0128e6564-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal\" (UID: \"84e1a630562b1b5cdfa159e0128e6564\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.247492 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.247289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e1a630562b1b5cdfa159e0128e6564-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal\" (UID: \"84e1a630562b1b5cdfa159e0128e6564\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.247492 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.247315 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aaae9886cf90bd3452823e4171c4905-config\") pod \"kube-apiserver-proxy-ip-10-0-142-14.ec2.internal\" (UID: \"8aaae9886cf90bd3452823e4171c4905\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.295960 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.295923 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.347903 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.347875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aaae9886cf90bd3452823e4171c4905-config\") pod \"kube-apiserver-proxy-ip-10-0-142-14.ec2.internal\" (UID: \"8aaae9886cf90bd3452823e4171c4905\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.347966 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.347911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/84e1a630562b1b5cdfa159e0128e6564-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal\" (UID: \"84e1a630562b1b5cdfa159e0128e6564\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.347966 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.347943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e1a630562b1b5cdfa159e0128e6564-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal\" (UID: \"84e1a630562b1b5cdfa159e0128e6564\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.348073 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.347978 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84e1a630562b1b5cdfa159e0128e6564-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal\" (UID: \"84e1a630562b1b5cdfa159e0128e6564\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.348073 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.347997 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8aaae9886cf90bd3452823e4171c4905-config\") pod \"kube-apiserver-proxy-ip-10-0-142-14.ec2.internal\" (UID: \"8aaae9886cf90bd3452823e4171c4905\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.348073 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.348017 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/84e1a630562b1b5cdfa159e0128e6564-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal\" (UID: \"84e1a630562b1b5cdfa159e0128e6564\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.397965 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.397927 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.501345 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.501262 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.527138 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.527095 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.531441 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.531338 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:57.602812 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.602768 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.706642 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.706610 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.808559 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.808475 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.863333 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.863299 2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 15:00:57.863862 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.863469 2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 15:00:57.911933 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:57.911888 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:57.961479 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.961423 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:55:57 +0000 UTC" deadline="2028-02-12 16:05:37.894480847 +0000 UTC" Jul 07 15:00:57.961479 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:57.961470 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14041h4m39.933014972s" Jul 07 15:00:58.012449 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:58.012426 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:58.067454 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.067381 2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:00:58.101709 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.101683 2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 15:00:58.102901 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.102875 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientMemory" Jul 07 15:00:58.103037 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.102919 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 15:00:58.103037 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.102934 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeHasSufficientPID" Jul 07 15:00:58.113507 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:58.113487 2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-14.ec2.internal\" not found" Jul 07 15:00:58.114775 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:58.114745 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aaae9886cf90bd3452823e4171c4905.slice/crio-abb64dbe6298db60ba171ccccecb80187b1ad59f42e33677368dd3ba3530def9 WatchSource:0}: Error finding container abb64dbe6298db60ba171ccccecb80187b1ad59f42e33677368dd3ba3530def9: Status 404 returned error can't find the container with id abb64dbe6298db60ba171ccccecb80187b1ad59f42e33677368dd3ba3530def9 Jul 07 15:00:58.115202 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:00:58.115179 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84e1a630562b1b5cdfa159e0128e6564.slice/crio-2e1e6bb83903d0701f78e0fcefa08bc81569ffd26b4ce362766247552c24274e WatchSource:0}: Error finding container 2e1e6bb83903d0701f78e0fcefa08bc81569ffd26b4ce362766247552c24274e: Status 404 returned error can't find the container with id 2e1e6bb83903d0701f78e0fcefa08bc81569ffd26b4ce362766247552c24274e Jul 07 15:00:58.120416 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.120394 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:00:58.168894 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.168865 2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:00:58.246166 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.246125 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" Jul 07 15:00:58.260740 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.260718 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:00:58.262584 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.262569 2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" Jul 07 15:00:58.276037 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.276022 2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 15:00:58.440471 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.440379 2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:00:58.926399 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.926072 2580 apiserver.go:52] "Watching apiserver" Jul 07 15:00:58.945026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.944990 2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 15:00:58.946303 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.946264 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-95qkd","openshift-multus/multus-rqsg6","openshift-multus/network-metrics-daemon-7s789","openshift-network-diagnostics/network-check-target-mwbqx","openshift-network-operator/iptables-alerter-7bjcd","openshift-ovn-kubernetes/ovnkube-node-grhnt","kube-system/global-pull-secret-syncer-6zmxl","kube-system/konnectivity-agent-2rbx7","kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d","openshift-cluster-node-tuning-operator/tuned-nktth","openshift-dns/node-resolver-pw298","openshift-image-registry/node-ca-crvz6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal"] Jul 07 15:00:58.946853 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.946831 2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 15:00:58.948092 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.948032 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:58.948209 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:58.948116 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:00:58.949598 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.949572 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:58.950937 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.950916 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:00:58.951107 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:58.951056 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:00:58.953347 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.953324 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:00:58.953450 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:58.953411 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:00:58.953521 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.953501 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 15:00:58.953775 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.953754 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 15:00:58.954457 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.954436 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 15:00:58.954722 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.954705 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vg527\"" Jul 07 15:00:58.955016 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.955000 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:58.956535 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.956511 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:58.958138 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.958117 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:00:58.958238 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.958169 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zdfqh\"" Jul 07 15:00:58.958441 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.958422 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:00:58.960607 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.958649 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 15:00:58.960607 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.959591 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 15:00:58.960607 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.960106 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 15:00:58.960607 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.960341 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 15:00:58.960885 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.960707 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:58.961802 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.961503 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqsg6" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.962656 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.962688 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.962761 2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.962869 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-x8xkk\"" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.962933 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.963017 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.963051 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zqgpb\"" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.963064 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 15:00:58.963342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.963181 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 15:00:58.963890 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.963712 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:58.963890 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.963863 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 15:00:58.964221 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.964090 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 15:00:58.964922 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.964892 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 15:00:58.965237 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.965218 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 15:00:58.965804 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.965643 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-tfmx7\"" Jul 07 15:00:58.965924 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.965906 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 15:00:58.966107 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.966088 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:58.966282 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.966248 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 15:00:58.966620 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.966600 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6hj2w\"" Jul 07 15:00:58.967162 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.967129 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:58.967398 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.967380 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hzdc8\"" Jul 07 15:00:58.967465 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.967418 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 15:00:58.967465 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.967453 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 15:00:58.967570 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.967516 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 15:00:58.969696 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.969662 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:00:58.970151 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.970122 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 15:00:58.970562 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.970543 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xcr2x\"" Jul 07 15:00:58.971062 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.970717 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 15:00:58.971062 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.970923 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4ptwx\"" Jul 07 15:00:58.971062 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.970934 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 15:00:58.989623 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.989597 2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l592x" Jul 07 15:00:58.997194 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:58.997164 2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l592x" Jul 07 15:00:59.046498 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.046477 2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 15:00:59.057597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057565 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-cni-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.057748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057609 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-host\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.057748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc21a381-7bad-4e2c-b719-4792135feadc-iptables-alerter-script\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.057748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057669 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-var-lib-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.057748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057697 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovn-node-metrics-cert\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.057748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057725 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.057947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057751 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-modprobe-d\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.057947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysctl-conf\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.057947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057801 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-systemd-units\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.057947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057826 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-kubelet\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.057947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057854 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-system-cni-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.057947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057877 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-slash\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.057947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057901 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-sys-fs\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.057947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057925 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/961c0f48-8801-47a4-8cb0-8f526398f88a-serviceca\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.057969 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovnkube-script-lib\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058020 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-os-release\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058047 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058072 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058125 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mng9s\" (UniqueName: \"kubernetes.io/projected/961c0f48-8801-47a4-8cb0-8f526398f88a-kube-api-access-mng9s\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058150 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-cni-bin\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058174 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc21a381-7bad-4e2c-b719-4792135feadc-host-slash\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.058283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058270 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-socket-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058293 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-daemon-config\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058321 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-lib-modules\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058338 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z42ws\" (UniqueName: \"kubernetes.io/projected/b7e359fb-fdd2-4166-a0b6-859097b93e40-kube-api-access-z42ws\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-kubelet-config\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058381 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzmw\" (UniqueName: \"kubernetes.io/projected/a7841608-6ac1-45b9-afe9-3b18712dcc58-kube-api-access-fgzmw\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-cni-bin\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-device-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058464 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v442m\" (UniqueName: \"kubernetes.io/projected/54335d5f-5840-4583-805a-60bb2ceb387c-kube-api-access-v442m\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058488 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-etc-kubernetes\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058512 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058536 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-systemd\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058558 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-ovn\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.058612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058587 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-cni-multus\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058623 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysctl-d\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058661 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abf01a38-1970-481f-8ad6-0901092e11e5-tmp\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058689 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-dbus\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058728 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-run-ovn-kubernetes\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058756 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-system-cni-dir\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058790 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cni-binary-copy\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058820 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-socket-dir-parent\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-conf-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058871 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-systemd\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058899 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wggpw\" (UniqueName: \"kubernetes.io/projected/abf01a38-1970-481f-8ad6-0901092e11e5-kube-api-access-wggpw\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058924 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-etc-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058947 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.058975 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-run\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059009 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89a25915-f232-4d60-aab5-e657bcb013ef-agent-certs\") pod \"konnectivity-agent-2rbx7\" (UID: \"89a25915-f232-4d60-aab5-e657bcb013ef\") " pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059059 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/961c0f48-8801-47a4-8cb0-8f526398f88a-host\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.059245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059091 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-k8s-cni-cncf-io\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059117 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-multus-certs\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059156 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysconfig\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-kubernetes\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059202 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-sys\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059224 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7e359fb-fdd2-4166-a0b6-859097b93e40-hosts-file\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059266 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4j2nk\" (UniqueName: \"kubernetes.io/projected/dc21a381-7bad-4e2c-b719-4792135feadc-kube-api-access-4j2nk\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059289 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-env-overrides\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059315 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-cni-binary-copy\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059345 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-netns\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059370 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-var-lib-kubelet\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-kubelet\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059415 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z9bv\" (UniqueName: \"kubernetes.io/projected/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-kube-api-access-5z9bv\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059472 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cnibin\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059496 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-os-release\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/abf01a38-1970-481f-8ad6-0901092e11e5-etc-tuned\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e359fb-fdd2-4166-a0b6-859097b93e40-tmp-dir\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.059995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-run-netns\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059604 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-etc-selinux\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059650 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-hostroot\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059684 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84sw4\" (UniqueName: \"kubernetes.io/projected/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-kube-api-access-84sw4\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059707 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-log-socket\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-cni-netd\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059755 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059782 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovnkube-config\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059811 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-cnibin\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059834 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-node-log\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059921 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89a25915-f232-4d60-aab5-e657bcb013ef-konnectivity-ca\") pod \"konnectivity-agent-2rbx7\" (UID: \"89a25915-f232-4d60-aab5-e657bcb013ef\") " pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.059964 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-registration-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.060875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.060011 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htmvj\" (UniqueName: \"kubernetes.io/projected/3f97ab07-a0f3-4bf6-b1c5-e635db360507-kube-api-access-htmvj\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.097627 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.097566 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" event={"ID":"8aaae9886cf90bd3452823e4171c4905","Type":"ContainerStarted","Data":"abb64dbe6298db60ba171ccccecb80187b1ad59f42e33677368dd3ba3530def9"} Jul 07 15:00:59.098795 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.098747 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" event={"ID":"84e1a630562b1b5cdfa159e0128e6564","Type":"ContainerStarted","Data":"2e1e6bb83903d0701f78e0fcefa08bc81569ffd26b4ce362766247552c24274e"} Jul 07 15:00:59.160422 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160388 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-cni-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.160422 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160423 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-host\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc21a381-7bad-4e2c-b719-4792135feadc-iptables-alerter-script\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160486 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-var-lib-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160519 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovn-node-metrics-cert\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160542 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-modprobe-d\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160600 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysctl-conf\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160613 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-host\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-systemd-units\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.160657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160659 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-systemd-units\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160576 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-cni-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160596 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-var-lib-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160660 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-kubelet\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160701 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-kubelet\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160713 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-system-cni-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160719 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysctl-conf\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160730 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-modprobe-d\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160739 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-slash\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160773 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-slash\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160792 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-system-cni-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160794 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-sys-fs\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160835 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/961c0f48-8801-47a4-8cb0-8f526398f88a-serviceca\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160844 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-sys-fs\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160877 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovnkube-script-lib\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160910 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-os-release\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160967 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.161188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160991 2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161066 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.161167 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.161243 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret podName:0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:59.661221565 +0000 UTC m=+3.136058296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret") pod "global-pull-secret-syncer-6zmxl" (UID: "0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161249 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/dc21a381-7bad-4e2c-b719-4792135feadc-iptables-alerter-script\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161326 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161337 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/961c0f48-8801-47a4-8cb0-8f526398f88a-serviceca\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161369 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-os-release\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.160994 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161471 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mng9s\" (UniqueName: \"kubernetes.io/projected/961c0f48-8801-47a4-8cb0-8f526398f88a-kube-api-access-mng9s\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161481 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovnkube-script-lib\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161493 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161500 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-cni-bin\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161528 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc21a381-7bad-4e2c-b719-4792135feadc-host-slash\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161553 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-cni-bin\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161556 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161578 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc21a381-7bad-4e2c-b719-4792135feadc-host-slash\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.162026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-socket-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161598 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161624 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-daemon-config\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-lib-modules\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161695 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z42ws\" (UniqueName: \"kubernetes.io/projected/b7e359fb-fdd2-4166-a0b6-859097b93e40-kube-api-access-z42ws\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161717 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-socket-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161721 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-kubelet-config\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161760 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzmw\" (UniqueName: \"kubernetes.io/projected/a7841608-6ac1-45b9-afe9-3b18712dcc58-kube-api-access-fgzmw\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161767 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-kubelet-config\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161783 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-cni-bin\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161801 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-lib-modules\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161814 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-cni-bin\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161911 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-device-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161934 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v442m\" (UniqueName: \"kubernetes.io/projected/54335d5f-5840-4583-805a-60bb2ceb387c-kube-api-access-v442m\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161954 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-etc-kubernetes\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.161988 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-systemd\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.162897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162022 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-device-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162026 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-etc-kubernetes\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162057 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-systemd\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.162089 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162093 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-ovn\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162138 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-cni-multus\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162161 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-run-ovn\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162163 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-var-lib-cni-multus\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162165 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-daemon-config\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysctl-d\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.162180 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs podName:a7841608-6ac1-45b9-afe9-3b18712dcc58 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:59.662164941 +0000 UTC m=+3.137001669 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs") pod "network-metrics-daemon-7s789" (UID: "a7841608-6ac1-45b9-afe9-3b18712dcc58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162210 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abf01a38-1970-481f-8ad6-0901092e11e5-tmp\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162226 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-dbus\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162242 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-run-ovn-kubernetes\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162270 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-system-cni-dir\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162248 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysctl-d\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162306 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-system-cni-dir\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.163843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162311 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-run-ovn-kubernetes\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162325 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cni-binary-copy\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162343 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-socket-dir-parent\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162345 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-dbus\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162366 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-conf-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162384 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-systemd\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162403 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-socket-dir-parent\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162406 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wggpw\" (UniqueName: \"kubernetes.io/projected/abf01a38-1970-481f-8ad6-0901092e11e5-kube-api-access-wggpw\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162426 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-multus-conf-dir\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162445 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-etc-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162473 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162480 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-systemd\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162514 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-run\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162550 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89a25915-f232-4d60-aab5-e657bcb013ef-agent-certs\") pod \"konnectivity-agent-2rbx7\" (UID: \"89a25915-f232-4d60-aab5-e657bcb013ef\") " pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-etc-openvswitch\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/961c0f48-8801-47a4-8cb0-8f526398f88a-host\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162627 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/961c0f48-8801-47a4-8cb0-8f526398f88a-host\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162629 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-tuning-conf-dir\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.164721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162633 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-k8s-cni-cncf-io\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162666 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-k8s-cni-cncf-io\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162678 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-run\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162678 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-multus-certs\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162711 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-multus-certs\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162714 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysconfig\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-kubernetes\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-sysconfig\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162770 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-sys\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162796 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7e359fb-fdd2-4166-a0b6-859097b93e40-hosts-file\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162806 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-etc-kubernetes\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162824 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4j2nk\" (UniqueName: \"kubernetes.io/projected/dc21a381-7bad-4e2c-b719-4792135feadc-kube-api-access-4j2nk\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162824 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cni-binary-copy\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162858 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-sys\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162877 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7e359fb-fdd2-4166-a0b6-859097b93e40-hosts-file\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162909 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-env-overrides\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162939 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-cni-binary-copy\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162966 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-netns\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.162991 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-var-lib-kubelet\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163033 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-kubelet\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163060 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z9bv\" (UniqueName: \"kubernetes.io/projected/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-kube-api-access-5z9bv\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163082 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-host-run-netns\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163088 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cnibin\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-os-release\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163130 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3f97ab07-a0f3-4bf6-b1c5-e635db360507-cnibin\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163148 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/abf01a38-1970-481f-8ad6-0901092e11e5-etc-tuned\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163175 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e359fb-fdd2-4166-a0b6-859097b93e40-tmp-dir\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163180 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/abf01a38-1970-481f-8ad6-0901092e11e5-var-lib-kubelet\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163203 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-run-netns\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163220 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-kubelet\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163231 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-etc-selinux\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163284 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-hostroot\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163309 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84sw4\" (UniqueName: \"kubernetes.io/projected/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-kube-api-access-84sw4\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163352 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-env-overrides\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163354 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-log-socket\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.165896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163413 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-log-socket\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163432 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-cni-binary-copy\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163441 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-cni-netd\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163477 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-os-release\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163481 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-cni-netd\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163502 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163534 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovnkube-config\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163536 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-etc-selinux\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163535 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-hostroot\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163574 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-cnibin\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163623 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-node-log\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163658 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89a25915-f232-4d60-aab5-e657bcb013ef-konnectivity-ca\") pod \"konnectivity-agent-2rbx7\" (UID: \"89a25915-f232-4d60-aab5-e657bcb013ef\") " pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163686 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-registration-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163715 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htmvj\" (UniqueName: \"kubernetes.io/projected/3f97ab07-a0f3-4bf6-b1c5-e635db360507-kube-api-access-htmvj\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163766 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.163825 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-host-run-netns\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.164009 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovnkube-config\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.164037 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e359fb-fdd2-4166-a0b6-859097b93e40-tmp-dir\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.166438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.164092 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-cnibin\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.166993 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.164165 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54335d5f-5840-4583-805a-60bb2ceb387c-registration-dir\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.166993 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.164213 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-node-log\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166993 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.164955 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/abf01a38-1970-481f-8ad6-0901092e11e5-tmp\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.166993 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.165088 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-ovn-node-metrics-cert\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.166993 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.165344 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89a25915-f232-4d60-aab5-e657bcb013ef-konnectivity-ca\") pod \"konnectivity-agent-2rbx7\" (UID: \"89a25915-f232-4d60-aab5-e657bcb013ef\") " pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:00:59.166993 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.165403 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89a25915-f232-4d60-aab5-e657bcb013ef-agent-certs\") pod \"konnectivity-agent-2rbx7\" (UID: \"89a25915-f232-4d60-aab5-e657bcb013ef\") " pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:00:59.166993 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.165443 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/abf01a38-1970-481f-8ad6-0901092e11e5-etc-tuned\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.177293 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.177115 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:00:59.177293 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.177152 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:00:59.177293 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.177167 2580 projected.go:196] Error preparing data for projected volume kube-api-access-5v8fd for pod openshift-network-diagnostics/network-check-target-mwbqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:00:59.177293 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.177237 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd podName:e0c29f8e-51c3-40b1-ad89-a16b212719a8 nodeName:}" failed. No retries permitted until 2026-07-07 15:00:59.677218992 +0000 UTC m=+3.152055735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5v8fd" (UniqueName: "kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd") pod "network-check-target-mwbqx" (UID: "e0c29f8e-51c3-40b1-ad89-a16b212719a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:00:59.177663 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.177360 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z42ws\" (UniqueName: \"kubernetes.io/projected/b7e359fb-fdd2-4166-a0b6-859097b93e40-kube-api-access-z42ws\") pod \"node-resolver-pw298\" (UID: \"b7e359fb-fdd2-4166-a0b6-859097b93e40\") " pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.181186 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.181120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wggpw\" (UniqueName: \"kubernetes.io/projected/abf01a38-1970-481f-8ad6-0901092e11e5-kube-api-access-wggpw\") pod \"tuned-nktth\" (UID: \"abf01a38-1970-481f-8ad6-0901092e11e5\") " pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.182759 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.182731 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mng9s\" (UniqueName: \"kubernetes.io/projected/961c0f48-8801-47a4-8cb0-8f526398f88a-kube-api-access-mng9s\") pod \"node-ca-crvz6\" (UID: \"961c0f48-8801-47a4-8cb0-8f526398f88a\") " pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.184258 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.184230 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z9bv\" (UniqueName: \"kubernetes.io/projected/d4bb2b5c-71d3-48a5-bcd8-4bc614c445df-kube-api-access-5z9bv\") pod \"ovnkube-node-grhnt\" (UID: \"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df\") " pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.184936 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.184879 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84sw4\" (UniqueName: \"kubernetes.io/projected/6a2b4940-a0cc-4b74-8c82-7a08794d1d87-kube-api-access-84sw4\") pod \"multus-rqsg6\" (UID: \"6a2b4940-a0cc-4b74-8c82-7a08794d1d87\") " pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.185092 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.185041 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v442m\" (UniqueName: \"kubernetes.io/projected/54335d5f-5840-4583-805a-60bb2ceb387c-kube-api-access-v442m\") pod \"aws-ebs-csi-driver-node-grp6d\" (UID: \"54335d5f-5840-4583-805a-60bb2ceb387c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.187849 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.187800 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzmw\" (UniqueName: \"kubernetes.io/projected/a7841608-6ac1-45b9-afe9-3b18712dcc58-kube-api-access-fgzmw\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:00:59.190812 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.190792 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4j2nk\" (UniqueName: \"kubernetes.io/projected/dc21a381-7bad-4e2c-b719-4792135feadc-kube-api-access-4j2nk\") pod \"iptables-alerter-7bjcd\" (UID: \"dc21a381-7bad-4e2c-b719-4792135feadc\") " pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.192257 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.192231 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-htmvj\" (UniqueName: \"kubernetes.io/projected/3f97ab07-a0f3-4bf6-b1c5-e635db360507-kube-api-access-htmvj\") pod \"multus-additional-cni-plugins-95qkd\" (UID: \"3f97ab07-a0f3-4bf6-b1c5-e635db360507\") " pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.265660 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.262546 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-crvz6" Jul 07 15:00:59.265660 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.264642 2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 15:00:59.272865 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.272837 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7bjcd" Jul 07 15:00:59.286048 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.285972 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:00:59.292428 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.292402 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:00:59.311465 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.311427 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-95qkd" Jul 07 15:00:59.321940 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.321910 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqsg6" Jul 07 15:00:59.330221 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.330191 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" Jul 07 15:00:59.338263 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.338243 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nktth" Jul 07 15:00:59.344170 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.344146 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pw298" Jul 07 15:00:59.668431 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.668330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:00:59.668431 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.668415 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:00:59.668669 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.668522 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:00:59.668669 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.668526 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:00:59.668669 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.668581 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret podName:0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:00.668565159 +0000 UTC m=+4.143401887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret") pod "global-pull-secret-syncer-6zmxl" (UID: "0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:00:59.668669 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.668603 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs podName:a7841608-6ac1-45b9-afe9-3b18712dcc58 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:00.668591885 +0000 UTC m=+4.143428614 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs") pod "network-metrics-daemon-7s789" (UID: "a7841608-6ac1-45b9-afe9-3b18712dcc58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:00:59.769536 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:00:59.769503 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:00:59.769737 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.769634 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:00:59.769737 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.769653 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:00:59.769737 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.769663 2580 projected.go:196] Error preparing data for projected volume kube-api-access-5v8fd for pod openshift-network-diagnostics/network-check-target-mwbqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:00:59.769737 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:00:59.769720 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd podName:e0c29f8e-51c3-40b1-ad89-a16b212719a8 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:00.769702742 +0000 UTC m=+4.244539470 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v8fd" (UniqueName: "kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd") pod "network-check-target-mwbqx" (UID: "e0c29f8e-51c3-40b1-ad89-a16b212719a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:00.000576 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:00.000447 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:55:59 +0000 UTC" deadline="2028-01-26 02:28:44.838204075 +0000 UTC" Jul 07 15:01:00.000576 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:00.000511 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13619h27m44.83769682s" Jul 07 15:01:00.093457 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:00.093421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:00.093644 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.093543 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:00.295586 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.295549 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54335d5f_5840_4583_805a_60bb2ceb387c.slice/crio-18530d83c93819e41e05bc31d3ad393853b30014374b982f555f261f3a2c8b59 WatchSource:0}: Error finding container 18530d83c93819e41e05bc31d3ad393853b30014374b982f555f261f3a2c8b59: Status 404 returned error can't find the container with id 18530d83c93819e41e05bc31d3ad393853b30014374b982f555f261f3a2c8b59 Jul 07 15:01:00.309607 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.309578 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e359fb_fdd2_4166_a0b6_859097b93e40.slice/crio-3f50476c139f4e9a7d4cb878475a2f07d639692771832d8cab07179622ec9a7a WatchSource:0}: Error finding container 3f50476c139f4e9a7d4cb878475a2f07d639692771832d8cab07179622ec9a7a: Status 404 returned error can't find the container with id 3f50476c139f4e9a7d4cb878475a2f07d639692771832d8cab07179622ec9a7a Jul 07 15:01:00.315391 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.315361 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2b4940_a0cc_4b74_8c82_7a08794d1d87.slice/crio-0854e85eeb499074cc358cb11da96dfa39c8ddcba1c9ec3b1d83c859f5259e3d WatchSource:0}: Error finding container 0854e85eeb499074cc358cb11da96dfa39c8ddcba1c9ec3b1d83c859f5259e3d: Status 404 returned error can't find the container with id 0854e85eeb499074cc358cb11da96dfa39c8ddcba1c9ec3b1d83c859f5259e3d Jul 07 15:01:00.316315 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.316290 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f97ab07_a0f3_4bf6_b1c5_e635db360507.slice/crio-b409a1e3be6864d9c338584decbdc771aaa20bfc211a38dcab63a22098996d9b WatchSource:0}: Error finding container b409a1e3be6864d9c338584decbdc771aaa20bfc211a38dcab63a22098996d9b: Status 404 returned error can't find the container with id b409a1e3be6864d9c338584decbdc771aaa20bfc211a38dcab63a22098996d9b Jul 07 15:01:00.317156 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.317133 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961c0f48_8801_47a4_8cb0_8f526398f88a.slice/crio-1b85768e5317484b6639646d83893d990c0bc8a2712ff54b6b78c21029a4d26f WatchSource:0}: Error finding container 1b85768e5317484b6639646d83893d990c0bc8a2712ff54b6b78c21029a4d26f: Status 404 returned error can't find the container with id 1b85768e5317484b6639646d83893d990c0bc8a2712ff54b6b78c21029a4d26f Jul 07 15:01:00.318552 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.318462 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4bb2b5c_71d3_48a5_bcd8_4bc614c445df.slice/crio-818cab1e8749ad42881ba0377b2e1ca0bbfe300201fe1cea488fd8717d8a521e WatchSource:0}: Error finding container 818cab1e8749ad42881ba0377b2e1ca0bbfe300201fe1cea488fd8717d8a521e: Status 404 returned error can't find the container with id 818cab1e8749ad42881ba0377b2e1ca0bbfe300201fe1cea488fd8717d8a521e Jul 07 15:01:00.320220 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.320196 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf01a38_1970_481f_8ad6_0901092e11e5.slice/crio-9dd1041aaa81d9e37184e6cb70f1e2c40077f2663cc9708bd23b87434bd0ca16 WatchSource:0}: Error finding container 9dd1041aaa81d9e37184e6cb70f1e2c40077f2663cc9708bd23b87434bd0ca16: Status 404 returned error can't find the container with id 9dd1041aaa81d9e37184e6cb70f1e2c40077f2663cc9708bd23b87434bd0ca16 Jul 07 15:01:00.320854 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.320802 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89a25915_f232_4d60_aab5_e657bcb013ef.slice/crio-c97975e516c4efbf0026e9fbfe12c49ab92f54997f003f37802ebe5835e2d4df WatchSource:0}: Error finding container c97975e516c4efbf0026e9fbfe12c49ab92f54997f003f37802ebe5835e2d4df: Status 404 returned error can't find the container with id c97975e516c4efbf0026e9fbfe12c49ab92f54997f003f37802ebe5835e2d4df Jul 07 15:01:00.322115 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:00.322016 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc21a381_7bad_4e2c_b719_4792135feadc.slice/crio-bc67c147f263a089308186a43f77b340e5346ee9a171e9c19545b6f9a148418a WatchSource:0}: Error finding container bc67c147f263a089308186a43f77b340e5346ee9a171e9c19545b6f9a148418a: Status 404 returned error can't find the container with id bc67c147f263a089308186a43f77b340e5346ee9a171e9c19545b6f9a148418a Jul 07 15:01:00.676047 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:00.675853 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:00.676215 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:00.676065 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:00.676215 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.676018 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:00.676215 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.676158 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret podName:0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:02.676144001 +0000 UTC m=+6.150980732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret") pod "global-pull-secret-syncer-6zmxl" (UID: "0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:00.676215 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.676183 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:00.676343 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.676231 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs podName:a7841608-6ac1-45b9-afe9-3b18712dcc58 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:02.676215274 +0000 UTC m=+6.151052001 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs") pod "network-metrics-daemon-7s789" (UID: "a7841608-6ac1-45b9-afe9-3b18712dcc58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:00.776628 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:00.776596 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:00.776812 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.776778 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:01:00.776812 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.776798 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:01:00.776812 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.776808 2580 projected.go:196] Error preparing data for projected volume kube-api-access-5v8fd for pod openshift-network-diagnostics/network-check-target-mwbqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:00.776961 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:00.776899 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd podName:e0c29f8e-51c3-40b1-ad89-a16b212719a8 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:02.77685198 +0000 UTC m=+6.251688727 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v8fd" (UniqueName: "kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd") pod "network-check-target-mwbqx" (UID: "e0c29f8e-51c3-40b1-ad89-a16b212719a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:01.001351 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.001304 2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:55:59 +0000 UTC" deadline="2027-12-29 23:30:35.723887904 +0000 UTC" Jul 07 15:01:01.001351 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.001347 2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12968h29m34.72254605s" Jul 07 15:01:01.093020 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.092986 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:01.093198 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:01.093132 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:01.093557 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.093535 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:01.093661 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:01.093636 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:01.107707 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.107669 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95qkd" event={"ID":"3f97ab07-a0f3-4bf6-b1c5-e635db360507","Type":"ContainerStarted","Data":"b409a1e3be6864d9c338584decbdc771aaa20bfc211a38dcab63a22098996d9b"} Jul 07 15:01:01.110177 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.110146 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqsg6" event={"ID":"6a2b4940-a0cc-4b74-8c82-7a08794d1d87","Type":"ContainerStarted","Data":"0854e85eeb499074cc358cb11da96dfa39c8ddcba1c9ec3b1d83c859f5259e3d"} Jul 07 15:01:01.114947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.114861 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pw298" event={"ID":"b7e359fb-fdd2-4166-a0b6-859097b93e40","Type":"ContainerStarted","Data":"3f50476c139f4e9a7d4cb878475a2f07d639692771832d8cab07179622ec9a7a"} Jul 07 15:01:01.117438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.117406 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" event={"ID":"8aaae9886cf90bd3452823e4171c4905","Type":"ContainerStarted","Data":"03029868494d4d563d647c4600725862e1797b7b23bcdf1ad0dec1a1f5f5f261"} Jul 07 15:01:01.119472 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.119446 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nktth" event={"ID":"abf01a38-1970-481f-8ad6-0901092e11e5","Type":"ContainerStarted","Data":"9dd1041aaa81d9e37184e6cb70f1e2c40077f2663cc9708bd23b87434bd0ca16"} Jul 07 15:01:01.122054 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.122027 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" event={"ID":"54335d5f-5840-4583-805a-60bb2ceb387c","Type":"ContainerStarted","Data":"18530d83c93819e41e05bc31d3ad393853b30014374b982f555f261f3a2c8b59"} Jul 07 15:01:01.124549 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.124518 2580 generic.go:356] "Generic (PLEG): container finished" podID="84e1a630562b1b5cdfa159e0128e6564" containerID="e01594c763ebb1ae94f122eb1aa06dcd78d7410f76ec90305b582e5b958d7886" exitCode=0 Jul 07 15:01:01.124676 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.124603 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" event={"ID":"84e1a630562b1b5cdfa159e0128e6564","Type":"ContainerDied","Data":"e01594c763ebb1ae94f122eb1aa06dcd78d7410f76ec90305b582e5b958d7886"} Jul 07 15:01:01.126926 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.126901 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bjcd" event={"ID":"dc21a381-7bad-4e2c-b719-4792135feadc","Type":"ContainerStarted","Data":"bc67c147f263a089308186a43f77b340e5346ee9a171e9c19545b6f9a148418a"} Jul 07 15:01:01.131169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.131129 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2rbx7" event={"ID":"89a25915-f232-4d60-aab5-e657bcb013ef","Type":"ContainerStarted","Data":"c97975e516c4efbf0026e9fbfe12c49ab92f54997f003f37802ebe5835e2d4df"} Jul 07 15:01:01.135099 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.133530 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"818cab1e8749ad42881ba0377b2e1ca0bbfe300201fe1cea488fd8717d8a521e"} Jul 07 15:01:01.136270 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.136216 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-14.ec2.internal" podStartSLOduration=3.136197392 podStartE2EDuration="3.136197392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:01.134922746 +0000 UTC m=+4.609759497" watchObservedRunningTime="2026-07-07 15:01:01.136197392 +0000 UTC m=+4.611034145" Jul 07 15:01:01.137827 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:01.137750 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-crvz6" event={"ID":"961c0f48-8801-47a4-8cb0-8f526398f88a","Type":"ContainerStarted","Data":"1b85768e5317484b6639646d83893d990c0bc8a2712ff54b6b78c21029a4d26f"} Jul 07 15:01:02.092454 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:02.092418 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:02.093074 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.092565 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:02.156742 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:02.156698 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" event={"ID":"84e1a630562b1b5cdfa159e0128e6564","Type":"ContainerStarted","Data":"acb50e3bb8cec1c8a41fce4b7c6610d350b7232a5197c7f0125a4adec3e9bdf1"} Jul 07 15:01:02.176840 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:02.176425 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-14.ec2.internal" podStartSLOduration=4.176401286 podStartE2EDuration="4.176401286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:02.17550249 +0000 UTC m=+5.650339240" watchObservedRunningTime="2026-07-07 15:01:02.176401286 +0000 UTC m=+5.651238037" Jul 07 15:01:02.696494 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:02.696259 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:02.696494 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:02.696327 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:02.696494 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.696407 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:02.696494 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.696445 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:02.696494 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.696500 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret podName:0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:06.696471733 +0000 UTC m=+10.171308462 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret") pod "global-pull-secret-syncer-6zmxl" (UID: "0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:02.696912 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.696524 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs podName:a7841608-6ac1-45b9-afe9-3b18712dcc58 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:06.696511907 +0000 UTC m=+10.171348634 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs") pod "network-metrics-daemon-7s789" (UID: "a7841608-6ac1-45b9-afe9-3b18712dcc58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:02.797388 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:02.797345 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:02.797569 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.797516 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:01:02.797569 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.797539 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:01:02.797569 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.797550 2580 projected.go:196] Error preparing data for projected volume kube-api-access-5v8fd for pod openshift-network-diagnostics/network-check-target-mwbqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:02.797730 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:02.797616 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd podName:e0c29f8e-51c3-40b1-ad89-a16b212719a8 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:06.797598852 +0000 UTC m=+10.272435602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v8fd" (UniqueName: "kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd") pod "network-check-target-mwbqx" (UID: "e0c29f8e-51c3-40b1-ad89-a16b212719a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:03.094218 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:03.094136 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:03.094663 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:03.094279 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:03.094663 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:03.094318 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:03.094663 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:03.094395 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:04.092459 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:04.092396 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:04.092666 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:04.092544 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:05.093506 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:05.093401 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:05.093925 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:05.093533 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:05.093925 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:05.093401 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:05.094078 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:05.094027 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:06.092646 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:06.092608 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:06.092822 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.092745 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:06.731028 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:06.730989 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:06.731530 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:06.731048 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:06.731530 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.731143 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:06.731530 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.731162 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:06.731530 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.731218 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret podName:0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:14.731196125 +0000 UTC m=+18.206032857 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret") pod "global-pull-secret-syncer-6zmxl" (UID: "0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:06.731530 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.731238 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs podName:a7841608-6ac1-45b9-afe9-3b18712dcc58 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:14.73122772 +0000 UTC m=+18.206064463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs") pod "network-metrics-daemon-7s789" (UID: "a7841608-6ac1-45b9-afe9-3b18712dcc58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:06.832318 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:06.832279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:06.832516 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.832446 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:01:06.832516 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.832466 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:01:06.832516 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.832484 2580 projected.go:196] Error preparing data for projected volume kube-api-access-5v8fd for pod openshift-network-diagnostics/network-check-target-mwbqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:06.832672 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:06.832532 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd podName:e0c29f8e-51c3-40b1-ad89-a16b212719a8 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:14.832518717 +0000 UTC m=+18.307355445 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v8fd" (UniqueName: "kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd") pod "network-check-target-mwbqx" (UID: "e0c29f8e-51c3-40b1-ad89-a16b212719a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:07.094265 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:07.094096 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:07.094265 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:07.094213 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:07.094597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:07.094563 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:07.094731 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:07.094705 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:08.093438 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:08.093399 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:08.093884 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:08.093535 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:09.092560 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:09.092525 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:09.092760 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:09.092674 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:09.092830 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:09.092756 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:09.092885 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:09.092851 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:10.092814 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:10.092772 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:10.093272 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:10.092942 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:11.093230 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:11.093193 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:11.093659 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:11.093246 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:11.093659 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:11.093328 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:11.093659 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:11.093446 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:12.093109 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:12.093077 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:12.093278 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:12.093187 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:13.093131 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:13.093092 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:13.093317 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:13.093243 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:13.093317 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:13.093277 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:13.093715 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:13.093385 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:14.092768 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:14.092736 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:14.092993 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.092869 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:14.791304 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:14.791261 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:14.791827 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:14.791323 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:14.791827 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.791383 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:14.791827 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.791452 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret podName:0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:30.791433078 +0000 UTC m=+34.266269810 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret") pod "global-pull-secret-syncer-6zmxl" (UID: "0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:14.791827 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.791478 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:14.791827 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.791529 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs podName:a7841608-6ac1-45b9-afe9-3b18712dcc58 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:30.791513785 +0000 UTC m=+34.266350517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs") pod "network-metrics-daemon-7s789" (UID: "a7841608-6ac1-45b9-afe9-3b18712dcc58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:14.892252 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:14.892212 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:14.892402 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.892341 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:01:14.892402 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.892356 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:01:14.892402 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.892368 2580 projected.go:196] Error preparing data for projected volume kube-api-access-5v8fd for pod openshift-network-diagnostics/network-check-target-mwbqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:14.892551 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:14.892420 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd podName:e0c29f8e-51c3-40b1-ad89-a16b212719a8 nodeName:}" failed. No retries permitted until 2026-07-07 15:01:30.892406816 +0000 UTC m=+34.367243542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v8fd" (UniqueName: "kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd") pod "network-check-target-mwbqx" (UID: "e0c29f8e-51c3-40b1-ad89-a16b212719a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:15.092655 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:15.092509 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:15.092655 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:15.092559 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:15.092885 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:15.092662 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:15.092885 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:15.092794 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:16.093058 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:16.093021 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:16.093548 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:16.093131 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:17.093542 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:17.093505 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:17.094015 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:17.093625 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:17.094015 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:17.093658 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:17.094015 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:17.093755 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:18.093102 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:18.093064 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:18.093272 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:18.093197 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:19.093413 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.093028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:19.093996 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.093028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:19.093996 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:19.093515 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:19.093996 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:19.093563 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:19.194660 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.194624 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-crvz6" event={"ID":"961c0f48-8801-47a4-8cb0-8f526398f88a","Type":"ContainerStarted","Data":"a3b2c18b456a3b675fdeac52e1291c1cf02b0efefbca1b8fff290eacbcb45d9c"} Jul 07 15:01:19.196051 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.196029 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f97ab07-a0f3-4bf6-b1c5-e635db360507" containerID="6a88403a3a4774464f0cccd60477b0a856a8e168bb65663e351dc920501fc0cf" exitCode=0 Jul 07 15:01:19.196153 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.196093 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95qkd" event={"ID":"3f97ab07-a0f3-4bf6-b1c5-e635db360507","Type":"ContainerDied","Data":"6a88403a3a4774464f0cccd60477b0a856a8e168bb65663e351dc920501fc0cf"} Jul 07 15:01:19.197504 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.197481 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqsg6" event={"ID":"6a2b4940-a0cc-4b74-8c82-7a08794d1d87","Type":"ContainerStarted","Data":"1939d7e53b91e1e155554b70d7587b14b952f3a29787653ddfff59e7dbf32155"} Jul 07 15:01:19.198843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.198822 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pw298" event={"ID":"b7e359fb-fdd2-4166-a0b6-859097b93e40","Type":"ContainerStarted","Data":"463af0b05e5d8225c3018cf4395d3935e19f4485907f2d241deeeeed59c7ee4a"} Jul 07 15:01:19.200444 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.200421 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nktth" event={"ID":"abf01a38-1970-481f-8ad6-0901092e11e5","Type":"ContainerStarted","Data":"d826cb422a4f8a6bbcbff598dc791cb7ba57b0f8f9868cad1b229a3c562e9ddf"} Jul 07 15:01:19.201764 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.201745 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" event={"ID":"54335d5f-5840-4583-805a-60bb2ceb387c","Type":"ContainerStarted","Data":"a6ef8e4134c4866381946169ea33b895b849031ae9ccfc4e57a06266a3d9057c"} Jul 07 15:01:19.202893 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.202877 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2rbx7" event={"ID":"89a25915-f232-4d60-aab5-e657bcb013ef","Type":"ContainerStarted","Data":"83db93184b21cf122468c7332fcb88dd3be33be00a872e7039ca1b6523662843"} Jul 07 15:01:19.205393 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.205376 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"211e0b194b8004506ba96ac1c3a95e2c2be656af3f8a814a5a7428f72101a92d"} Jul 07 15:01:19.205481 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.205425 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"a208a01a4057bff2a32a773626970c6cb70cbad3aa9471d55e7e9af690063cc4"} Jul 07 15:01:19.205481 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.205452 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"37e709d2351ef1d28df5113bb4e77bedc4c1d8d9fa223a13f7d7002df7debd12"} Jul 07 15:01:19.205481 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.205478 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"d6cc0cc2a089e46678295e1194e869a71c9942c0a2945c8cd77e823e9b554c97"} Jul 07 15:01:19.205576 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.205504 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"6076524414d9bc477f836a24ba8c04971c7a100c1d6552c9a0a3af565172b3d4"} Jul 07 15:01:19.248370 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.248322 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-crvz6" podStartSLOduration=7.768493891 podStartE2EDuration="22.248305653s" totalImagesPullingTime="14.479811762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:19.222121464 +0000 UTC m=+22.696958213" watchObservedRunningTime="2026-07-07 15:01:19.248305653 +0000 UTC m=+22.723142401" Jul 07 15:01:19.270345 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.270287 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2rbx7" podStartSLOduration=7.648842623 podStartE2EDuration="22.270267127s" totalImagesPullingTime="14.621424504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:19.248817418 +0000 UTC m=+22.723654166" watchObservedRunningTime="2026-07-07 15:01:19.270267127 +0000 UTC m=+22.745103876" Jul 07 15:01:19.270538 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.270514 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pw298" podStartSLOduration=3.967561131 podStartE2EDuration="22.270505655s" totalImagesPullingTime="18.302944524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:19.270016243 +0000 UTC m=+22.744852993" watchObservedRunningTime="2026-07-07 15:01:19.270505655 +0000 UTC m=+22.745342404" Jul 07 15:01:19.326822 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.326773 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rqsg6" podStartSLOduration=3.978250525 podStartE2EDuration="22.326754091s" totalImagesPullingTime="18.348503566s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:19.326633382 +0000 UTC m=+22.801470132" watchObservedRunningTime="2026-07-07 15:01:19.326754091 +0000 UTC m=+22.801590840" Jul 07 15:01:19.496776 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.496696 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:19.567364 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.567331 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:19.596170 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.596133 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:01:19.944563 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:19.944533 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:20.044638 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.044606 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:20.092965 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.092934 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:20.093155 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:20.093074 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:20.128689 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.128654 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:01:20.129514 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.129493 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:01:20.147531 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.147473 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nktth" podStartSLOduration=4.85451794 podStartE2EDuration="23.147450541s" totalImagesPullingTime="18.292932601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:19.351550576 +0000 UTC m=+22.826387325" watchObservedRunningTime="2026-07-07 15:01:20.147450541 +0000 UTC m=+23.622287293" Jul 07 15:01:20.211549 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.211468 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"65fd8e4d741aae57bd521b47ab43328d6523604029fabcf1f6f0065f951b3312"} Jul 07 15:01:20.213018 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.212987 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7bjcd" event={"ID":"dc21a381-7bad-4e2c-b719-4792135feadc","Type":"ContainerStarted","Data":"96eeb6f2e999b3e96126f42111da1d5000c00e46e37171ea9deec1202ab51c75"} Jul 07 15:01:20.214379 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.214344 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2rbx7" Jul 07 15:01:20.233097 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.233037 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7bjcd" podStartSLOduration=4.948571157 podStartE2EDuration="23.233018071s" totalImagesPullingTime="18.284446914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:20.232987884 +0000 UTC m=+23.707824640" watchObservedRunningTime="2026-07-07 15:01:20.233018071 +0000 UTC m=+23.707854822" Jul 07 15:01:20.371802 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.371765 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:20.471776 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.471676 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:20.561756 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.561725 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:20.655531 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.655500 2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 15:01:20.671452 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.671414 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:20.766190 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.766107 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:20.910856 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:20.910818 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:21.015514 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:21.015406 2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T15:01:20.655523218Z","UUID":"d62f7c1c-884a-4832-9794-019a5504226c","Handler":null,"Name":"","Endpoint":""} Jul 07 15:01:21.017046 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:21.016958 2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 15:01:21.017046 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:21.017030 2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 15:01:21.093399 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:21.093363 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:21.093399 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:21.093389 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:21.093685 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:21.093500 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:21.093685 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:21.093636 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:21.217050 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:21.217000 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" event={"ID":"54335d5f-5840-4583-805a-60bb2ceb387c","Type":"ContainerStarted","Data":"0273414f2450ab4d3db00b117323a58ab8241a6750c657f0854d94525a086590"} Jul 07 15:01:21.853005 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:21.852957 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:21.969693 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:21.969522 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:22.092480 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:22.092447 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:22.092683 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:22.092565 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:22.222592 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:22.222513 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"210fc4e2cf9738283a9112a9f386a5c8e21062d573bd8153d66d4d1757c0c032"} Jul 07 15:01:22.239212 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:22.239178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:22.284364 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:22.284336 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pw298_b7e359fb-fdd2-4166-a0b6-859097b93e40/dns-node-resolver/0.log" Jul 07 15:01:22.346191 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:22.346148 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:22.880086 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:22.880061 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crvz6_961c0f48-8801-47a4-8cb0-8f526398f88a/node-ca/0.log" Jul 07 15:01:22.906687 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:22.906653 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:23.016872 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:23.016841 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:23.098938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:23.097213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:23.098938 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:23.097372 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:23.098938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:23.097806 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:23.098938 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:23.097917 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:23.291646 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:23.291564 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:23.657206 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:23.657085 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:23.763113 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:23.763083 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:24.092700 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.092438 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:24.092869 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:24.092719 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:24.095276 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.095241 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:24.197268 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.197237 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:24.230005 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.229956 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" event={"ID":"d4bb2b5c-71d3-48a5-bcd8-4bc614c445df","Type":"ContainerStarted","Data":"88b2177dc80f04472c464ee231ae1d3734f812ac9af50ac5039329142a3543b3"} Jul 07 15:01:24.230236 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.230220 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:01:24.231781 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.231751 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f97ab07-a0f3-4bf6-b1c5-e635db360507" containerID="c65953f2165735cc6b55f430a391b54a64bacba65df44512ac5d36e8a837937f" exitCode=0 Jul 07 15:01:24.231903 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.231804 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95qkd" event={"ID":"3f97ab07-a0f3-4bf6-b1c5-e635db360507","Type":"ContainerDied","Data":"c65953f2165735cc6b55f430a391b54a64bacba65df44512ac5d36e8a837937f"} Jul 07 15:01:24.234055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.234033 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" event={"ID":"54335d5f-5840-4583-805a-60bb2ceb387c","Type":"ContainerStarted","Data":"2d1cfc90a4a099688dbb1d2ea12611abd0e83b671798747b7ce622deee51bf2b"} Jul 07 15:01:24.246676 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.246651 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:01:24.271464 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.271417 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" podStartSLOduration=8.913382589 podStartE2EDuration="27.271403916s" totalImagesPullingTime="18.358021327s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:24.270950014 +0000 UTC m=+27.745786762" watchObservedRunningTime="2026-07-07 15:01:24.271403916 +0000 UTC m=+27.746240665" Jul 07 15:01:24.305311 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.305260 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-grp6d" podStartSLOduration=4.347522265 podStartE2EDuration="27.305244666s" totalImagesPullingTime="22.957722401s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:24.305198848 +0000 UTC m=+27.780035598" watchObservedRunningTime="2026-07-07 15:01:24.305244666 +0000 UTC m=+27.780081415" Jul 07 15:01:24.373306 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.373207 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:24.683485 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:24.683446 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:25.092793 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:25.092716 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:25.092961 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:25.092721 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:25.092961 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:25.092841 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:25.092961 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:25.092881 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:25.236470 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:25.236442 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:01:25.236671 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:25.236503 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:01:25.251090 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:25.251065 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:01:25.438636 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:25.438546 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:25.725204 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:25.725123 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:25.903563 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:25.903525 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:26.002532 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:26.002454 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:26.093154 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:26.093124 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:26.093308 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:26.093220 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:26.113249 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:26.113224 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:26.239658 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:26.239628 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f97ab07-a0f3-4bf6-b1c5-e635db360507" containerID="c497348bf7ae5d9b0344798552d0f38451a8959d2b20539db7750928aefcb6d3" exitCode=0 Jul 07 15:01:26.239808 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:26.239690 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95qkd" event={"ID":"3f97ab07-a0f3-4bf6-b1c5-e635db360507","Type":"ContainerDied","Data":"c497348bf7ae5d9b0344798552d0f38451a8959d2b20539db7750928aefcb6d3"} Jul 07 15:01:26.310908 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:26.310812 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:27.096236 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:27.096209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:27.096650 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:27.096209 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:27.096650 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:27.096315 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:27.096650 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:27.096387 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:27.107087 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:27.107060 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:27.296692 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:27.296646 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:27.500263 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:27.500183 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:27.918651 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:27.918558 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:27.989470 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:27.989421 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:28.093426 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:28.093388 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:28.093638 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:28.093515 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:28.247374 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:28.247295 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f97ab07-a0f3-4bf6-b1c5-e635db360507" containerID="66a5dd3ef4351001d29387a4afd15ecc8e70a77ff42e5246a05eb915f6cff6ce" exitCode=0 Jul 07 15:01:28.247374 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:28.247360 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95qkd" event={"ID":"3f97ab07-a0f3-4bf6-b1c5-e635db360507","Type":"ContainerDied","Data":"66a5dd3ef4351001d29387a4afd15ecc8e70a77ff42e5246a05eb915f6cff6ce"} Jul 07 15:01:28.309768 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:28.309738 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:28.726410 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:28.726319 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:28.825617 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:28.825584 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:28.924213 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:28.924184 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:29.021761 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:29.021681 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:29.093005 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:29.092950 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:29.093175 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:29.093016 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:29.093175 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:29.093121 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:29.093249 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:29.093214 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:29.129105 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:29.129077 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:29.617989 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:29.617948 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:29.906856 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:29.906777 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:29.989704 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:29.989674 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:30.092896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:30.092858 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:30.093086 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.093030 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:30.156321 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:30.156282 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:30.501434 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:30.501403 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:30.807847 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:30.807762 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:30.808273 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:30.807859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:30.808273 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.807898 2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:30.808273 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.807962 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs podName:a7841608-6ac1-45b9-afe9-3b18712dcc58 nodeName:}" failed. No retries permitted until 2026-07-07 15:02:02.807946195 +0000 UTC m=+66.282782933 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs") pod "network-metrics-daemon-7s789" (UID: "a7841608-6ac1-45b9-afe9-3b18712dcc58") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 15:01:30.808273 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.807993 2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:30.808273 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.808063 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret podName:0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04 nodeName:}" failed. No retries permitted until 2026-07-07 15:02:02.808045464 +0000 UTC m=+66.282882192 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret") pod "global-pull-secret-syncer-6zmxl" (UID: "0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04") : object "kube-system"/"original-pull-secret" not registered Jul 07 15:01:30.909081 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:30.909037 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:30.909263 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.909218 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 15:01:30.909263 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.909244 2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 15:01:30.909263 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.909257 2580 projected.go:196] Error preparing data for projected volume kube-api-access-5v8fd for pod openshift-network-diagnostics/network-check-target-mwbqx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:30.909376 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:30.909310 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd podName:e0c29f8e-51c3-40b1-ad89-a16b212719a8 nodeName:}" failed. No retries permitted until 2026-07-07 15:02:02.90929664 +0000 UTC m=+66.384133367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v8fd" (UniqueName: "kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd") pod "network-check-target-mwbqx" (UID: "e0c29f8e-51c3-40b1-ad89-a16b212719a8") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 15:01:31.093073 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:31.092996 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:31.093229 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:31.092998 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:31.093229 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:31.093135 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:31.093229 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:31.093199 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:31.137178 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:31.137143 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:31.262811 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:31.262781 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:31.723414 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:31.723375 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:31.915274 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:31.915242 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:32.093129 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:32.093055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:32.093305 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:32.093174 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:32.322645 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:32.322613 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:32.498726 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:32.498634 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:33.092926 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:33.092847 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:33.093278 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:33.092960 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:33.093278 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:33.093028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:33.093278 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:33.093135 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:33.126090 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:33.126058 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:33.262730 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:33.262695 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f97ab07-a0f3-4bf6-b1c5-e635db360507" containerID="b4b74daf071aab173254ecafa07fa94494bd03e64401f39f1532d9c23b87f730" exitCode=0 Jul 07 15:01:33.262911 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:33.262752 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95qkd" event={"ID":"3f97ab07-a0f3-4bf6-b1c5-e635db360507","Type":"ContainerDied","Data":"b4b74daf071aab173254ecafa07fa94494bd03e64401f39f1532d9c23b87f730"} Jul 07 15:01:33.732423 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:33.732318 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:33.923091 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:33.923060 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:34.092830 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:34.092731 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:34.093030 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:34.092852 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:34.120224 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:34.120193 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:34.267668 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:34.267633 2580 generic.go:356] "Generic (PLEG): container finished" podID="3f97ab07-a0f3-4bf6-b1c5-e635db360507" containerID="366feae48adb6e9f1846502d301d810170d1a4f1f8e7a541f2f6830a9a29a4ef" exitCode=0 Jul 07 15:01:34.267833 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:34.267675 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95qkd" event={"ID":"3f97ab07-a0f3-4bf6-b1c5-e635db360507","Type":"ContainerDied","Data":"366feae48adb6e9f1846502d301d810170d1a4f1f8e7a541f2f6830a9a29a4ef"} Jul 07 15:01:34.317840 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:34.317815 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:35.093086 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:35.093055 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:35.093476 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:35.093066 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:35.093476 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:35.093167 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:35.093476 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:35.093248 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:35.272698 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:35.272669 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-95qkd" event={"ID":"3f97ab07-a0f3-4bf6-b1c5-e635db360507","Type":"ContainerStarted","Data":"4027007ff04888e418d6a192cdd70bb89386744f9d063fcc69862783e3f149f9"} Jul 07 15:01:35.314467 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:35.314415 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-95qkd" podStartSLOduration=8.439245748 podStartE2EDuration="38.314398272s" totalImagesPullingTime="29.875152524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:35.312833122 +0000 UTC m=+38.787669883" watchObservedRunningTime="2026-07-07 15:01:35.314398272 +0000 UTC m=+38.789235020" Jul 07 15:01:36.092773 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:36.092740 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:36.092944 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:36.092840 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:37.093279 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:37.093238 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:37.093731 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:37.093338 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:37.093731 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:37.093384 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:37.093731 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:37.093472 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:37.761826 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:37.761794 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:37.868784 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:37.868742 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:38.092748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:38.092659 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:38.092894 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:38.092773 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:38.997442 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:38.997408 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:39.093403 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:39.093371 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:39.093565 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:39.093481 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:39.093609 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:39.093561 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:39.093662 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:39.093645 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:39.181736 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:39.181704 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:40.093079 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:40.093050 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:40.093451 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:40.093145 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:41.092550 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:41.092506 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:41.092693 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:41.092557 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:41.092693 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:41.092635 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:41.092781 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:41.092749 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:41.852691 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:41.852653 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:41.999429 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:41.999396 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:42.093061 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.093028 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:42.093391 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:42.093366 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:42.180018 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.179920 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:42.271191 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.271162 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:42.372950 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.372924 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:42.945002 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.944772 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7s789"] Jul 07 15:01:42.945369 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.945116 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:42.945369 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:42.945263 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:42.948130 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.947872 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6zmxl"] Jul 07 15:01:42.948130 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.947964 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:42.948130 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:42.948089 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:42.949120 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.949100 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mwbqx"] Jul 07 15:01:42.949342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:42.949311 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:42.949441 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:42.949413 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:44.387348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:44.387315 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:44.461186 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:44.461154 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:45.093013 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:45.092958 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:45.093013 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:45.093013 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:45.093210 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:45.092957 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:45.093210 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:45.093099 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6zmxl" podUID="0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04" Jul 07 15:01:45.093275 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:45.093216 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7s789" podUID="a7841608-6ac1-45b9-afe9-3b18712dcc58" Jul 07 15:01:45.093322 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:01:45.093300 2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwbqx" podUID="e0c29f8e-51c3-40b1-ad89-a16b212719a8" Jul 07 15:01:45.172864 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:45.172829 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:45.361235 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:45.361148 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:45.535548 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:45.535519 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:45.788816 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:45.788733 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:45.878712 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:45.878679 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:46.210252 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.210216 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:46.288223 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.288198 2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-14.ec2.internal" event="NodeReady" Jul 07 15:01:46.288366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.288313 2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 15:01:46.329121 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.329094 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-c88c4f799-bsjsj"] Jul 07 15:01:46.343897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.343866 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.344558 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.344538 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-x88bq"] Jul 07 15:01:46.347339 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.347312 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 15:01:46.347853 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.347836 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t8hm9\"" Jul 07 15:01:46.347952 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.347938 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 15:01:46.348672 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.348657 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 15:01:46.355556 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.355534 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 15:01:46.358318 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.358294 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zhpzx"] Jul 07 15:01:46.358440 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.358422 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.361156 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.361137 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6qs2h\"" Jul 07 15:01:46.362245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.362223 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 15:01:46.362659 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.362640 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 15:01:46.373997 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.373957 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c88c4f799-bsjsj"] Jul 07 15:01:46.374113 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.374012 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x88bq"] Jul 07 15:01:46.374113 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.374036 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zhpzx"] Jul 07 15:01:46.374113 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.374056 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.377248 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.377196 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4zds6\"" Jul 07 15:01:46.377248 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.377240 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 15:01:46.377453 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.377281 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 15:01:46.377453 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.377234 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 15:01:46.377453 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.377382 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 15:01:46.425806 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.425777 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/511374b0-e4f6-4212-90da-0654203828b2-data-volume\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.426000 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.425812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjb7c\" (UniqueName: \"kubernetes.io/projected/511374b0-e4f6-4212-90da-0654203828b2-kube-api-access-bjb7c\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.426000 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.425833 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-registry-tls\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.426000 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.425850 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7abe3b37-5856-4cd4-acf1-a92a49ec2848-installation-pull-secrets\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.426000 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.425910 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce46f22d-3634-4b1b-bbe9-d38925b54a45-metrics-tls\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.426000 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.425955 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/511374b0-e4f6-4212-90da-0654203828b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.426161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426015 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7abe3b37-5856-4cd4-acf1-a92a49ec2848-image-registry-private-configuration\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.426161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/511374b0-e4f6-4212-90da-0654203828b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.426161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426064 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hx6x\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-kube-api-access-6hx6x\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.426161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426109 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7abe3b37-5856-4cd4-acf1-a92a49ec2848-ca-trust-extracted\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.426161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426128 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce46f22d-3634-4b1b-bbe9-d38925b54a45-tmp-dir\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.426161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426151 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7abe3b37-5856-4cd4-acf1-a92a49ec2848-trusted-ca\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.426332 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426184 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7abe3b37-5856-4cd4-acf1-a92a49ec2848-registry-certificates\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.426332 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426217 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vglc5\" (UniqueName: \"kubernetes.io/projected/ce46f22d-3634-4b1b-bbe9-d38925b54a45-kube-api-access-vglc5\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.426332 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426247 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-bound-sa-token\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.426332 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426261 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/511374b0-e4f6-4212-90da-0654203828b2-crio-socket\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.426332 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.426279 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce46f22d-3634-4b1b-bbe9-d38925b54a45-config-volume\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.444815 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.444783 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:46.451663 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.451641 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5kc47"] Jul 07 15:01:46.476120 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.476090 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5kc47"] Jul 07 15:01:46.476263 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.476190 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5kc47" Jul 07 15:01:46.479142 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.479100 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 15:01:46.479142 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.479103 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 15:01:46.479308 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.479263 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-mt4rv\"" Jul 07 15:01:46.479355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.479329 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 15:01:46.514468 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.514436 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:46.526511 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526488 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7abe3b37-5856-4cd4-acf1-a92a49ec2848-image-registry-private-configuration\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.526608 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526520 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/511374b0-e4f6-4212-90da-0654203828b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.526608 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526549 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hx6x\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-kube-api-access-6hx6x\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.526608 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526591 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7abe3b37-5856-4cd4-acf1-a92a49ec2848-ca-trust-extracted\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.526716 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526616 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce46f22d-3634-4b1b-bbe9-d38925b54a45-tmp-dir\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.526716 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526647 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7abe3b37-5856-4cd4-acf1-a92a49ec2848-trusted-ca\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.526716 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526672 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbaa6cc-65a4-4ef0-989c-811bae822b8f-cert\") pod \"ingress-canary-5kc47\" (UID: \"0dbaa6cc-65a4-4ef0-989c-811bae822b8f\") " pod="openshift-ingress-canary/ingress-canary-5kc47" Jul 07 15:01:46.526716 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526697 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7abe3b37-5856-4cd4-acf1-a92a49ec2848-registry-certificates\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.526892 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526720 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvd5m\" (UniqueName: \"kubernetes.io/projected/0dbaa6cc-65a4-4ef0-989c-811bae822b8f-kube-api-access-tvd5m\") pod \"ingress-canary-5kc47\" (UID: \"0dbaa6cc-65a4-4ef0-989c-811bae822b8f\") " pod="openshift-ingress-canary/ingress-canary-5kc47" Jul 07 15:01:46.526892 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526761 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vglc5\" (UniqueName: \"kubernetes.io/projected/ce46f22d-3634-4b1b-bbe9-d38925b54a45-kube-api-access-vglc5\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.526892 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-bound-sa-token\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.526892 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526840 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/511374b0-e4f6-4212-90da-0654203828b2-crio-socket\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.526892 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.526870 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce46f22d-3634-4b1b-bbe9-d38925b54a45-config-volume\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.527115 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527094 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/511374b0-e4f6-4212-90da-0654203828b2-data-volume\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.527160 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527133 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjb7c\" (UniqueName: \"kubernetes.io/projected/511374b0-e4f6-4212-90da-0654203828b2-kube-api-access-bjb7c\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.527204 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527166 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-registry-tls\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.527204 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527105 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/511374b0-e4f6-4212-90da-0654203828b2-crio-socket\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.527204 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527188 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7abe3b37-5856-4cd4-acf1-a92a49ec2848-installation-pull-secrets\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.527349 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527220 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/511374b0-e4f6-4212-90da-0654203828b2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.527349 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527233 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce46f22d-3634-4b1b-bbe9-d38925b54a45-metrics-tls\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.527349 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/511374b0-e4f6-4212-90da-0654203828b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.527487 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527382 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/511374b0-e4f6-4212-90da-0654203828b2-data-volume\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.527487 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527453 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce46f22d-3634-4b1b-bbe9-d38925b54a45-tmp-dir\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.527654 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.527632 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce46f22d-3634-4b1b-bbe9-d38925b54a45-config-volume\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.531121 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.531086 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce46f22d-3634-4b1b-bbe9-d38925b54a45-metrics-tls\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.531121 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.531118 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7abe3b37-5856-4cd4-acf1-a92a49ec2848-installation-pull-secrets\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.531312 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.531197 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7abe3b37-5856-4cd4-acf1-a92a49ec2848-registry-certificates\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.531422 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.531398 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7abe3b37-5856-4cd4-acf1-a92a49ec2848-trusted-ca\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.531643 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.531621 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7abe3b37-5856-4cd4-acf1-a92a49ec2848-ca-trust-extracted\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.531724 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.531708 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7abe3b37-5856-4cd4-acf1-a92a49ec2848-image-registry-private-configuration\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.531900 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.531886 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/511374b0-e4f6-4212-90da-0654203828b2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.532841 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.532824 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-registry-tls\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.535814 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.535790 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-bound-sa-token\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.536236 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.535830 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vglc5\" (UniqueName: \"kubernetes.io/projected/ce46f22d-3634-4b1b-bbe9-d38925b54a45-kube-api-access-vglc5\") pod \"dns-default-x88bq\" (UID: \"ce46f22d-3634-4b1b-bbe9-d38925b54a45\") " pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.536469 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.536441 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hx6x\" (UniqueName: \"kubernetes.io/projected/7abe3b37-5856-4cd4-acf1-a92a49ec2848-kube-api-access-6hx6x\") pod \"image-registry-c88c4f799-bsjsj\" (UID: \"7abe3b37-5856-4cd4-acf1-a92a49ec2848\") " pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.536529 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.536477 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjb7c\" (UniqueName: \"kubernetes.io/projected/511374b0-e4f6-4212-90da-0654203828b2-kube-api-access-bjb7c\") pod \"insights-runtime-extractor-zhpzx\" (UID: \"511374b0-e4f6-4212-90da-0654203828b2\") " pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.626137 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.626107 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:46.628192 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.628142 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbaa6cc-65a4-4ef0-989c-811bae822b8f-cert\") pod \"ingress-canary-5kc47\" (UID: \"0dbaa6cc-65a4-4ef0-989c-811bae822b8f\") " pod="openshift-ingress-canary/ingress-canary-5kc47" Jul 07 15:01:46.628192 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.628174 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvd5m\" (UniqueName: \"kubernetes.io/projected/0dbaa6cc-65a4-4ef0-989c-811bae822b8f-kube-api-access-tvd5m\") pod \"ingress-canary-5kc47\" (UID: \"0dbaa6cc-65a4-4ef0-989c-811bae822b8f\") " pod="openshift-ingress-canary/ingress-canary-5kc47" Jul 07 15:01:46.630565 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.630544 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0dbaa6cc-65a4-4ef0-989c-811bae822b8f-cert\") pod \"ingress-canary-5kc47\" (UID: \"0dbaa6cc-65a4-4ef0-989c-811bae822b8f\") " pod="openshift-ingress-canary/ingress-canary-5kc47" Jul 07 15:01:46.639765 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.639734 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvd5m\" (UniqueName: \"kubernetes.io/projected/0dbaa6cc-65a4-4ef0-989c-811bae822b8f-kube-api-access-tvd5m\") pod \"ingress-canary-5kc47\" (UID: \"0dbaa6cc-65a4-4ef0-989c-811bae822b8f\") " pod="openshift-ingress-canary/ingress-canary-5kc47" Jul 07 15:01:46.655583 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.655558 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:46.667720 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.667700 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:46.683109 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.682965 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zhpzx" Jul 07 15:01:46.784302 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.784194 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5kc47" Jul 07 15:01:46.811615 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.811564 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:46.855899 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.855821 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-c88c4f799-bsjsj"] Jul 07 15:01:46.870939 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.870900 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-x88bq"] Jul 07 15:01:46.873781 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:46.873749 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce46f22d_3634_4b1b_bbe9_d38925b54a45.slice/crio-b1e21fe7851991263cb58500decfa8e32fef20f9d24befb880f069841dccf657 WatchSource:0}: Error finding container b1e21fe7851991263cb58500decfa8e32fef20f9d24befb880f069841dccf657: Status 404 returned error can't find the container with id b1e21fe7851991263cb58500decfa8e32fef20f9d24befb880f069841dccf657 Jul 07 15:01:46.896066 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.896031 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zhpzx"] Jul 07 15:01:46.900525 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:46.900491 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511374b0_e4f6_4212_90da_0654203828b2.slice/crio-29c9bb4d706a636792f06e49cb57c1290a1d5cb137080e99ce60c922da9cbe0a WatchSource:0}: Error finding container 29c9bb4d706a636792f06e49cb57c1290a1d5cb137080e99ce60c922da9cbe0a: Status 404 returned error can't find the container with id 29c9bb4d706a636792f06e49cb57c1290a1d5cb137080e99ce60c922da9cbe0a Jul 07 15:01:46.955771 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:46.955733 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5kc47"] Jul 07 15:01:46.959425 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:01:46.959399 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbaa6cc_65a4_4ef0_989c_811bae822b8f.slice/crio-cbf6b3726302f8c5c721f62f75724b05b814bd3d26d921d34c4a503713f22822 WatchSource:0}: Error finding container cbf6b3726302f8c5c721f62f75724b05b814bd3d26d921d34c4a503713f22822: Status 404 returned error can't find the container with id cbf6b3726302f8c5c721f62f75724b05b814bd3d26d921d34c4a503713f22822 Jul 07 15:01:47.094175 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.094147 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:01:47.094309 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.094224 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:01:47.094309 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.094278 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:01:47.101665 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.101229 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:01:47.101665 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.101239 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bchjv\"" Jul 07 15:01:47.101665 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.101250 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:01:47.101867 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.101670 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:01:47.101867 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.101774 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:01:47.101867 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.101822 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ghr77\"" Jul 07 15:01:47.288604 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.288512 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:47.301687 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.301645 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zhpzx" event={"ID":"511374b0-e4f6-4212-90da-0654203828b2","Type":"ContainerStarted","Data":"29c9bb4d706a636792f06e49cb57c1290a1d5cb137080e99ce60c922da9cbe0a"} Jul 07 15:01:47.303181 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.303147 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5kc47" event={"ID":"0dbaa6cc-65a4-4ef0-989c-811bae822b8f","Type":"ContainerStarted","Data":"cbf6b3726302f8c5c721f62f75724b05b814bd3d26d921d34c4a503713f22822"} Jul 07 15:01:47.304743 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.304716 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x88bq" event={"ID":"ce46f22d-3634-4b1b-bbe9-d38925b54a45","Type":"ContainerStarted","Data":"b1e21fe7851991263cb58500decfa8e32fef20f9d24befb880f069841dccf657"} Jul 07 15:01:47.306468 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.306438 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" event={"ID":"7abe3b37-5856-4cd4-acf1-a92a49ec2848","Type":"ContainerStarted","Data":"d401816979c1d46ff8d3a6b69c32792b5671ef84b06871258a0681239a04bc0a"} Jul 07 15:01:47.306595 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.306485 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" event={"ID":"7abe3b37-5856-4cd4-acf1-a92a49ec2848","Type":"ContainerStarted","Data":"358b9b84620953c4b0ad3b12646dc46effeb9dbd0018697cf4644526c4dcd86b"} Jul 07 15:01:47.306595 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.306549 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:01:47.334620 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:47.334562 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" podStartSLOduration=6.334536578 podStartE2EDuration="6.334536578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:47.333864991 +0000 UTC m=+50.808701741" watchObservedRunningTime="2026-07-07 15:01:47.334536578 +0000 UTC m=+50.809373324" Jul 07 15:01:48.317353 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:48.317273 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:48.417117 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:48.417084 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:48.666669 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:48.666514 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:48.941083 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:48.940994 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:51.406197 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:51.406158 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:51.600946 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:51.600914 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:52.252506 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:52.252417 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:52.363315 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:52.363279 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:53.322365 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:53.322314 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5kc47" event={"ID":"0dbaa6cc-65a4-4ef0-989c-811bae822b8f","Type":"ContainerStarted","Data":"2345d0161209144f221afed7fa12d0b4b1f8b0ca8e7718004f537bd94ce9d0c7"} Jul 07 15:01:53.324066 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:53.324039 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x88bq" event={"ID":"ce46f22d-3634-4b1b-bbe9-d38925b54a45","Type":"ContainerStarted","Data":"bfa3f2a29e6e3c7dd4d248905be04036b421c9c5c115e71a65134bf09c30532e"} Jul 07 15:01:53.324172 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:53.324090 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-x88bq" event={"ID":"ce46f22d-3634-4b1b-bbe9-d38925b54a45","Type":"ContainerStarted","Data":"0582cdc0099dc06dded7b6b085909156955a71cfc0ce22af42e69400b13d81da"} Jul 07 15:01:53.324172 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:53.324155 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-x88bq" Jul 07 15:01:53.341777 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:53.341724 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5kc47" podStartSLOduration=1.313840463 podStartE2EDuration="7.341707859s" totalImagesPullingTime="6.027867396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:53.340556972 +0000 UTC m=+56.815393734" watchObservedRunningTime="2026-07-07 15:01:53.341707859 +0000 UTC m=+56.816544607" Jul 07 15:01:53.364177 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:53.364130 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-x88bq" podStartSLOduration=1.250075539 podStartE2EDuration="7.364114566s" totalImagesPullingTime="6.114039027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:01:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:53.363597577 +0000 UTC m=+56.838434328" watchObservedRunningTime="2026-07-07 15:01:53.364114566 +0000 UTC m=+56.838951318" Jul 07 15:01:53.924608 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:53.924569 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:54.024782 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:54.024749 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:54.328718 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:54.328677 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zhpzx" event={"ID":"511374b0-e4f6-4212-90da-0654203828b2","Type":"ContainerStarted","Data":"d71c9a785137f4c51d717cec583e87884f2390ff5160410030e633a3b6202c50"} Jul 07 15:01:54.394435 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:54.394403 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:54.465867 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:54.465825 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:54.568583 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:54.568553 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:54.666811 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:54.666730 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:55.013271 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:55.013246 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:55.334033 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:55.334001 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zhpzx" event={"ID":"511374b0-e4f6-4212-90da-0654203828b2","Type":"ContainerStarted","Data":"bb89859147b3c056b06bd673884f669472a83c75fcb9f34ee7cd223e26cb9d7e"} Jul 07 15:01:57.255708 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:57.255662 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-grhnt" Jul 07 15:01:57.423871 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:57.423779 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:57.525457 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:57.525161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:58.347552 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:58.347522 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zhpzx" event={"ID":"511374b0-e4f6-4212-90da-0654203828b2","Type":"ContainerStarted","Data":"48f5f255f314ecaeb35e3db3f9bc64499be0971a0783d922469ccd2898eda352"} Jul 07 15:01:58.368720 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:58.368671 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zhpzx" podStartSLOduration=1.801273543 podStartE2EDuration="12.368652779s" totalImagesPullingTime="10.567379236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:01:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:01:58.368490036 +0000 UTC m=+61.843326787" watchObservedRunningTime="2026-07-07 15:01:58.368652779 +0000 UTC m=+61.843489527" Jul 07 15:01:58.693481 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:58.693371 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:58.787793 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:58.787752 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:59.880794 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:59.880748 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:01:59.966832 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:01:59.966800 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:02.609692 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.609638 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:02.673261 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.673225 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr"] Jul 07 15:02:02.675646 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.675626 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.679815 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.679789 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 15:02:02.679930 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.679839 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 15:02:02.679930 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.679863 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 15:02:02.681077 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.681051 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 15:02:02.681197 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.681090 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 15:02:02.681197 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.681181 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ng4h5\"" Jul 07 15:02:02.692341 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.692310 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr"] Jul 07 15:02:02.702252 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.702226 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:02.765229 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.765196 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b87ab270-7821-46d7-9266-fdb6f5289aa6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.765374 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.765248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b87ab270-7821-46d7-9266-fdb6f5289aa6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.765374 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.765285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbhwd\" (UniqueName: \"kubernetes.io/projected/b87ab270-7821-46d7-9266-fdb6f5289aa6-kube-api-access-qbhwd\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.765374 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.765355 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87ab270-7821-46d7-9266-fdb6f5289aa6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.866765 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.866665 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b87ab270-7821-46d7-9266-fdb6f5289aa6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.866765 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.866718 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:02:02.866765 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.866745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbhwd\" (UniqueName: \"kubernetes.io/projected/b87ab270-7821-46d7-9266-fdb6f5289aa6-kube-api-access-qbhwd\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.867140 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.866809 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87ab270-7821-46d7-9266-fdb6f5289aa6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.867140 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.866850 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b87ab270-7821-46d7-9266-fdb6f5289aa6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.867140 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.866880 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:02:02.867567 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.867549 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b87ab270-7821-46d7-9266-fdb6f5289aa6-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.870706 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.870679 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b87ab270-7821-46d7-9266-fdb6f5289aa6-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.870822 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.870757 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b87ab270-7821-46d7-9266-fdb6f5289aa6-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.872800 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.872783 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 15:02:02.873034 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.873017 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 15:02:02.879315 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.879292 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04-original-pull-secret\") pod \"global-pull-secret-syncer-6zmxl\" (UID: \"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04\") " pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:02:02.879428 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.879316 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7841608-6ac1-45b9-afe9-3b18712dcc58-metrics-certs\") pod \"network-metrics-daemon-7s789\" (UID: \"a7841608-6ac1-45b9-afe9-3b18712dcc58\") " pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:02:02.888651 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.888623 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:02.889088 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.889071 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbhwd\" (UniqueName: \"kubernetes.io/projected/b87ab270-7821-46d7-9266-fdb6f5289aa6-kube-api-access-qbhwd\") pod \"prometheus-operator-567f7b8b7c-gn7fr\" (UID: \"b87ab270-7821-46d7-9266-fdb6f5289aa6\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.967250 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.967205 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:02:02.970704 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.970687 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 15:02:02.980621 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.980600 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 15:02:02.985022 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.985008 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" Jul 07 15:02:02.990476 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:02.990457 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v8fd\" (UniqueName: \"kubernetes.io/projected/e0c29f8e-51c3-40b1-ad89-a16b212719a8-kube-api-access-5v8fd\") pod \"network-check-target-mwbqx\" (UID: \"e0c29f8e-51c3-40b1-ad89-a16b212719a8\") " pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:02:03.007448 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.007421 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bchjv\"" Jul 07 15:02:03.013830 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.013807 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ghr77\"" Jul 07 15:02:03.014809 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.014793 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:02:03.014923 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.014905 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6zmxl" Jul 07 15:02:03.021159 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.021137 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7s789" Jul 07 15:02:03.150887 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.150724 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr"] Jul 07 15:02:03.153477 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:02:03.153445 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb87ab270_7821_46d7_9266_fdb6f5289aa6.slice/crio-1021584b14f71ba64223d7199408a949de2395823ef313cf653edc6afa2779e2 WatchSource:0}: Error finding container 1021584b14f71ba64223d7199408a949de2395823ef313cf653edc6afa2779e2: Status 404 returned error can't find the container with id 1021584b14f71ba64223d7199408a949de2395823ef313cf653edc6afa2779e2 Jul 07 15:02:03.181467 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.181436 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6zmxl"] Jul 07 15:02:03.184406 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:02:03.184379 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ebf6e5e_2938_4274_8bf7_5dcf5c4ceb04.slice/crio-94647321282f92980379161c6ee522878c373a5c67dff179b0cdab4b4a760230 WatchSource:0}: Error finding container 94647321282f92980379161c6ee522878c373a5c67dff179b0cdab4b4a760230: Status 404 returned error can't find the container with id 94647321282f92980379161c6ee522878c373a5c67dff179b0cdab4b4a760230 Jul 07 15:02:03.295446 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.295418 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:03.331361 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.331336 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-x88bq" Jul 07 15:02:03.363673 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.363641 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:03.368830 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.368806 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6zmxl" event={"ID":"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04","Type":"ContainerStarted","Data":"94647321282f92980379161c6ee522878c373a5c67dff179b0cdab4b4a760230"} Jul 07 15:02:03.369873 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.369844 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" event={"ID":"b87ab270-7821-46d7-9266-fdb6f5289aa6","Type":"ContainerStarted","Data":"1021584b14f71ba64223d7199408a949de2395823ef313cf653edc6afa2779e2"} Jul 07 15:02:03.406798 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.406704 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7s789"] Jul 07 15:02:03.409858 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:03.409821 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mwbqx"] Jul 07 15:02:03.410219 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:02:03.410195 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7841608_6ac1_45b9_afe9_3b18712dcc58.slice/crio-b46779c6257fe2e2581d69076473325452e849bb96c734b6a58c7e5103ca31d9 WatchSource:0}: Error finding container b46779c6257fe2e2581d69076473325452e849bb96c734b6a58c7e5103ca31d9: Status 404 returned error can't find the container with id b46779c6257fe2e2581d69076473325452e849bb96c734b6a58c7e5103ca31d9 Jul 07 15:02:03.412396 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:02:03.412371 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c29f8e_51c3_40b1_ad89_a16b212719a8.slice/crio-99db50e2b91021951b7090dc4777f8698f3de2effa14cc415a584d235ad21740 WatchSource:0}: Error finding container 99db50e2b91021951b7090dc4777f8698f3de2effa14cc415a584d235ad21740: Status 404 returned error can't find the container with id 99db50e2b91021951b7090dc4777f8698f3de2effa14cc415a584d235ad21740 Jul 07 15:02:04.375706 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:04.375665 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7s789" event={"ID":"a7841608-6ac1-45b9-afe9-3b18712dcc58","Type":"ContainerStarted","Data":"b46779c6257fe2e2581d69076473325452e849bb96c734b6a58c7e5103ca31d9"} Jul 07 15:02:04.377550 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:04.377511 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mwbqx" event={"ID":"e0c29f8e-51c3-40b1-ad89-a16b212719a8","Type":"ContainerStarted","Data":"99db50e2b91021951b7090dc4777f8698f3de2effa14cc415a584d235ad21740"} Jul 07 15:02:05.300914 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.300858 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:05.383747 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.383656 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" event={"ID":"b87ab270-7821-46d7-9266-fdb6f5289aa6","Type":"ContainerStarted","Data":"8713391dcd47dee9fd52b902be16ffe07c1121407b2d10c43e9db067bf2432c1"} Jul 07 15:02:05.383747 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.383718 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" event={"ID":"b87ab270-7821-46d7-9266-fdb6f5289aa6","Type":"ContainerStarted","Data":"eaa07e74042c3579aa24f999f7771dffc75ab5b0ed2f24307228a64362422f85"} Jul 07 15:02:05.385932 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.385896 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7s789" event={"ID":"a7841608-6ac1-45b9-afe9-3b18712dcc58","Type":"ContainerStarted","Data":"b43ffb386c07941e5e94a5912addde9870c35034010d474995c4e4f9911c21e6"} Jul 07 15:02:05.386073 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.385953 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7s789" event={"ID":"a7841608-6ac1-45b9-afe9-3b18712dcc58","Type":"ContainerStarted","Data":"44b299c273c089a797f47c7a23dfc01ada91cb5e040056d7eba88842c7295f05"} Jul 07 15:02:05.448014 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.447936 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-gn7fr" podStartSLOduration=1.797847897 podStartE2EDuration="3.447911958s" totalImagesPullingTime="1.650064061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:05.446183785 +0000 UTC m=+68.921020536" watchObservedRunningTime="2026-07-07 15:02:05.447911958 +0000 UTC m=+68.922748710" Jul 07 15:02:05.607387 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.607345 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:05.768905 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.768867 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:05.853336 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:05.853300 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:06.072184 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:06.072147 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:06.169756 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:06.169722 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:06.662225 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:06.662180 2580 patch_prober.go:28] interesting pod/image-registry-c88c4f799-bsjsj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 15:02:06.662692 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:06.662248 2580 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" podUID="7abe3b37-5856-4cd4-acf1-a92a49ec2848" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 15:02:06.863320 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:06.863283 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:07.117983 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.117938 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:07.201052 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.200997 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7s789" podStartSLOduration=68.80654599 podStartE2EDuration="1m10.200959392s" totalImagesPullingTime="1.394413402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:05.497392488 +0000 UTC m=+68.972229238" watchObservedRunningTime="2026-07-07 15:02:07.200959392 +0000 UTC m=+70.675796177" Jul 07 15:02:07.201614 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.201598 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8t7b"] Jul 07 15:02:07.224294 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.224255 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.225853 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.225829 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:07.227338 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.227321 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 15:02:07.227721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.227706 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-5lxkv\"" Jul 07 15:02:07.227799 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.227761 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 15:02:07.227859 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.227827 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 15:02:07.305589 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305553 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqjc\" (UniqueName: \"kubernetes.io/projected/aa25adb6-0689-4dea-9f16-4d3c51171d20-kube-api-access-xgqjc\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.305589 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305591 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa25adb6-0689-4dea-9f16-4d3c51171d20-metrics-client-ca\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.305879 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305659 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-sys\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.305879 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305693 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.305879 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305724 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-wtmp\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.305879 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305752 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-textfile\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.305879 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305791 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-tls\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.305879 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.305879 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.305847 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-root\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406629 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406536 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqjc\" (UniqueName: \"kubernetes.io/projected/aa25adb6-0689-4dea-9f16-4d3c51171d20-kube-api-access-xgqjc\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406629 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406582 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa25adb6-0689-4dea-9f16-4d3c51171d20-metrics-client-ca\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406629 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406621 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-sys\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406675 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-wtmp\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406701 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-textfile\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406731 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-tls\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406742 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-sys\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406756 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406778 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-root\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406826 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-wtmp\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.406919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.406842 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aa25adb6-0689-4dea-9f16-4d3c51171d20-root\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.407257 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:02:07.406929 2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 07 15:02:07.407257 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:02:07.407050 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-tls podName:aa25adb6-0689-4dea-9f16-4d3c51171d20 nodeName:}" failed. No retries permitted until 2026-07-07 15:02:07.907029929 +0000 UTC m=+71.381866671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-tls") pod "node-exporter-s8t7b" (UID: "aa25adb6-0689-4dea-9f16-4d3c51171d20") : secret "node-exporter-tls" not found Jul 07 15:02:07.407257 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.407114 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-textfile\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.407392 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.407338 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.407392 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.407372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa25adb6-0689-4dea-9f16-4d3c51171d20-metrics-client-ca\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.409634 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.409605 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.426054 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.426020 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqjc\" (UniqueName: \"kubernetes.io/projected/aa25adb6-0689-4dea-9f16-4d3c51171d20-kube-api-access-xgqjc\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.512492 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.512449 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:07.609805 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.609772 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:07.816459 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.816421 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:07.910677 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.910638 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-tls\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:07.911608 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.911573 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:07.913380 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:07.913346 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aa25adb6-0689-4dea-9f16-4d3c51171d20-node-exporter-tls\") pod \"node-exporter-s8t7b\" (UID: \"aa25adb6-0689-4dea-9f16-4d3c51171d20\") " pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:08.021252 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.021219 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:08.108904 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.108815 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:08.133770 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.133736 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8t7b" Jul 07 15:02:08.269798 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.269759 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:02:08.293806 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.293769 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.298809 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.298775 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:02:08.300100 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.300074 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 07 15:02:08.300945 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.300893 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 07 15:02:08.301219 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.301166 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 07 15:02:08.301219 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.301241 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 07 15:02:08.302219 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.302110 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 07 15:02:08.302219 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.302125 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 07 15:02:08.302419 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.302330 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 07 15:02:08.302464 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.302444 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zsrs6\"" Jul 07 15:02:08.302632 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.302618 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 07 15:02:08.302951 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.302931 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 07 15:02:08.313461 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.313434 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:08.314352 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.314334 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-c88c4f799-bsjsj" Jul 07 15:02:08.415286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415206 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/991c8258-721a-4e4e-aac0-1ec77172128c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415433 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415353 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/991c8258-721a-4e4e-aac0-1ec77172128c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415433 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415393 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-web-config\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415433 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415421 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991c8258-721a-4e4e-aac0-1ec77172128c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415598 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/991c8258-721a-4e4e-aac0-1ec77172128c-config-out\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415598 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415518 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415598 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415544 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/991c8258-721a-4e4e-aac0-1ec77172128c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415755 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415640 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-config-volume\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415755 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6pfv\" (UniqueName: \"kubernetes.io/projected/991c8258-721a-4e4e-aac0-1ec77172128c-kube-api-access-v6pfv\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415755 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415692 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415755 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415961 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415773 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.415961 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.415822 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.432753 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.432717 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:08.517110 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517076 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517287 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517122 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/991c8258-721a-4e4e-aac0-1ec77172128c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517287 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-config-volume\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517287 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517179 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6pfv\" (UniqueName: \"kubernetes.io/projected/991c8258-721a-4e4e-aac0-1ec77172128c-kube-api-access-v6pfv\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517287 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517207 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517287 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517235 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517287 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517283 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517352 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/991c8258-721a-4e4e-aac0-1ec77172128c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/991c8258-721a-4e4e-aac0-1ec77172128c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517430 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-web-config\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517458 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991c8258-721a-4e4e-aac0-1ec77172128c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.517603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.517490 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/991c8258-721a-4e4e-aac0-1ec77172128c-config-out\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.519302 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.519218 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/991c8258-721a-4e4e-aac0-1ec77172128c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.519426 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.519396 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/991c8258-721a-4e4e-aac0-1ec77172128c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.520324 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.520297 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/991c8258-721a-4e4e-aac0-1ec77172128c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523316 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.521429 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/991c8258-721a-4e4e-aac0-1ec77172128c-config-out\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523316 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.521869 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523316 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.522017 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523316 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.522382 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523316 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.522413 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-config-volume\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523316 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.523008 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/991c8258-721a-4e4e-aac0-1ec77172128c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523673 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.523335 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523673 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.523408 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.523673 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.523496 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/991c8258-721a-4e4e-aac0-1ec77172128c-web-config\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.531335 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.531312 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6pfv\" (UniqueName: \"kubernetes.io/projected/991c8258-721a-4e4e-aac0-1ec77172128c-kube-api-access-v6pfv\") pod \"alertmanager-main-0\" (UID: \"991c8258-721a-4e4e-aac0-1ec77172128c\") " pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.536681 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.536655 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:08.611345 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.611310 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 07 15:02:08.636814 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.636778 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:08.739804 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:08.739718 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:08.848842 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:02:08.848729 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa25adb6_0689_4dea_9f16_4d3c51171d20.slice/crio-7fb82dcdec42146565045b84ecb39a5661248cef09fa73e15a03ceb1498cc572 WatchSource:0}: Error finding container 7fb82dcdec42146565045b84ecb39a5661248cef09fa73e15a03ceb1498cc572: Status 404 returned error can't find the container with id 7fb82dcdec42146565045b84ecb39a5661248cef09fa73e15a03ceb1498cc572 Jul 07 15:02:09.028841 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.028732 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 07 15:02:09.030759 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:02:09.030718 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod991c8258_721a_4e4e_aac0_1ec77172128c.slice/crio-d0201baa758a3a70dc2522e3d4303e9f458c626ade45b81611753e0d5f4721ac WatchSource:0}: Error finding container d0201baa758a3a70dc2522e3d4303e9f458c626ade45b81611753e0d5f4721ac: Status 404 returned error can't find the container with id d0201baa758a3a70dc2522e3d4303e9f458c626ade45b81611753e0d5f4721ac Jul 07 15:02:09.155446 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.155411 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:09.249394 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.249358 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:09.402692 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.402655 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mwbqx" event={"ID":"e0c29f8e-51c3-40b1-ad89-a16b212719a8","Type":"ContainerStarted","Data":"811912be62817ecbed70d2d2e8d273c956266903506b189a00e18b53acc88cf8"} Jul 07 15:02:09.402881 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.402715 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:02:09.403949 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.403925 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"991c8258-721a-4e4e-aac0-1ec77172128c","Type":"ContainerStarted","Data":"d0201baa758a3a70dc2522e3d4303e9f458c626ade45b81611753e0d5f4721ac"} Jul 07 15:02:09.405009 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.404964 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8t7b" event={"ID":"aa25adb6-0689-4dea-9f16-4d3c51171d20","Type":"ContainerStarted","Data":"7fb82dcdec42146565045b84ecb39a5661248cef09fa73e15a03ceb1498cc572"} Jul 07 15:02:09.892658 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.892625 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:09.957664 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:09.957627 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:10.411713 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:10.411649 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6zmxl" event={"ID":"0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04","Type":"ContainerStarted","Data":"7b17dd7208697a050ebb2b27aa748ee45a8883e6062aee05f7fe018343735f63"} Jul 07 15:02:10.437878 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:10.435721 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mwbqx" podStartSLOduration=67.997776271 podStartE2EDuration="1m13.435699718s" totalImagesPullingTime="5.437923447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:09.428551007 +0000 UTC m=+72.903387757" watchObservedRunningTime="2026-07-07 15:02:10.435699718 +0000 UTC m=+73.910536468" Jul 07 15:02:10.476507 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:10.476465 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:10.570893 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:10.570851 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:10.708707 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:10.708620 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:10.964936 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:10.964852 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:11.041210 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.041178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:11.416820 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.416788 2580 generic.go:356] "Generic (PLEG): container finished" podID="991c8258-721a-4e4e-aac0-1ec77172128c" containerID="7fb5945c1aa5883812999f19c2e83ef05969f8506ff3abcc8de78208741e2319" exitCode=0 Jul 07 15:02:11.416962 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.416870 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"991c8258-721a-4e4e-aac0-1ec77172128c","Type":"ContainerDied","Data":"7fb5945c1aa5883812999f19c2e83ef05969f8506ff3abcc8de78208741e2319"} Jul 07 15:02:11.448547 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.448489 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6zmxl" podStartSLOduration=68.36032832 podStartE2EDuration="1m14.448455086s" totalImagesPullingTime="6.088126766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:00:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:10.441409649 +0000 UTC m=+73.916246397" watchObservedRunningTime="2026-07-07 15:02:11.448455086 +0000 UTC m=+74.923291835" Jul 07 15:02:11.843581 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.843550 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:11.851044 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.851017 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr"] Jul 07 15:02:11.853213 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.853195 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:11.857100 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.857071 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pdb4g\"" Jul 07 15:02:11.857241 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.857105 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 15:02:11.866357 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.866331 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr"] Jul 07 15:02:11.937320 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.937289 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:11.947434 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.947408 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a3f74dc-11ec-429a-bbc3-bfa50a730381-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bw5tr\" (UID: \"4a3f74dc-11ec-429a-bbc3-bfa50a730381\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:11.947598 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:11.947457 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpxzt\" (UniqueName: \"kubernetes.io/projected/4a3f74dc-11ec-429a-bbc3-bfa50a730381-kube-api-access-fpxzt\") pod \"monitoring-plugin-d5dcff7cf-bw5tr\" (UID: \"4a3f74dc-11ec-429a-bbc3-bfa50a730381\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:12.039137 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.039055 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:12.048603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.048573 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a3f74dc-11ec-429a-bbc3-bfa50a730381-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bw5tr\" (UID: \"4a3f74dc-11ec-429a-bbc3-bfa50a730381\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:12.048776 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.048611 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpxzt\" (UniqueName: \"kubernetes.io/projected/4a3f74dc-11ec-429a-bbc3-bfa50a730381-kube-api-access-fpxzt\") pod \"monitoring-plugin-d5dcff7cf-bw5tr\" (UID: \"4a3f74dc-11ec-429a-bbc3-bfa50a730381\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:12.050964 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.050939 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4a3f74dc-11ec-429a-bbc3-bfa50a730381-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-bw5tr\" (UID: \"4a3f74dc-11ec-429a-bbc3-bfa50a730381\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:12.065565 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.065527 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpxzt\" (UniqueName: \"kubernetes.io/projected/4a3f74dc-11ec-429a-bbc3-bfa50a730381-kube-api-access-fpxzt\") pod \"monitoring-plugin-d5dcff7cf-bw5tr\" (UID: \"4a3f74dc-11ec-429a-bbc3-bfa50a730381\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:12.162950 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.162903 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:12.294775 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.294490 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr"] Jul 07 15:02:12.297573 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:02:12.297548 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a3f74dc_11ec_429a_bbc3_bfa50a730381.slice/crio-f6f7c1fadbd2b6c72d4293f4240edbc5cb6b34aa0a4461f18fd39796b131c937 WatchSource:0}: Error finding container f6f7c1fadbd2b6c72d4293f4240edbc5cb6b34aa0a4461f18fd39796b131c937: Status 404 returned error can't find the container with id f6f7c1fadbd2b6c72d4293f4240edbc5cb6b34aa0a4461f18fd39796b131c937 Jul 07 15:02:12.421726 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.421688 2580 generic.go:356] "Generic (PLEG): container finished" podID="aa25adb6-0689-4dea-9f16-4d3c51171d20" containerID="224462151d382ba17d97fcf9d79a33cb41082f4129420e4f0e7673ac0930dddf" exitCode=0 Jul 07 15:02:12.421899 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.421770 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8t7b" event={"ID":"aa25adb6-0689-4dea-9f16-4d3c51171d20","Type":"ContainerDied","Data":"224462151d382ba17d97fcf9d79a33cb41082f4129420e4f0e7673ac0930dddf"} Jul 07 15:02:12.423059 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.423026 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" event={"ID":"4a3f74dc-11ec-429a-bbc3-bfa50a730381","Type":"ContainerStarted","Data":"f6f7c1fadbd2b6c72d4293f4240edbc5cb6b34aa0a4461f18fd39796b131c937"} Jul 07 15:02:12.532869 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.532847 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:12.630613 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:12.630583 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:13.432093 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.432024 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8t7b" event={"ID":"aa25adb6-0689-4dea-9f16-4d3c51171d20","Type":"ContainerStarted","Data":"dc607c1983512f5d1259cfec02228bcb7c104345e55f886fbf0fa7251ee13f1f"} Jul 07 15:02:13.432530 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.432125 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8t7b" event={"ID":"aa25adb6-0689-4dea-9f16-4d3c51171d20","Type":"ContainerStarted","Data":"5ce58b4cb9590c1d6303bdd0d9c3191934000f711570a54eb1b4253c4b2daf23"} Jul 07 15:02:13.542668 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.542373 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8t7b" podStartSLOduration=3.583478637 podStartE2EDuration="6.542348669s" totalImagesPullingTime="2.889522747s" totalInitContainerRuntime="69.347285ms" isStatefulPod=true podCreationTimestamp="2026-07-07 15:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:13.536909908 +0000 UTC m=+77.011746660" watchObservedRunningTime="2026-07-07 15:02:13.542348669 +0000 UTC m=+77.017185422" Jul 07 15:02:13.557477 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.557436 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:13.771040 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.770897 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:13.779627 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.779592 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 15:02:13.784392 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.784361 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.791390 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.791365 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.792410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.792457 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.792476 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.792420 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.792410 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.792642 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7wr8q\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.792714 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.792769 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.793106 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.793362 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.793377 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 15:02:13.793624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.793527 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 15:02:13.794344 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.793931 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a8esl8t3dskjk\"" Jul 07 15:02:13.794344 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.793960 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 15:02:13.794963 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.794945 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 15:02:13.797745 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.797726 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 15:02:13.832138 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.832107 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 15:02:13.863613 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863582 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863613 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863618 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863642 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863665 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863727 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-config\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863748 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38c471af-c395-4004-9d1b-a1602ecdcf61-config-out\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863776 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863800 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863825 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.863855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863846 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863888 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863909 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38c471af-c395-4004-9d1b-a1602ecdcf61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.863946 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.864006 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.864027 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.864046 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-web-config\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.864070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx6pp\" (UniqueName: \"kubernetes.io/projected/38c471af-c395-4004-9d1b-a1602ecdcf61-kube-api-access-qx6pp\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.864093 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.864147 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.864169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.864161 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.871148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.871120 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:13.965312 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965279 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-web-config\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965506 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965321 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6pp\" (UniqueName: \"kubernetes.io/projected/38c471af-c395-4004-9d1b-a1602ecdcf61-kube-api-access-qx6pp\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965506 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965356 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965506 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965400 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965685 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965651 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965769 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965707 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965769 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965744 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965869 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965774 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965869 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965807 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.965869 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965848 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-config\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966030 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965875 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38c471af-c395-4004-9d1b-a1602ecdcf61-config-out\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966030 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965918 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966030 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965943 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966030 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.965988 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966030 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.966015 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966253 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.966044 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966253 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.966071 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38c471af-c395-4004-9d1b-a1602ecdcf61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966253 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.966095 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966253 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.966120 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.966253 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.966144 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.967364 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.966844 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.967769 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.967569 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.967769 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.967603 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.971899 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.968296 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-web-config\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.971899 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.968703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.971899 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.969050 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.971899 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.969963 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.973854 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.972547 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.973854 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.972753 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.973854 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.973084 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.973854 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.973287 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/38c471af-c395-4004-9d1b-a1602ecdcf61-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.973854 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.973458 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.973854 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.973683 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.973854 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.973799 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/38c471af-c395-4004-9d1b-a1602ecdcf61-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.974277 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.973934 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/38c471af-c395-4004-9d1b-a1602ecdcf61-config-out\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.974883 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.974843 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.975373 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.975328 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.976521 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.976497 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.976872 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.976852 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/38c471af-c395-4004-9d1b-a1602ecdcf61-config\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:13.979787 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:13.979768 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx6pp\" (UniqueName: \"kubernetes.io/projected/38c471af-c395-4004-9d1b-a1602ecdcf61-kube-api-access-qx6pp\") pod \"prometheus-k8s-0\" (UID: \"38c471af-c395-4004-9d1b-a1602ecdcf61\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:14.096958 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.096920 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:14.308503 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.308450 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 15:02:14.318477 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:02:14.318450 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c471af_c395_4004_9d1b_a1602ecdcf61.slice/crio-36dc149eb590e680f7200585ab50cb1ac112dde5c85c32caf29d5ddaf6869a45 WatchSource:0}: Error finding container 36dc149eb590e680f7200585ab50cb1ac112dde5c85c32caf29d5ddaf6869a45: Status 404 returned error can't find the container with id 36dc149eb590e680f7200585ab50cb1ac112dde5c85c32caf29d5ddaf6869a45 Jul 07 15:02:14.438669 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.438629 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerStarted","Data":"8f8b696fee66c0ca592c5b36ad24b34c9325ba7814a0b6564e4ccd0838177b32"} Jul 07 15:02:14.439256 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.438719 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerStarted","Data":"36dc149eb590e680f7200585ab50cb1ac112dde5c85c32caf29d5ddaf6869a45"} Jul 07 15:02:14.444055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.443779 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"991c8258-721a-4e4e-aac0-1ec77172128c","Type":"ContainerStarted","Data":"01ee90a34a0c8ae082b47a0717a97361120cddd7c3109b79f3c199c0f59a4b2f"} Jul 07 15:02:14.444055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.443855 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"991c8258-721a-4e4e-aac0-1ec77172128c","Type":"ContainerStarted","Data":"30463fd977046c30af0881902032a5084b418a83723a50beffbc8d133dc3dfc3"} Jul 07 15:02:14.444055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.443896 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"991c8258-721a-4e4e-aac0-1ec77172128c","Type":"ContainerStarted","Data":"b301162a57a811dcd31d0a0e05e0268191921fa344ab30e4a4eb3429cbcd3a36"} Jul 07 15:02:14.444055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.443934 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"991c8258-721a-4e4e-aac0-1ec77172128c","Type":"ContainerStarted","Data":"c05de1f61f1017487a00306dccdc9bd8f41706d6981243721a4d3937b024c84b"} Jul 07 15:02:14.444055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.443991 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"991c8258-721a-4e4e-aac0-1ec77172128c","Type":"ContainerStarted","Data":"49d121415c70c0c837bede231648eacaab6df3909b0714f430ac1e2fab6b3c7c"} Jul 07 15:02:14.445884 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.445824 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" event={"ID":"4a3f74dc-11ec-429a-bbc3-bfa50a730381","Type":"ContainerStarted","Data":"21df2a45d8c66bc9254c63bf1687726abfe0f65f176bb68b111ada2ce8e3c374"} Jul 07 15:02:14.446334 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.446304 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:14.452333 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.452306 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" Jul 07 15:02:14.503428 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:14.503366 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-bw5tr" podStartSLOduration=1.7004533450000001 podStartE2EDuration="3.503345031s" totalImagesPullingTime="1.802891686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:14.502595195 +0000 UTC m=+77.977431945" watchObservedRunningTime="2026-07-07 15:02:14.503345031 +0000 UTC m=+77.978181781" Jul 07 15:02:15.197220 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:15.197186 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:15.296319 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:15.296286 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:15.451218 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:15.451126 2580 generic.go:356] "Generic (PLEG): container finished" podID="38c471af-c395-4004-9d1b-a1602ecdcf61" containerID="8f8b696fee66c0ca592c5b36ad24b34c9325ba7814a0b6564e4ccd0838177b32" exitCode=0 Jul 07 15:02:15.451662 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:15.451212 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerDied","Data":"8f8b696fee66c0ca592c5b36ad24b34c9325ba7814a0b6564e4ccd0838177b32"} Jul 07 15:02:16.009271 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:16.009228 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:16.107266 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:16.107237 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:16.211640 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:16.211603 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:16.458792 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:16.458755 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"991c8258-721a-4e4e-aac0-1ec77172128c","Type":"ContainerStarted","Data":"53f5225a9431fed9af97166f1335ea4b9ebe8589a68e20e8c9903e51b03632ee"} Jul 07 15:02:16.492538 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:16.492443 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.882131243 podStartE2EDuration="8.492419448s" totalImagesPullingTime="5.59503217s" totalInitContainerRuntime="15.256035ms" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:16.490622165 +0000 UTC m=+79.965458913" watchObservedRunningTime="2026-07-07 15:02:16.492419448 +0000 UTC m=+79.967256200" Jul 07 15:02:17.604584 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:17.604553 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:17.674617 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:17.674576 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:19.366156 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:19.366125 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:19.469193 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:19.469161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:19.476249 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:19.476223 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerStarted","Data":"e945b29f581c3eabf31f355410f960d72655be63c40dee55351ba14a8b393eb2"} Jul 07 15:02:19.476366 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:19.476281 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerStarted","Data":"4662ca02e1a067d9f3567c93f14e246102a7ce8497414e4d3cc2b1baf937da57"} Jul 07 15:02:21.529497 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:21.529466 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:21.590955 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:21.590923 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:22.493228 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:22.493133 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerStarted","Data":"39d1b13323ce775ff107715fad0c9fbe8aa5319c2cf49edeb2a71b102c8c7bf9"} Jul 07 15:02:22.493228 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:22.493207 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerStarted","Data":"e246fee4ed86b56d000279353e023d1cdb97e50f50f87e4fbb58d604ca3e3c1e"} Jul 07 15:02:22.493460 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:22.493247 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerStarted","Data":"3b8af3ab8036a3f854716a5cbf65ed3b7aca56789ea555df6939d5de6ab3fd39"} Jul 07 15:02:22.493460 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:22.493283 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"38c471af-c395-4004-9d1b-a1602ecdcf61","Type":"ContainerStarted","Data":"16c06bf0a87b562ed275eb7cfecc1cd04da859e8e2cf4428e60a6e9f567a768b"} Jul 07 15:02:22.535537 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:22.535473 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.271236485 podStartE2EDuration="9.535449787s" totalImagesPullingTime="6.241452356s" totalInitContainerRuntime="22.760946ms" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:22.532577597 +0000 UTC m=+86.007414346" watchObservedRunningTime="2026-07-07 15:02:22.535449787 +0000 UTC m=+86.010286533" Jul 07 15:02:22.780957 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:22.780877 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:22.881406 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:22.881377 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:23.818947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:23.818915 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:23.923518 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:23.923484 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:23.984650 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:23.984623 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:24.097322 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:24.097226 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:02:38.955909 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:38.955878 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:39.048888 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:39.048857 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:40.414757 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:40.414731 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mwbqx" Jul 07 15:02:53.255921 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:53.255883 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:54.156862 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:54.156829 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:54.234852 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:02:54.234824 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:14.097482 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:14.097441 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:03:14.116535 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:14.116508 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:03:14.691607 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:14.691578 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 15:03:26.646525 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:26.646490 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:26.752287 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:26.752259 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:38.771662 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:38.771618 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:38.828772 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:38.828740 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:39.048437 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:39.048331 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:39.487498 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:39.487464 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:39.634126 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:39.634086 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:41.981917 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:41.981886 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:42.043168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:42.043137 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:53.952681 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:53.952643 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:54.030629 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:54.030597 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:55.145529 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:55.145499 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:55.239606 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:55.239571 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:55.295460 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:03:55.295411 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:04:08.937343 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:04:08.937309 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:04:09.036594 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:04:09.036565 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:04:09.162473 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:04:09.162434 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:04:40.770495 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:04:40.770460 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:04:40.940984 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:04:40.940951 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:12.596463 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:12.596433 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:13.574137 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:13.574106 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:16.304561 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:16.304525 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:16.467820 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:16.467788 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:18.032313 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:18.032287 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:18.133351 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:18.133319 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:18.776739 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:18.776699 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:18.877654 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:18.877625 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:20.439613 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:20.439576 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:20.841233 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:20.841199 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:23.394346 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:23.394305 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:23.493744 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:23.493715 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:27.664473 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:27.664408 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:27.726870 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:27.726831 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:27.855705 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:27.855674 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:29.814321 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:29.814288 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:29.912249 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:29.912220 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:32.106251 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.106218 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q"] Jul 07 15:05:32.108494 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.108477 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" Jul 07 15:05:32.111310 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.111284 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 07 15:05:32.111310 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.111298 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 07 15:05:32.112654 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.112616 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6p26j\"" Jul 07 15:05:32.118990 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.118952 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q"] Jul 07 15:05:32.243364 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.243314 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9c3f63-4447-4138-a8cf-d4ddbdcc1251-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpp8q\" (UID: \"1e9c3f63-4447-4138-a8cf-d4ddbdcc1251\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" Jul 07 15:05:32.243364 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.243366 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8z9s\" (UniqueName: \"kubernetes.io/projected/1e9c3f63-4447-4138-a8cf-d4ddbdcc1251-kube-api-access-b8z9s\") pod \"openshift-lws-operator-fd8ccff4c-cpp8q\" (UID: \"1e9c3f63-4447-4138-a8cf-d4ddbdcc1251\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" Jul 07 15:05:32.344683 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.344635 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9c3f63-4447-4138-a8cf-d4ddbdcc1251-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpp8q\" (UID: \"1e9c3f63-4447-4138-a8cf-d4ddbdcc1251\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" Jul 07 15:05:32.344824 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.344699 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8z9s\" (UniqueName: \"kubernetes.io/projected/1e9c3f63-4447-4138-a8cf-d4ddbdcc1251-kube-api-access-b8z9s\") pod \"openshift-lws-operator-fd8ccff4c-cpp8q\" (UID: \"1e9c3f63-4447-4138-a8cf-d4ddbdcc1251\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" Jul 07 15:05:32.345040 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.345023 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9c3f63-4447-4138-a8cf-d4ddbdcc1251-tmp\") pod \"openshift-lws-operator-fd8ccff4c-cpp8q\" (UID: \"1e9c3f63-4447-4138-a8cf-d4ddbdcc1251\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" Jul 07 15:05:32.356141 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.356107 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8z9s\" (UniqueName: \"kubernetes.io/projected/1e9c3f63-4447-4138-a8cf-d4ddbdcc1251-kube-api-access-b8z9s\") pod \"openshift-lws-operator-fd8ccff4c-cpp8q\" (UID: \"1e9c3f63-4447-4138-a8cf-d4ddbdcc1251\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" Jul 07 15:05:32.431444 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.431339 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" Jul 07 15:05:32.560093 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:32.560068 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q"] Jul 07 15:05:32.562684 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:05:32.562661 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1e9c3f63_4447_4138_a8cf_d4ddbdcc1251.slice/crio-846755df9da9aa91359387a2884ed1e768d2f0d24d16fef04c58d578d889fd9b WatchSource:0}: Error finding container 846755df9da9aa91359387a2884ed1e768d2f0d24d16fef04c58d578d889fd9b: Status 404 returned error can't find the container with id 846755df9da9aa91359387a2884ed1e768d2f0d24d16fef04c58d578d889fd9b Jul 07 15:05:33.157750 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:33.157718 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" event={"ID":"1e9c3f63-4447-4138-a8cf-d4ddbdcc1251","Type":"ContainerStarted","Data":"846755df9da9aa91359387a2884ed1e768d2f0d24d16fef04c58d578d889fd9b"} Jul 07 15:05:36.170108 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:36.170074 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" event={"ID":"1e9c3f63-4447-4138-a8cf-d4ddbdcc1251","Type":"ContainerStarted","Data":"0176354060a67bc8a9dbd0b560efd7de77c2a3437cf61b49e9388dc50a1039a6"} Jul 07 15:05:36.191259 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:36.191213 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-cpp8q" podStartSLOduration=0.722908513 podStartE2EDuration="4.191198771s" totalImagesPullingTime="3.468290258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:36.189720701 +0000 UTC m=+279.664557449" watchObservedRunningTime="2026-07-07 15:05:36.191198771 +0000 UTC m=+279.666035520" Jul 07 15:05:36.924355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:36.924324 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:38.807202 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:38.807161 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:39.527888 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:39.527856 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:51.017059 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.017025 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:51.111096 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.111065 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:51.653251 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.653175 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:51.860314 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.860287 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:51.983948 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.983866 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66"] Jul 07 15:05:51.987108 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.987084 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:51.988847 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.988821 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:51.991778 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.991755 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 15:05:51.992115 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.992093 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 15:05:51.992473 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.992452 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 15:05:51.992561 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.992453 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7xnv8\"" Jul 07 15:05:51.993557 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:51.993533 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 15:05:52.007319 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.007290 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66"] Jul 07 15:05:52.012459 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.012433 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/933e75bd-9c1a-4c3c-8e91-41a127689085-webhook-cert\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.012593 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.012486 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/933e75bd-9c1a-4c3c-8e91-41a127689085-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.012593 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.012513 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79ggm\" (UniqueName: \"kubernetes.io/projected/933e75bd-9c1a-4c3c-8e91-41a127689085-kube-api-access-79ggm\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.012593 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.012562 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933e75bd-9c1a-4c3c-8e91-41a127689085-tmp\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.012593 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.012586 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/933e75bd-9c1a-4c3c-8e91-41a127689085-manifests\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.012772 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.012753 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f"] Jul 07 15:05:52.015789 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.015774 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.018873 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.018849 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 07 15:05:52.019260 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.018905 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 07 15:05:52.019260 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.018962 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 07 15:05:52.019260 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.019101 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8svlv\"" Jul 07 15:05:52.058586 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.058556 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f"] Jul 07 15:05:52.097727 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.097692 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:52.113039 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113010 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-manager-config\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.113192 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113056 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/933e75bd-9c1a-4c3c-8e91-41a127689085-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.113192 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113082 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79ggm\" (UniqueName: \"kubernetes.io/projected/933e75bd-9c1a-4c3c-8e91-41a127689085-kube-api-access-79ggm\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.113192 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-metrics-cert\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.113192 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113156 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933e75bd-9c1a-4c3c-8e91-41a127689085-tmp\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.113384 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113197 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/933e75bd-9c1a-4c3c-8e91-41a127689085-manifests\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.113384 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113241 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55hxw\" (UniqueName: \"kubernetes.io/projected/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-kube-api-access-55hxw\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.113384 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/933e75bd-9c1a-4c3c-8e91-41a127689085-webhook-cert\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.113384 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113332 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-cert\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.113657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.113633 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/933e75bd-9c1a-4c3c-8e91-41a127689085-manifests\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.115601 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.115569 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/933e75bd-9c1a-4c3c-8e91-41a127689085-tmp\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.115749 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.115733 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/933e75bd-9c1a-4c3c-8e91-41a127689085-webhook-cert\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.115787 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.115745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/933e75bd-9c1a-4c3c-8e91-41a127689085-apiservice-cert\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.137753 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.137724 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79ggm\" (UniqueName: \"kubernetes.io/projected/933e75bd-9c1a-4c3c-8e91-41a127689085-kube-api-access-79ggm\") pod \"opendatahub-operator-controller-manager-845dc9964f-7sd66\" (UID: \"933e75bd-9c1a-4c3c-8e91-41a127689085\") " pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.214300 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.214262 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-cert\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.214300 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.214307 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-manager-config\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.214541 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.214344 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-metrics-cert\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.214541 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.214387 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55hxw\" (UniqueName: \"kubernetes.io/projected/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-kube-api-access-55hxw\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.215055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.215030 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-manager-config\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.217080 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.217059 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-cert\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.217197 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.217120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-metrics-cert\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.232045 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.232020 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55hxw\" (UniqueName: \"kubernetes.io/projected/398c5e10-8688-402a-9dc4-c90dfa7a3f9a-kube-api-access-55hxw\") pod \"lws-controller-manager-d59ff9cf9-lrz9f\" (UID: \"398c5e10-8688-402a-9dc4-c90dfa7a3f9a\") " pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.298007 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.297878 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:52.314352 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.314327 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:52.325303 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.325272 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:52.416506 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.416474 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:52.449440 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:05:52.449415 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933e75bd_9c1a_4c3c_8e91_41a127689085.slice/crio-c492f1c6536f71861ab385e703cf25c7705569e762ff1d9edbe7841f1274325b WatchSource:0}: Error finding container c492f1c6536f71861ab385e703cf25c7705569e762ff1d9edbe7841f1274325b: Status 404 returned error can't find the container with id c492f1c6536f71861ab385e703cf25c7705569e762ff1d9edbe7841f1274325b Jul 07 15:05:52.452848 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.452828 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66"] Jul 07 15:05:52.466274 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.466250 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f"] Jul 07 15:05:52.466761 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:05:52.466738 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod398c5e10_8688_402a_9dc4_c90dfa7a3f9a.slice/crio-1e0a633024b9232ca736c8e52168c36ac97ca2c7cf222ed47f59ac5db19ff342 WatchSource:0}: Error finding container 1e0a633024b9232ca736c8e52168c36ac97ca2c7cf222ed47f59ac5db19ff342: Status 404 returned error can't find the container with id 1e0a633024b9232ca736c8e52168c36ac97ca2c7cf222ed47f59ac5db19ff342 Jul 07 15:05:52.498340 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.498313 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:52.579306 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.579277 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:52.680501 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.680471 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:52.780079 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:52.780048 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:05:53.239063 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:53.239014 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" event={"ID":"933e75bd-9c1a-4c3c-8e91-41a127689085","Type":"ContainerStarted","Data":"c492f1c6536f71861ab385e703cf25c7705569e762ff1d9edbe7841f1274325b"} Jul 07 15:05:53.242818 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:53.242781 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" event={"ID":"398c5e10-8688-402a-9dc4-c90dfa7a3f9a","Type":"ContainerStarted","Data":"1e0a633024b9232ca736c8e52168c36ac97ca2c7cf222ed47f59ac5db19ff342"} Jul 07 15:05:56.258925 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:56.258893 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" event={"ID":"398c5e10-8688-402a-9dc4-c90dfa7a3f9a","Type":"ContainerStarted","Data":"dd7dc8a3da0b4c14fbf18110b2d7ae1b1a1af814beeacde854e8d2abed4e3008"} Jul 07 15:05:56.259401 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:56.259091 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:05:56.260507 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:56.260471 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" event={"ID":"933e75bd-9c1a-4c3c-8e91-41a127689085","Type":"ContainerStarted","Data":"a20963cf2d3b2461309c33a3e53eb0577ccf4dcf6b4878c64f883b0a30f7ec3a"} Jul 07 15:05:56.278961 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:56.278903 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" podStartSLOduration=1.952138575 podStartE2EDuration="5.278888338s" totalImagesPullingTime="3.326749763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:56.277905343 +0000 UTC m=+299.752742088" watchObservedRunningTime="2026-07-07 15:05:56.278888338 +0000 UTC m=+299.753725065" Jul 07 15:05:56.973792 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:56.973766 2580 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 15:05:57.266165 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:57.265956 2580 generic.go:356] "Generic (PLEG): container finished" podID="933e75bd-9c1a-4c3c-8e91-41a127689085" containerID="a20963cf2d3b2461309c33a3e53eb0577ccf4dcf6b4878c64f883b0a30f7ec3a" exitCode=0 Jul 07 15:05:57.266165 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:57.266009 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" event={"ID":"933e75bd-9c1a-4c3c-8e91-41a127689085","Type":"ContainerDied","Data":"a20963cf2d3b2461309c33a3e53eb0577ccf4dcf6b4878c64f883b0a30f7ec3a"} Jul 07 15:05:59.275664 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:59.275625 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" event={"ID":"933e75bd-9c1a-4c3c-8e91-41a127689085","Type":"ContainerStarted","Data":"3a2577ccda06f006b1200cca40270281626272d10749a5b4e9ba0febadfa54ef"} Jul 07 15:05:59.276066 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:59.275742 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:05:59.317323 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:05:59.317264 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" podStartSLOduration=2.066650339 podStartE2EDuration="8.317244919s" totalImagesPullingTime="5.214382516s" totalInitContainerRuntime="1.036212064s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:05:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:05:59.316837123 +0000 UTC m=+302.791673885" watchObservedRunningTime="2026-07-07 15:05:59.317244919 +0000 UTC m=+302.792081667" Jul 07 15:06:07.268850 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:07.268817 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d59ff9cf9-lrz9f" Jul 07 15:06:10.282153 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:10.282123 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-845dc9964f-7sd66" Jul 07 15:06:11.933215 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:11.933177 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:12.451798 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.451767 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt"] Jul 07 15:06:12.464299 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.464276 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.469260 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.469231 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 15:06:12.469406 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.469276 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 15:06:12.469406 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.469231 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 15:06:12.469406 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.469231 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 15:06:12.469406 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.469232 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-rx945\"" Jul 07 15:06:12.471140 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.471116 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt"] Jul 07 15:06:12.587938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.587905 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a000aa1a-dccb-46fe-bdb5-88ee94724ced-tmp\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.587938 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.587941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6v4h\" (UniqueName: \"kubernetes.io/projected/a000aa1a-dccb-46fe-bdb5-88ee94724ced-kube-api-access-x6v4h\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.588157 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.587990 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a000aa1a-dccb-46fe-bdb5-88ee94724ced-tls-certs\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.670311 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.670284 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:12.689435 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.689409 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a000aa1a-dccb-46fe-bdb5-88ee94724ced-tmp\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.689590 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.689444 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6v4h\" (UniqueName: \"kubernetes.io/projected/a000aa1a-dccb-46fe-bdb5-88ee94724ced-kube-api-access-x6v4h\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.689590 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.689475 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a000aa1a-dccb-46fe-bdb5-88ee94724ced-tls-certs\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.691764 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.691740 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a000aa1a-dccb-46fe-bdb5-88ee94724ced-tmp\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.691891 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.691874 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a000aa1a-dccb-46fe-bdb5-88ee94724ced-tls-certs\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.714023 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.713945 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6v4h\" (UniqueName: \"kubernetes.io/projected/a000aa1a-dccb-46fe-bdb5-88ee94724ced-kube-api-access-x6v4h\") pod \"kube-auth-proxy-8697c578dd-2mwlt\" (UID: \"a000aa1a-dccb-46fe-bdb5-88ee94724ced\") " pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.774293 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.774257 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" Jul 07 15:06:12.775281 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.775257 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:12.912491 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.912459 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt"] Jul 07 15:06:12.915595 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:06:12.915566 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda000aa1a_dccb_46fe_bdb5_88ee94724ced.slice/crio-ff5c635649c18edcdc2a4013f1568df2cbf45c1f7382b5b176ac11a59f060685 WatchSource:0}: Error finding container ff5c635649c18edcdc2a4013f1568df2cbf45c1f7382b5b176ac11a59f060685: Status 404 returned error can't find the container with id ff5c635649c18edcdc2a4013f1568df2cbf45c1f7382b5b176ac11a59f060685 Jul 07 15:06:12.917404 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.917388 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:06:12.924385 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.924360 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:12.996560 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:12.996472 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:13.096569 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:13.096542 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:13.296937 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:13.296863 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:13.333904 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:13.333856 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" event={"ID":"a000aa1a-dccb-46fe-bdb5-88ee94724ced","Type":"ContainerStarted","Data":"ff5c635649c18edcdc2a4013f1568df2cbf45c1f7382b5b176ac11a59f060685"} Jul 07 15:06:13.898188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:13.898160 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:13.974270 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:13.974232 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:14.090585 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:14.090554 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:15.689592 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:15.689559 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:16.346269 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:16.346229 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" event={"ID":"a000aa1a-dccb-46fe-bdb5-88ee94724ced","Type":"ContainerStarted","Data":"9582789fa602e60e58de453bbde1bd15f8399995e3c245d362adef6cd87eb2ed"} Jul 07 15:06:16.374154 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:16.374109 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8697c578dd-2mwlt" podStartSLOduration=1.121937723 podStartE2EDuration="4.374093932s" totalImagesPullingTime="3.252156209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:06:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:16.373363178 +0000 UTC m=+319.848199929" watchObservedRunningTime="2026-07-07 15:06:16.374093932 +0000 UTC m=+319.848930675" Jul 07 15:06:20.567369 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:20.567337 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:20.757668 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:20.757635 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:21.898314 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:21.898244 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:22.286181 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:22.286069 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:22.623010 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:22.622950 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:26.832703 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:26.832672 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:26.930738 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:26.930696 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:26.965507 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:26.965477 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm"] Jul 07 15:06:26.967580 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:26.967566 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:26.976512 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:26.976493 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-tv7t7\"" Jul 07 15:06:26.976755 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:26.976738 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 07 15:06:26.982380 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:26.982359 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm"] Jul 07 15:06:27.049165 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.049138 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:27.117911 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.117812 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spnct\" (UniqueName: \"kubernetes.io/projected/59d6c10e-4db6-406d-8bfd-f1087111e87c-kube-api-access-spnct\") pod \"kserve-controller-manager-d6f4b65b8-b6pkm\" (UID: \"59d6c10e-4db6-406d-8bfd-f1087111e87c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:27.117911 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.117862 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59d6c10e-4db6-406d-8bfd-f1087111e87c-cert\") pod \"kserve-controller-manager-d6f4b65b8-b6pkm\" (UID: \"59d6c10e-4db6-406d-8bfd-f1087111e87c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:27.218362 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.218322 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spnct\" (UniqueName: \"kubernetes.io/projected/59d6c10e-4db6-406d-8bfd-f1087111e87c-kube-api-access-spnct\") pod \"kserve-controller-manager-d6f4b65b8-b6pkm\" (UID: \"59d6c10e-4db6-406d-8bfd-f1087111e87c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:27.218362 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.218365 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59d6c10e-4db6-406d-8bfd-f1087111e87c-cert\") pod \"kserve-controller-manager-d6f4b65b8-b6pkm\" (UID: \"59d6c10e-4db6-406d-8bfd-f1087111e87c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:27.220836 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.220805 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/59d6c10e-4db6-406d-8bfd-f1087111e87c-cert\") pod \"kserve-controller-manager-d6f4b65b8-b6pkm\" (UID: \"59d6c10e-4db6-406d-8bfd-f1087111e87c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:27.246887 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.246843 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spnct\" (UniqueName: \"kubernetes.io/projected/59d6c10e-4db6-406d-8bfd-f1087111e87c-kube-api-access-spnct\") pod \"kserve-controller-manager-d6f4b65b8-b6pkm\" (UID: \"59d6c10e-4db6-406d-8bfd-f1087111e87c\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:27.268408 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.268361 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:27.277227 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.277205 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:27.443555 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:27.443469 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm"] Jul 07 15:06:27.449629 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:06:27.449597 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d6c10e_4db6_406d_8bfd_f1087111e87c.slice/crio-6376de9a12b7086833a1d01ef2aac3ae4179329932b70d7697f43ee0783b737a WatchSource:0}: Error finding container 6376de9a12b7086833a1d01ef2aac3ae4179329932b70d7697f43ee0783b737a: Status 404 returned error can't find the container with id 6376de9a12b7086833a1d01ef2aac3ae4179329932b70d7697f43ee0783b737a Jul 07 15:06:28.187214 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:28.187183 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:28.288223 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:28.288185 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:28.360843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:28.360811 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:06:28.395650 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:28.395616 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" event={"ID":"59d6c10e-4db6-406d-8bfd-f1087111e87c","Type":"ContainerStarted","Data":"6376de9a12b7086833a1d01ef2aac3ae4179329932b70d7697f43ee0783b737a"} Jul 07 15:06:30.405092 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:30.405059 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" event={"ID":"59d6c10e-4db6-406d-8bfd-f1087111e87c","Type":"ContainerStarted","Data":"7c2e1883870a63445cddd18a2c92c4878488bf8981e8b8331d13469e077232f9"} Jul 07 15:06:30.405499 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:30.405169 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:06:51.190064 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:06:51.189933 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:01.414361 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:01.414324 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" Jul 07 15:07:01.435896 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:01.435812 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-b6pkm" podStartSLOduration=32.705480211 podStartE2EDuration="35.435796858s" totalImagesPullingTime="2.730316647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:06:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:06:30.431692197 +0000 UTC m=+333.906528958" watchObservedRunningTime="2026-07-07 15:07:01.435796858 +0000 UTC m=+364.910633645" Jul 07 15:07:13.674525 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:13.674491 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:13.772549 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:13.772519 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:13.869268 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:13.869234 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:14.622805 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:14.622769 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:14.810348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:14.810315 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:28.665498 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:28.665467 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:28.765493 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:28.765463 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:30.612673 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:30.612637 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:30.675676 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:30.675639 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:39.166994 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:39.166935 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:39.768001 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:39.767955 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:40.189594 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:40.189563 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:40.292256 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:40.292218 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:44.207042 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:44.207009 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:46.972413 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:46.972376 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:47.416241 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:47.416205 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:49.446905 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:49.446871 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:49.592810 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:49.592779 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:52.010485 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:52.010450 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:54.579297 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:54.579262 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:54.677580 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:54.677550 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:54.881205 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:54.881110 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:54.985522 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:54.985486 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:58.608963 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:58.608928 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:07:58.720177 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:07:58.720147 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:01.718405 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:01.718360 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:01.856311 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:01.856273 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:04.418054 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.418022 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:04.422177 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.422145 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz"] Jul 07 15:08:04.424375 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.424359 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.427408 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.427383 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 15:08:04.428227 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.428209 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 15:08:04.428676 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.428652 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 15:08:04.429021 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.428997 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-29wfl\"" Jul 07 15:08:04.429122 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.429032 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 15:08:04.436307 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.436282 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz"] Jul 07 15:08:04.526684 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.526651 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpkvn\" (UniqueName: \"kubernetes.io/projected/f6aa854c-ba95-4128-864a-c3df8f8e0d72-kube-api-access-fpkvn\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.526859 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.526715 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6aa854c-ba95-4128-864a-c3df8f8e0d72-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.526859 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.526764 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f6aa854c-ba95-4128-864a-c3df8f8e0d72-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.627670 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.627632 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpkvn\" (UniqueName: \"kubernetes.io/projected/f6aa854c-ba95-4128-864a-c3df8f8e0d72-kube-api-access-fpkvn\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.627875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.627698 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6aa854c-ba95-4128-864a-c3df8f8e0d72-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.627875 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:08:04.627786 2580 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 07 15:08:04.627875 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.627816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f6aa854c-ba95-4128-864a-c3df8f8e0d72-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.627875 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:08:04.627845 2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6aa854c-ba95-4128-864a-c3df8f8e0d72-plugin-serving-cert podName:f6aa854c-ba95-4128-864a-c3df8f8e0d72 nodeName:}" failed. No retries permitted until 2026-07-07 15:08:05.127830465 +0000 UTC m=+428.602667192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/f6aa854c-ba95-4128-864a-c3df8f8e0d72-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-blwlz" (UID: "f6aa854c-ba95-4128-864a-c3df8f8e0d72") : secret "plugin-serving-cert" not found Jul 07 15:08:04.628430 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.628403 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f6aa854c-ba95-4128-864a-c3df8f8e0d72-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.642610 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.642582 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpkvn\" (UniqueName: \"kubernetes.io/projected/f6aa854c-ba95-4128-864a-c3df8f8e0d72-kube-api-access-fpkvn\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:04.856757 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:04.856722 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:05.133021 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:05.132898 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6aa854c-ba95-4128-864a-c3df8f8e0d72-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:05.135535 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:05.135508 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6aa854c-ba95-4128-864a-c3df8f8e0d72-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-blwlz\" (UID: \"f6aa854c-ba95-4128-864a-c3df8f8e0d72\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:05.333918 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:05.333862 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" Jul 07 15:08:05.467484 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:05.467453 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz"] Jul 07 15:08:05.469941 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:08:05.469914 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6aa854c_ba95_4128_864a_c3df8f8e0d72.slice/crio-59baf2e1e597f0a7c37362c83a0cc05d9ba5a8eeec3d0cdbf0e632b8feb3a297 WatchSource:0}: Error finding container 59baf2e1e597f0a7c37362c83a0cc05d9ba5a8eeec3d0cdbf0e632b8feb3a297: Status 404 returned error can't find the container with id 59baf2e1e597f0a7c37362c83a0cc05d9ba5a8eeec3d0cdbf0e632b8feb3a297 Jul 07 15:08:05.789618 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:05.789538 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" event={"ID":"f6aa854c-ba95-4128-864a-c3df8f8e0d72","Type":"ContainerStarted","Data":"59baf2e1e597f0a7c37362c83a0cc05d9ba5a8eeec3d0cdbf0e632b8feb3a297"} Jul 07 15:08:05.971654 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:05.971619 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:06.072353 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:06.072322 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:06.283477 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:06.283444 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:13.838517 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:13.838475 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:13.937715 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:13.937681 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:14.207788 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:14.207680 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:14.313296 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:14.313267 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:16.846491 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:16.846435 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:16.959702 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:16.959664 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:20.008245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:20.008165 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:20.075676 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:20.075645 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:24.596496 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:24.596464 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:24.697596 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:24.697564 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:29.902735 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:29.902701 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" event={"ID":"f6aa854c-ba95-4128-864a-c3df8f8e0d72","Type":"ContainerStarted","Data":"b8aa086e2f00653fd64489d1dcb1a1ae8cdd8fc926700660464787fdce1ff127"} Jul 07 15:08:29.923919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:29.923868 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-blwlz" podStartSLOduration=2.141106179 podStartE2EDuration="25.92385272s" totalImagesPullingTime="23.782746541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:08:29.92240682 +0000 UTC m=+453.397243570" watchObservedRunningTime="2026-07-07 15:08:29.92385272 +0000 UTC m=+453.398689448" Jul 07 15:08:43.658609 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:43.658574 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:43.869121 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:43.869088 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:45.151530 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:45.151493 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:45.234332 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:45.234302 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:54.818624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:54.818591 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:58.587464 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:58.587426 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:58.696680 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:58.696650 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:58.756556 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:58.756523 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:59.049051 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.048958 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:08:59.103244 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.103213 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:08:59.106316 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.106288 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 15:08:59.108783 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.108761 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:08:59.108894 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.108817 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:08:59.204237 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.204198 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5vsz\" (UniqueName: \"kubernetes.io/projected/896b2f11-02ac-492e-880a-ab2f7e0946de-kube-api-access-m5vsz\") pod \"limitador-limitador-54d6d988d5-zpwl4\" (UID: \"896b2f11-02ac-492e-880a-ab2f7e0946de\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:08:59.204423 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.204248 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/896b2f11-02ac-492e-880a-ab2f7e0946de-config-file\") pod \"limitador-limitador-54d6d988d5-zpwl4\" (UID: \"896b2f11-02ac-492e-880a-ab2f7e0946de\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:08:59.305325 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.305238 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5vsz\" (UniqueName: \"kubernetes.io/projected/896b2f11-02ac-492e-880a-ab2f7e0946de-kube-api-access-m5vsz\") pod \"limitador-limitador-54d6d988d5-zpwl4\" (UID: \"896b2f11-02ac-492e-880a-ab2f7e0946de\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:08:59.305325 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.305281 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/896b2f11-02ac-492e-880a-ab2f7e0946de-config-file\") pod \"limitador-limitador-54d6d988d5-zpwl4\" (UID: \"896b2f11-02ac-492e-880a-ab2f7e0946de\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:08:59.305953 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.305927 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/896b2f11-02ac-492e-880a-ab2f7e0946de-config-file\") pod \"limitador-limitador-54d6d988d5-zpwl4\" (UID: \"896b2f11-02ac-492e-880a-ab2f7e0946de\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:08:59.316053 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.316026 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5vsz\" (UniqueName: \"kubernetes.io/projected/896b2f11-02ac-492e-880a-ab2f7e0946de-kube-api-access-m5vsz\") pod \"limitador-limitador-54d6d988d5-zpwl4\" (UID: \"896b2f11-02ac-492e-880a-ab2f7e0946de\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:08:59.414168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.414136 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:08:59.464867 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.464831 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:59.565178 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.565150 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:08:59.580297 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.580270 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:08:59.582238 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:08:59.582211 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod896b2f11_02ac_492e_880a_ab2f7e0946de.slice/crio-d77fef3c41302267e5a1ea9c5f6750fb3474015a3fd183417b27ae474b42388d WatchSource:0}: Error finding container d77fef3c41302267e5a1ea9c5f6750fb3474015a3fd183417b27ae474b42388d: Status 404 returned error can't find the container with id d77fef3c41302267e5a1ea9c5f6750fb3474015a3fd183417b27ae474b42388d Jul 07 15:08:59.637275 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.637243 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-mqdv2"] Jul 07 15:08:59.648054 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.648014 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mqdv2"] Jul 07 15:08:59.648228 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.648119 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mqdv2" Jul 07 15:08:59.650878 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.650855 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-66xr8\"" Jul 07 15:08:59.708793 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.708758 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxph7\" (UniqueName: \"kubernetes.io/projected/7363e7da-7408-4dcf-ace6-b57fb47f4637-kube-api-access-pxph7\") pod \"authorino-75d556bd77-mqdv2\" (UID: \"7363e7da-7408-4dcf-ace6-b57fb47f4637\") " pod="kuadrant-system/authorino-75d556bd77-mqdv2" Jul 07 15:08:59.810223 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.810193 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxph7\" (UniqueName: \"kubernetes.io/projected/7363e7da-7408-4dcf-ace6-b57fb47f4637-kube-api-access-pxph7\") pod \"authorino-75d556bd77-mqdv2\" (UID: \"7363e7da-7408-4dcf-ace6-b57fb47f4637\") " pod="kuadrant-system/authorino-75d556bd77-mqdv2" Jul 07 15:08:59.840746 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.840671 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxph7\" (UniqueName: \"kubernetes.io/projected/7363e7da-7408-4dcf-ace6-b57fb47f4637-kube-api-access-pxph7\") pod \"authorino-75d556bd77-mqdv2\" (UID: \"7363e7da-7408-4dcf-ace6-b57fb47f4637\") " pod="kuadrant-system/authorino-75d556bd77-mqdv2" Jul 07 15:08:59.957815 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:08:59.957777 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mqdv2" Jul 07 15:09:00.028986 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:00.028928 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" event={"ID":"896b2f11-02ac-492e-880a-ab2f7e0946de","Type":"ContainerStarted","Data":"d77fef3c41302267e5a1ea9c5f6750fb3474015a3fd183417b27ae474b42388d"} Jul 07 15:09:00.115256 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:00.115186 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mqdv2"] Jul 07 15:09:00.118754 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:09:00.118725 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7363e7da_7408_4dcf_ace6_b57fb47f4637.slice/crio-63427e7b366b465352a64987fe8e274e473c5c388059ceb656c93a9155741ec2 WatchSource:0}: Error finding container 63427e7b366b465352a64987fe8e274e473c5c388059ceb656c93a9155741ec2: Status 404 returned error can't find the container with id 63427e7b366b465352a64987fe8e274e473c5c388059ceb656c93a9155741ec2 Jul 07 15:09:01.039090 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:01.038886 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mqdv2" event={"ID":"7363e7da-7408-4dcf-ace6-b57fb47f4637","Type":"ContainerStarted","Data":"63427e7b366b465352a64987fe8e274e473c5c388059ceb656c93a9155741ec2"} Jul 07 15:09:05.059503 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:05.059469 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" event={"ID":"896b2f11-02ac-492e-880a-ab2f7e0946de","Type":"ContainerStarted","Data":"615432717cd82cf6554f62ef0dde9c647c1589e424ab0cd7926fa248f87c90af"} Jul 07 15:09:05.059963 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:05.059556 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:09:05.061012 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:05.060992 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mqdv2" event={"ID":"7363e7da-7408-4dcf-ace6-b57fb47f4637","Type":"ContainerStarted","Data":"1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a"} Jul 07 15:09:05.087495 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:05.087443 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" podStartSLOduration=1.4433029849999999 podStartE2EDuration="6.087428234s" totalImagesPullingTime="4.644125249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:05.086110926 +0000 UTC m=+488.560947676" watchObservedRunningTime="2026-07-07 15:09:05.087428234 +0000 UTC m=+488.562264983" Jul 07 15:09:05.112467 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:05.112400 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-mqdv2" podStartSLOduration=2.041125981 podStartE2EDuration="6.11238488s" totalImagesPullingTime="4.071258899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:09:05.111137679 +0000 UTC m=+488.585974428" watchObservedRunningTime="2026-07-07 15:09:05.11238488 +0000 UTC m=+488.587221628" Jul 07 15:09:10.840450 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:10.840408 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:12.553441 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:12.553406 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:16.066534 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:16.066507 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-zpwl4" Jul 07 15:09:17.802535 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:17.802497 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:20.262823 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:20.262793 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:28.500960 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:28.500923 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:28.600922 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:28.600888 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:32.734784 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:32.734745 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:32.892027 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:32.891995 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:35.469433 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:35.469401 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mqdv2"] Jul 07 15:09:35.469819 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:35.469583 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-mqdv2" podUID="7363e7da-7408-4dcf-ace6-b57fb47f4637" containerName="authorino" containerID="cri-o://1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a" gracePeriod=30 Jul 07 15:09:35.719103 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:35.719080 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mqdv2" Jul 07 15:09:35.826947 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:35.826916 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxph7\" (UniqueName: \"kubernetes.io/projected/7363e7da-7408-4dcf-ace6-b57fb47f4637-kube-api-access-pxph7\") pod \"7363e7da-7408-4dcf-ace6-b57fb47f4637\" (UID: \"7363e7da-7408-4dcf-ace6-b57fb47f4637\") " Jul 07 15:09:35.829086 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:35.829061 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7363e7da-7408-4dcf-ace6-b57fb47f4637-kube-api-access-pxph7" (OuterVolumeSpecName: "kube-api-access-pxph7") pod "7363e7da-7408-4dcf-ace6-b57fb47f4637" (UID: "7363e7da-7408-4dcf-ace6-b57fb47f4637"). InnerVolumeSpecName "kube-api-access-pxph7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:09:35.928268 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:35.928230 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pxph7\" (UniqueName: \"kubernetes.io/projected/7363e7da-7408-4dcf-ace6-b57fb47f4637-kube-api-access-pxph7\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:09:36.191557 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.191471 2580 generic.go:356] "Generic (PLEG): container finished" podID="7363e7da-7408-4dcf-ace6-b57fb47f4637" containerID="1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a" exitCode=0 Jul 07 15:09:36.191557 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.191514 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-mqdv2" Jul 07 15:09:36.191557 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.191549 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mqdv2" event={"ID":"7363e7da-7408-4dcf-ace6-b57fb47f4637","Type":"ContainerDied","Data":"1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a"} Jul 07 15:09:36.191785 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.191578 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-mqdv2" event={"ID":"7363e7da-7408-4dcf-ace6-b57fb47f4637","Type":"ContainerDied","Data":"63427e7b366b465352a64987fe8e274e473c5c388059ceb656c93a9155741ec2"} Jul 07 15:09:36.191785 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.191594 2580 scope.go:117] "RemoveContainer" containerID="1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a" Jul 07 15:09:36.199741 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.199723 2580 scope.go:117] "RemoveContainer" containerID="1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a" Jul 07 15:09:36.200032 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:09:36.200010 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a\": container with ID starting with 1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a not found: ID does not exist" containerID="1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a" Jul 07 15:09:36.200104 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.200040 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a"} err="failed to get container status \"1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a\": rpc error: code = NotFound desc = could not find container \"1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a\": container with ID starting with 1185e8e57080885f8c5a4b3f92bc534775407fa91f7ccfe3432122842053d60a not found: ID does not exist" Jul 07 15:09:36.215241 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.215210 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mqdv2"] Jul 07 15:09:36.222537 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:36.222514 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-mqdv2"] Jul 07 15:09:37.101546 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:37.101511 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7363e7da-7408-4dcf-ace6-b57fb47f4637" path="/var/lib/kubelet/pods/7363e7da-7408-4dcf-ace6-b57fb47f4637/volumes" Jul 07 15:09:39.975386 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:39.975352 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:40.074191 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:40.074155 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:40.160718 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:40.160684 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:43.416175 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:43.416136 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:09:43.503319 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:09:43.503276 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:16.229393 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:16.229351 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:16.734694 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:16.734663 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:16.896204 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:16.896175 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:17.303503 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:17.303473 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:17.398576 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:17.398543 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:17.533054 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:17.533021 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:10:27.708441 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:27.708393 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:27.808960 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:27.808920 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:32.220671 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:32.220640 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:32.684203 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:32.684169 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:10:52.312198 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:52.312167 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:10:52.981010 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:10:52.980906 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:11:00.433765 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:00.433730 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:11:00.495232 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:00.495196 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:11:08.412748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:08.412715 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:11:09.375633 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:09.375599 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:11:17.903158 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:17.903123 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:11:19.395764 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:19.395729 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:11:23.401392 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:23.401358 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:11:23.465117 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:23.465082 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:11:35.880759 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.880728 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx"] Jul 07 15:11:35.881139 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.881050 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7363e7da-7408-4dcf-ace6-b57fb47f4637" containerName="authorino" Jul 07 15:11:35.881139 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.881062 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7363e7da-7408-4dcf-ace6-b57fb47f4637" containerName="authorino" Jul 07 15:11:35.881139 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.881126 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7363e7da-7408-4dcf-ace6-b57fb47f4637" containerName="authorino" Jul 07 15:11:35.883992 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.883947 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:35.886912 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.886887 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tjdd8\"" Jul 07 15:11:35.886912 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.886902 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 07 15:11:35.888257 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.888240 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 07 15:11:35.888345 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.888325 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 07 15:11:35.896988 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.896944 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx"] Jul 07 15:11:35.910834 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.910809 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:11:35.945765 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.945730 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:35.945765 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.945776 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:35.946032 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.945845 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:35.946032 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.945872 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07ae8b6f-7ebe-4723-91af-b35598b7c87c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:35.946032 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.945891 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnn6h\" (UniqueName: \"kubernetes.io/projected/07ae8b6f-7ebe-4723-91af-b35598b7c87c-kube-api-access-vnn6h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:35.946032 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:35.945917 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.046727 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.046690 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnn6h\" (UniqueName: \"kubernetes.io/projected/07ae8b6f-7ebe-4723-91af-b35598b7c87c-kube-api-access-vnn6h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.046863 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.046741 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.046863 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.046790 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.046863 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.046823 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.047024 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.046879 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.047024 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.046920 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07ae8b6f-7ebe-4723-91af-b35598b7c87c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.047201 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.047179 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.047270 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.047237 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.047270 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.047261 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.049188 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.049163 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/07ae8b6f-7ebe-4723-91af-b35598b7c87c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.049379 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.049363 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/07ae8b6f-7ebe-4723-91af-b35598b7c87c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.056691 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.056668 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnn6h\" (UniqueName: \"kubernetes.io/projected/07ae8b6f-7ebe-4723-91af-b35598b7c87c-kube-api-access-vnn6h\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9fqbx\" (UID: \"07ae8b6f-7ebe-4723-91af-b35598b7c87c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.193820 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.193729 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:36.340830 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.340738 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx"] Jul 07 15:11:36.343428 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:11:36.343403 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ae8b6f_7ebe_4723_91af_b35598b7c87c.slice/crio-b89ebc03ed05287523e9197c46f2d1cdbf4e9e3f9fba61cb71d8fef898151def WatchSource:0}: Error finding container b89ebc03ed05287523e9197c46f2d1cdbf4e9e3f9fba61cb71d8fef898151def: Status 404 returned error can't find the container with id b89ebc03ed05287523e9197c46f2d1cdbf4e9e3f9fba61cb71d8fef898151def Jul 07 15:11:36.344704 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.344685 2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:11:36.728583 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:36.728544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" event={"ID":"07ae8b6f-7ebe-4723-91af-b35598b7c87c","Type":"ContainerStarted","Data":"b89ebc03ed05287523e9197c46f2d1cdbf4e9e3f9fba61cb71d8fef898151def"} Jul 07 15:11:37.737195 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:37.737105 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" event={"ID":"07ae8b6f-7ebe-4723-91af-b35598b7c87c","Type":"ContainerStarted","Data":"436c327de5e4d67e2905a11fc3089b2f31f6a9af280c69f4574479c17eec3f73"} Jul 07 15:11:37.762385 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:37.762331 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" podStartSLOduration=1.6792810550000001 podStartE2EDuration="2.762317289s" totalImagesPullingTime="1.083036234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:11:37.758589645 +0000 UTC m=+641.233426394" watchObservedRunningTime="2026-07-07 15:11:37.762317289 +0000 UTC m=+641.237154016" Jul 07 15:11:37.929660 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:37.929631 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:11:45.281524 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.281492 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl"] Jul 07 15:11:45.284882 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.284862 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.287809 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.287790 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 07 15:11:45.296119 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.296100 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl"] Jul 07 15:11:45.336216 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.336184 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:11:45.431054 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.431016 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptt5m\" (UniqueName: \"kubernetes.io/projected/81e0b56b-4af2-4f77-949f-6957e2a94584-kube-api-access-ptt5m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.431228 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.431071 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.431228 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.431118 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.431228 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.431179 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.431228 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.431207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e0b56b-4af2-4f77-949f-6957e2a94584-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.431432 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.431307 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532045 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532078 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532106 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532126 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e0b56b-4af2-4f77-949f-6957e2a94584-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532431 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532191 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532431 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532228 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptt5m\" (UniqueName: \"kubernetes.io/projected/81e0b56b-4af2-4f77-949f-6957e2a94584-kube-api-access-ptt5m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532553 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532506 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532606 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532577 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.532647 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.532616 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.534423 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.534407 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81e0b56b-4af2-4f77-949f-6957e2a94584-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.534685 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.534665 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81e0b56b-4af2-4f77-949f-6957e2a94584-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.541118 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.541097 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptt5m\" (UniqueName: \"kubernetes.io/projected/81e0b56b-4af2-4f77-949f-6957e2a94584-kube-api-access-ptt5m\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl\" (UID: \"81e0b56b-4af2-4f77-949f-6957e2a94584\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.594042 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.594001 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:45.728017 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.727989 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl"] Jul 07 15:11:45.730495 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:11:45.730466 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81e0b56b_4af2_4f77_949f_6957e2a94584.slice/crio-5437923fab8fe65aaa4679d99f98ba2220bfcf9ae49435650daf4eedbe44defa WatchSource:0}: Error finding container 5437923fab8fe65aaa4679d99f98ba2220bfcf9ae49435650daf4eedbe44defa: Status 404 returned error can't find the container with id 5437923fab8fe65aaa4679d99f98ba2220bfcf9ae49435650daf4eedbe44defa Jul 07 15:11:45.771421 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:45.771390 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" event={"ID":"81e0b56b-4af2-4f77-949f-6957e2a94584","Type":"ContainerStarted","Data":"5437923fab8fe65aaa4679d99f98ba2220bfcf9ae49435650daf4eedbe44defa"} Jul 07 15:11:46.193951 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:46.193915 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:46.194156 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:46.194070 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:46.206657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:46.206629 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:46.777755 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:46.777723 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" event={"ID":"81e0b56b-4af2-4f77-949f-6957e2a94584","Type":"ContainerStarted","Data":"05c5090bdace38fc8b669d00e0b29578275b5cd9714d0aa706e0c36ecadef8dd"} Jul 07 15:11:46.788914 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:46.788891 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9fqbx" Jul 07 15:11:46.802346 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:46.802298 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" podStartSLOduration=1.532280825 podStartE2EDuration="1.802284297s" totalImagesPullingTime="270.003472ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:11:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:11:46.799206962 +0000 UTC m=+650.274043712" watchObservedRunningTime="2026-07-07 15:11:46.802284297 +0000 UTC m=+650.277121047" Jul 07 15:11:47.776102 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:47.776070 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:11:55.594843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:55.594802 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:55.595494 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:55.594871 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:55.607328 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:55.607303 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:55.825127 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:55.825095 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl" Jul 07 15:11:59.599909 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:11:59.599868 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:12:44.461435 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:12:44.461389 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:16.485142 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.485105 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67ff9cf867-lj6vp"] Jul 07 15:13:16.488447 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.488421 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67ff9cf867-lj6vp" Jul 07 15:13:16.492317 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.492297 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-66xr8\"" Jul 07 15:13:16.492317 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.492304 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 07 15:13:16.497412 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.497385 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67ff9cf867-lj6vp"] Jul 07 15:13:16.625294 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.625262 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxlhn\" (UniqueName: \"kubernetes.io/projected/3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb-kube-api-access-zxlhn\") pod \"authorino-67ff9cf867-lj6vp\" (UID: \"3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb\") " pod="kuadrant-system/authorino-67ff9cf867-lj6vp" Jul 07 15:13:16.625490 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.625399 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb-tls-cert\") pod \"authorino-67ff9cf867-lj6vp\" (UID: \"3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb\") " pod="kuadrant-system/authorino-67ff9cf867-lj6vp" Jul 07 15:13:16.726018 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.725961 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb-tls-cert\") pod \"authorino-67ff9cf867-lj6vp\" (UID: \"3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb\") " pod="kuadrant-system/authorino-67ff9cf867-lj6vp" Jul 07 15:13:16.726207 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.726068 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxlhn\" (UniqueName: \"kubernetes.io/projected/3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb-kube-api-access-zxlhn\") pod \"authorino-67ff9cf867-lj6vp\" (UID: \"3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb\") " pod="kuadrant-system/authorino-67ff9cf867-lj6vp" Jul 07 15:13:16.728269 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.728245 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb-tls-cert\") pod \"authorino-67ff9cf867-lj6vp\" (UID: \"3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb\") " pod="kuadrant-system/authorino-67ff9cf867-lj6vp" Jul 07 15:13:16.736668 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.736605 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxlhn\" (UniqueName: \"kubernetes.io/projected/3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb-kube-api-access-zxlhn\") pod \"authorino-67ff9cf867-lj6vp\" (UID: \"3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb\") " pod="kuadrant-system/authorino-67ff9cf867-lj6vp" Jul 07 15:13:16.786701 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.786662 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:16.798886 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.798859 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67ff9cf867-lj6vp" Jul 07 15:13:16.884097 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.884063 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:16.935101 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:16.935057 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67ff9cf867-lj6vp"] Jul 07 15:13:16.937311 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:13:16.937278 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ecc9daf_cf91_4fcd_9f9b_d6ec5d229fbb.slice/crio-729e46a02172fa0b1883a1a01fef51509e6a929f800b0068bfdd5ed531495d72 WatchSource:0}: Error finding container 729e46a02172fa0b1883a1a01fef51509e6a929f800b0068bfdd5ed531495d72: Status 404 returned error can't find the container with id 729e46a02172fa0b1883a1a01fef51509e6a929f800b0068bfdd5ed531495d72 Jul 07 15:13:17.156580 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:17.156544 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67ff9cf867-lj6vp" event={"ID":"3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb","Type":"ContainerStarted","Data":"729e46a02172fa0b1883a1a01fef51509e6a929f800b0068bfdd5ed531495d72"} Jul 07 15:13:17.979689 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:17.979658 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:18.087425 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:18.087386 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:13:18.163537 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:18.163504 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67ff9cf867-lj6vp" event={"ID":"3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb","Type":"ContainerStarted","Data":"5760734059de95ab51131df50ae12fa2e78bf59950f887d88a45852d17a75fc0"} Jul 07 15:13:18.187817 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:18.187760 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67ff9cf867-lj6vp" podStartSLOduration=1.792255161 podStartE2EDuration="2.187742723s" totalImagesPullingTime="395.487562ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:13:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:13:18.186220565 +0000 UTC m=+741.661057316" watchObservedRunningTime="2026-07-07 15:13:18.187742723 +0000 UTC m=+741.662579472" Jul 07 15:13:46.381474 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:46.381433 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:13:55.685347 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:13:55.685312 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:14:07.284821 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:14:07.284784 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:14:13.881993 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:14:13.881942 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:14:22.992758 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:14:22.992677 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:14:28.870711 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:14:28.870673 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:30.679713 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:14:30.679678 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:14:30.709283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:14:30.709254 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:14:54.878321 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:14:54.878286 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:15:07.282160 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:07.282131 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:15:11.614899 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:11.614866 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:11.719020 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:11.718962 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:11.836342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:11.836312 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:17.794654 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:17.794616 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:17.897139 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:17.897107 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:17.996638 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:17.996599 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:18.107854 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:18.107815 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:18.203095 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:18.203055 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:24.383501 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:24.383471 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:24.445568 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:24.445542 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:15:41.378567 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:41.378529 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:15:51.169632 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:51.169552 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:15:59.513559 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:15:59.513518 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:16:08.479526 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:16:08.479489 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:16:18.682270 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:16:18.682228 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:16:26.012851 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:16:26.012821 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:16:27.838500 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:16:27.838468 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:16:28.586848 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:16:28.586814 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:16:40.275477 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:16:40.275434 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:16:49.977497 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:16:49.977461 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:16:52.659703 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:16:52.659668 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:17:12.391431 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:17:12.386472 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:17:24.779589 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:17:24.779508 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:17:47.779802 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:17:47.779769 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:18:00.284645 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:18:00.284606 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:18:15.283623 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:18:15.283590 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:18:19.775887 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:18:19.775851 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:18:24.790239 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:18:24.790198 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:18:33.893324 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:18:33.893282 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:18:44.682576 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:18:44.682543 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:18:54.500641 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:18:54.500553 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:20:11.213356 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:20:11.213319 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:20:44.298782 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:20:44.298745 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:20:55.691807 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:20:55.691761 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:21:03.409611 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:21:03.409575 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:21:14.887239 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:21:14.887204 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:21:25.000108 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:21:25.000072 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:21:35.186824 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:21:35.186784 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:21:42.686379 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:21:42.686343 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:21:51.991131 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:21:51.991048 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:22:00.983112 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:22:00.983077 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:22:11.625701 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:22:11.625660 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:22:18.988843 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:22:18.988806 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:22:30.479736 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:22:30.479692 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:22:33.601799 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:22:33.601768 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:22:51.891131 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:22:51.891092 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:23:01.135316 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:23:01.135273 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:23:10.084025 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:23:10.083984 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:23:21.283011 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:23:21.282886 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:23:37.585533 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:23:37.585501 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:23:48.382245 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:23:48.382208 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:23:57.187212 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:23:57.187178 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:24:07.888877 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:24:07.888837 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:24:16.481116 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:24:16.481077 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:24:25.716093 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:24:25.716058 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:24:38.188472 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:24:38.188437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:24:48.784058 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:24:48.783963 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:24:57.977816 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:24:57.977778 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:25:06.943507 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:25:06.943473 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:25:07.004603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:25:07.004571 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:25:09.886983 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:25:09.886930 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:25:21.681468 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:25:21.681430 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:25:29.385776 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:25:29.385741 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:25:38.597828 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:25:38.597789 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:25:47.986626 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:25:47.986583 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:25:55.802354 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:25:55.802312 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:26:05.080323 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:05.080282 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:26:11.218735 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:11.218701 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:11.333170 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:11.333134 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:17.193784 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:17.193745 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:17.270519 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:17.270485 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:17.531353 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:17.531322 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:17.635552 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:17.635521 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:18.692073 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:18.692000 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:18.806650 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:18.806618 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:18.906290 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:18.906256 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:19.269338 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:19.269307 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:19.441354 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:19.441321 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:19.542585 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:19.542507 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:21.107429 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:21.107395 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:26:21.299285 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:21.299259 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:23.785661 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:23.785630 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:23.958757 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:23.958727 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:24.087156 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:24.087121 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:24.364612 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:24.364522 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:25.668902 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:25.668875 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:30.355708 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:30.355673 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:30.422292 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:30.422251 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:30.604213 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:30.604181 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:30.699181 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:30.699070 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:31.707346 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:31.707308 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:31.811846 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:31.811808 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:31.982224 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:31.982113 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:32.414280 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:32.414248 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:26:32.444040 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:32.444011 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:32.689748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:32.689663 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:32.793950 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:32.793902 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:33.824104 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:33.824074 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:36.927545 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:36.927509 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:37.457697 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:37.457667 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:43.145590 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:43.145556 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:43.245571 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:43.245538 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:45.052665 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:45.052634 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:49.799812 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:49.799780 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:49.863671 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:49.863639 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:50.056487 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:50.056405 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:50.136123 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:50.136072 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:51.180255 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:51.180217 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:51.274062 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:51.274025 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:51.375456 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:51.375428 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:51.626126 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:51.626081 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:52.150486 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:52.150445 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:52.249367 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:52.249334 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:53.426413 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:53.426383 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:54.093344 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:54.093312 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:26:55.672548 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:55.672491 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:55.860369 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:55.860337 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:55.974722 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:55.974631 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:56.244995 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:56.244897 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:26:58.073244 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:26:58.073214 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:02.656848 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:02.656808 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:02.758626 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:02.758591 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:03.163626 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:03.163592 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:03.259853 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:03.259820 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:03.366202 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:03.366170 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:04.031394 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:04.031357 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:27:04.960297 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:04.960261 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:11.846261 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:11.846227 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:11.954592 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:11.954556 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:12.068426 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:12.068384 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:12.161067 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:12.160953 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:12.643342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:12.643299 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:38.705951 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:38.705918 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:45.715179 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:45.715137 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:45.781045 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:45.781008 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:45.868662 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:45.868614 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:45.967232 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:45.967133 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:27:50.978631 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:27:50.978538 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:01.948098 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:01.948060 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:08.364231 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:08.364181 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:08.465862 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:08.465831 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:08.591820 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:08.591787 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:19.429277 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:19.429239 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:20.123015 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:20.122981 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:26.656579 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:26.656530 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:26.750021 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:26.749959 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:26.849565 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:26.849522 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:26.950229 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:26.950127 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:27.866838 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:27.866808 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:27.963398 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:27.963362 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:28.065000 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:28.064947 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:29.127855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:29.127822 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:28:29.873286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:29.873252 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:35.996378 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:35.996343 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:36.098297 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:36.098262 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:36.689469 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:36.689437 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:28:36.797300 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:36.797269 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:43.146794 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:43.146754 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:43.209446 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:43.209415 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:43.469360 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:43.469276 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:43.771310 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:43.771228 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:44.090727 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:44.090695 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:28:44.108578 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:44.108549 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:46.607691 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:46.607655 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:46.698757 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:46.698731 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:46.774359 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:46.774328 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:47.036337 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:47.036256 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:47.662059 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:47.662027 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:47.756883 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:47.756851 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:51.184349 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:51.184306 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:51.946084 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:51.946055 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:52.037741 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:52.037695 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:52.284919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:52.284836 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:28:52.385127 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:52.385071 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:58.656918 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:58.656879 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:58.751697 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:58.751664 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:59.315840 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:59.315804 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:59.733706 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:59.733609 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:28:59.954559 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:28:59.954525 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:06.087309 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:06.087264 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:29:06.511807 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:06.511696 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:06.608778 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:06.608746 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:06.790540 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:06.790448 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:07.021303 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:07.021271 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:07.182142 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:07.182105 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:07.276214 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:07.276167 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:07.384443 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:07.384407 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:14.029760 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:14.029710 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:14.134407 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:14.134373 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:14.232087 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:14.232052 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:14.437872 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:14.437841 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:20.847620 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:20.847520 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:20.923402 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:20.923370 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:27.937640 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:27.937606 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:28.266923 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:28.266822 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:28.519695 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:28.519594 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:31.803663 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:31.803633 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:31.897416 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:31.897384 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:31.980556 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:31.980516 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:32.077532 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:32.077477 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:32.483418 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:32.483340 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:32.582619 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:32.582580 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:36.322837 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:36.322808 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:38.185692 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:38.185655 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:29:43.137346 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:43.137317 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:49.505775 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:49.505740 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:29:53.615768 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:53.615737 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:53.716643 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:53.716612 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:54.418636 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:54.418601 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:29:54.519678 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:29:54.519645 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:06.416668 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:06.416632 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:30:08.856294 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:08.856263 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:09.339687 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:09.339652 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:15.045305 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:15.045277 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:19.011811 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:19.011776 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:30:20.091801 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:20.091766 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:36.534311 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:36.534275 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:56.157410 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:56.157368 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:57.436128 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:57.436095 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:30:59.714127 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:30:59.714086 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:31:03.675565 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:03.675525 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:03.760009 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:03.759955 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:04.046857 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:04.046775 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:04.334782 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:04.334747 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:05.435106 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:05.435069 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:05.525606 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:05.525572 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:05.625454 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:05.625423 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:06.467171 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:06.467135 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:06.574571 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:06.574540 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:06.674404 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:06.674358 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:08.272067 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:08.272022 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:14.715117 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:14.715086 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:14.829764 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:14.829733 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:15.298990 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:15.298948 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:31:15.497306 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:15.497274 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:21.774744 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:21.774704 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:21.861733 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:21.861698 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:21.946335 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:21.946301 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:22.060442 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:22.060352 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:23.175295 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:23.175253 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:31:32.670685 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:32.670635 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:33.027240 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:33.027146 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:54.100600 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:54.100555 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:31:59.172000 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:31:59.171937 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:00.689702 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:00.689671 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:00.753212 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:00.753176 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:01.075241 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:01.075210 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:01.491601 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:01.491515 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:01.653768 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:01.653741 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:04.653703 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:04.653670 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:04.754559 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:04.754526 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:04.875319 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:04.875289 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:05.204686 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:05.204651 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:05.489133 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:05.489055 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:05.582674 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:05.582640 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:09.242815 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:09.242781 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:09.595172 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:09.595135 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:09.978710 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:09.978623 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:10.096807 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:10.096781 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:11.785263 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:11.785228 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:32:13.457639 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:13.457610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:13.555257 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:13.555222 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:13.770042 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:13.769935 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:13.964891 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:13.964854 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:14.318688 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:14.318648 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:14.414774 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:14.414741 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:17.984676 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:17.984643 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:25.389687 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:25.389649 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:32:26.078935 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.078898 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs"] Jul 07 15:32:26.082898 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.082873 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.086829 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.086808 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ac6910\"/\"test-model-ac6910-kserve-self-signed-certs\"" Jul 07 15:32:26.087890 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.087863 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ac6910\"/\"kube-root-ca.crt\"" Jul 07 15:32:26.088050 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.087863 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-ac6910\"/\"default-dockercfg-txqvc\"" Jul 07 15:32:26.088050 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.087908 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-ac6910\"/\"openshift-service-ca.crt\"" Jul 07 15:32:26.092604 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.092568 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs"] Jul 07 15:32:26.115526 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.115497 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:26.212238 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.212207 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-tmp-dir\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.212407 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.212246 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/008d605b-4298-4107-a62f-1f87db9b2f49-tls-certs\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.212407 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.212285 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsfl7\" (UniqueName: \"kubernetes.io/projected/008d605b-4298-4107-a62f-1f87db9b2f49-kube-api-access-hsfl7\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.212407 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.212309 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-home\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.212407 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.212328 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-model-cache\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.212607 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.212466 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-dshm\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.313786 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.313745 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-dshm\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.314006 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.313821 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-tmp-dir\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.314006 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.313852 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/008d605b-4298-4107-a62f-1f87db9b2f49-tls-certs\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.314006 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.313881 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsfl7\" (UniqueName: \"kubernetes.io/projected/008d605b-4298-4107-a62f-1f87db9b2f49-kube-api-access-hsfl7\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.314006 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.313907 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-home\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.314006 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.313930 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-model-cache\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.314348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.314321 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-tmp-dir\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.314413 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.314331 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-home\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.314413 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.314373 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-model-cache\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.316047 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.316029 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-dshm\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.316299 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.316281 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/008d605b-4298-4107-a62f-1f87db9b2f49-tls-certs\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.324097 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.324074 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsfl7\" (UniqueName: \"kubernetes.io/projected/008d605b-4298-4107-a62f-1f87db9b2f49-kube-api-access-hsfl7\") pod \"test-model-ac6910-kserve-8489bd595c-852gs\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.392902 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.392809 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:26.525986 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:26.525938 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs"] Jul 07 15:32:26.529279 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:32:26.529246 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod008d605b_4298_4107_a62f_1f87db9b2f49.slice/crio-ce01db2c10c26c9c1735e481bbc9b3c362d93de57dae8cc2a3554eb75ff64684 WatchSource:0}: Error finding container ce01db2c10c26c9c1735e481bbc9b3c362d93de57dae8cc2a3554eb75ff64684: Status 404 returned error can't find the container with id ce01db2c10c26c9c1735e481bbc9b3c362d93de57dae8cc2a3554eb75ff64684 Jul 07 15:32:27.210906 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:27.210867 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" event={"ID":"008d605b-4298-4107-a62f-1f87db9b2f49","Type":"ContainerStarted","Data":"fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872"} Jul 07 15:32:27.211115 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:27.210916 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" event={"ID":"008d605b-4298-4107-a62f-1f87db9b2f49","Type":"ContainerStarted","Data":"ce01db2c10c26c9c1735e481bbc9b3c362d93de57dae8cc2a3554eb75ff64684"} Jul 07 15:32:27.249280 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:27.249230 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" podStartSLOduration=1.249213949 podStartE2EDuration="1.249213949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:32:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:32:27.248440064 +0000 UTC m=+1890.723276814" watchObservedRunningTime="2026-07-07 15:32:27.249213949 +0000 UTC m=+1890.724050749" Jul 07 15:32:27.274527 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:27.274496 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:27.388920 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:27.388888 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:34.887011 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:34.886962 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:32:36.240631 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:36.240593 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:36.338670 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:36.338637 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:36.393725 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:36.393685 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:36.393725 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:36.393734 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:36.405885 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:36.405856 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:37.268832 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:37.268797 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:32:47.986637 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:47.986604 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5"] Jul 07 15:32:47.990059 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:47.990041 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:47.993228 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:47.993207 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-44430f\"/\"openshift-service-ca.crt\"" Jul 07 15:32:47.994281 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:47.994257 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-44430f\"/\"default-dockercfg-ljnmj\"" Jul 07 15:32:47.994411 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:47.994298 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-44430f\"/\"test-model-44430f-kserve-self-signed-certs\"" Jul 07 15:32:47.994484 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:47.994410 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-44430f\"/\"kube-root-ca.crt\"" Jul 07 15:32:48.002024 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.001997 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5"] Jul 07 15:32:48.013868 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.013830 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tls-certs\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.014055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.013911 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tmp-dir\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.014055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.013941 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55bhk\" (UniqueName: \"kubernetes.io/projected/7a1055c2-355c-4d00-8f72-fde0b9617a4e-kube-api-access-55bhk\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.014055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.013991 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-home\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.014055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.014036 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-dshm\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.014274 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.014062 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-model-cache\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.018461 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.018437 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:48.115162 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115110 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tls-certs\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.115342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115194 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tmp-dir\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.115342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115224 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55bhk\" (UniqueName: \"kubernetes.io/projected/7a1055c2-355c-4d00-8f72-fde0b9617a4e-kube-api-access-55bhk\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.115342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115255 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-home\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.115342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115301 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-dshm\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.115342 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115330 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-model-cache\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.115716 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115688 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tmp-dir\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.115810 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115703 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-home\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.115810 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.115729 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-model-cache\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.117530 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.117508 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-dshm\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.117735 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.117717 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tls-certs\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.127715 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.127687 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55bhk\" (UniqueName: \"kubernetes.io/projected/7a1055c2-355c-4d00-8f72-fde0b9617a4e-kube-api-access-55bhk\") pod \"test-model-44430f-kserve-7b9769f655-gpxg5\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.300408 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.300328 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:48.436556 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:48.436517 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5"] Jul 07 15:32:48.439953 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:32:48.439927 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a1055c2_355c_4d00_8f72_fde0b9617a4e.slice/crio-26143a5b9d8f8631b3850591d0f62e21d8c06ef7d1f4f3cb1d2c8f921d42656d WatchSource:0}: Error finding container 26143a5b9d8f8631b3850591d0f62e21d8c06ef7d1f4f3cb1d2c8f921d42656d: Status 404 returned error can't find the container with id 26143a5b9d8f8631b3850591d0f62e21d8c06ef7d1f4f3cb1d2c8f921d42656d Jul 07 15:32:49.311047 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:49.311006 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" event={"ID":"7a1055c2-355c-4d00-8f72-fde0b9617a4e","Type":"ContainerStarted","Data":"04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0"} Jul 07 15:32:49.311526 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:49.311058 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" event={"ID":"7a1055c2-355c-4d00-8f72-fde0b9617a4e","Type":"ContainerStarted","Data":"26143a5b9d8f8631b3850591d0f62e21d8c06ef7d1f4f3cb1d2c8f921d42656d"} Jul 07 15:32:49.335597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:49.335545 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" podStartSLOduration=2.335529114 podStartE2EDuration="2.335529114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:32:49.335405972 +0000 UTC m=+1912.810242724" watchObservedRunningTime="2026-07-07 15:32:49.335529114 +0000 UTC m=+1912.810365862" Jul 07 15:32:49.580531 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:49.580441 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:32:51.802223 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:51.802186 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:32:58.300873 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:58.300827 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:58.301309 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:58.300890 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:58.313939 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:58.313910 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:32:58.362817 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:32:58.362789 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:33:04.994134 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:04.994097 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:33:17.005307 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:17.005274 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs"] Jul 07 15:33:17.036376 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:17.036343 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:18.121061 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:18.121020 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5"] Jul 07 15:33:18.149637 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:18.149603 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:18.364078 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:18.364044 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:18.750531 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:18.750502 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:18.943254 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:18.943223 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:19.043452 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:19.043363 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:19.233642 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:19.233610 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:22.781860 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:22.781827 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:33:23.818714 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:23.818680 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:32.024924 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.024881 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" podUID="008d605b-4298-4107-a62f-1f87db9b2f49" containerName="main" containerID="cri-o://fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872" gracePeriod=45 Jul 07 15:33:32.050453 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.050426 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:32.113286 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.113231 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:33:32.268010 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.267985 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:33:32.410853 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.410814 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsfl7\" (UniqueName: \"kubernetes.io/projected/008d605b-4298-4107-a62f-1f87db9b2f49-kube-api-access-hsfl7\") pod \"008d605b-4298-4107-a62f-1f87db9b2f49\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " Jul 07 15:33:32.411050 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.410889 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-tmp-dir\") pod \"008d605b-4298-4107-a62f-1f87db9b2f49\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " Jul 07 15:33:32.411050 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411010 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-home\") pod \"008d605b-4298-4107-a62f-1f87db9b2f49\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " Jul 07 15:33:32.411144 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411050 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-model-cache\") pod \"008d605b-4298-4107-a62f-1f87db9b2f49\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " Jul 07 15:33:32.411144 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411067 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-dshm\") pod \"008d605b-4298-4107-a62f-1f87db9b2f49\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " Jul 07 15:33:32.411235 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411141 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/008d605b-4298-4107-a62f-1f87db9b2f49-tls-certs\") pod \"008d605b-4298-4107-a62f-1f87db9b2f49\" (UID: \"008d605b-4298-4107-a62f-1f87db9b2f49\") " Jul 07 15:33:32.411235 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411147 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "008d605b-4298-4107-a62f-1f87db9b2f49" (UID: "008d605b-4298-4107-a62f-1f87db9b2f49"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:33:32.411315 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411248 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-home" (OuterVolumeSpecName: "home") pod "008d605b-4298-4107-a62f-1f87db9b2f49" (UID: "008d605b-4298-4107-a62f-1f87db9b2f49"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:33:32.411356 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411307 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-model-cache" (OuterVolumeSpecName: "model-cache") pod "008d605b-4298-4107-a62f-1f87db9b2f49" (UID: "008d605b-4298-4107-a62f-1f87db9b2f49"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:33:32.411480 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411458 2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-tmp-dir\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:32.411480 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411476 2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-home\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:32.411645 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.411487 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-model-cache\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:32.413190 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.413160 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/008d605b-4298-4107-a62f-1f87db9b2f49-kube-api-access-hsfl7" (OuterVolumeSpecName: "kube-api-access-hsfl7") pod "008d605b-4298-4107-a62f-1f87db9b2f49" (UID: "008d605b-4298-4107-a62f-1f87db9b2f49"). InnerVolumeSpecName "kube-api-access-hsfl7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:33:32.413277 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.413205 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/008d605b-4298-4107-a62f-1f87db9b2f49-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "008d605b-4298-4107-a62f-1f87db9b2f49" (UID: "008d605b-4298-4107-a62f-1f87db9b2f49"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:33:32.413317 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.413272 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-dshm" (OuterVolumeSpecName: "dshm") pod "008d605b-4298-4107-a62f-1f87db9b2f49" (UID: "008d605b-4298-4107-a62f-1f87db9b2f49"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:33:32.498430 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.498394 2580 generic.go:356] "Generic (PLEG): container finished" podID="008d605b-4298-4107-a62f-1f87db9b2f49" containerID="fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872" exitCode=0 Jul 07 15:33:32.498596 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.498442 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" Jul 07 15:33:32.498596 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.498439 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" event={"ID":"008d605b-4298-4107-a62f-1f87db9b2f49","Type":"ContainerDied","Data":"fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872"} Jul 07 15:33:32.498596 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.498541 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs" event={"ID":"008d605b-4298-4107-a62f-1f87db9b2f49","Type":"ContainerDied","Data":"ce01db2c10c26c9c1735e481bbc9b3c362d93de57dae8cc2a3554eb75ff64684"} Jul 07 15:33:32.498596 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.498563 2580 scope.go:117] "RemoveContainer" containerID="fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872" Jul 07 15:33:32.508079 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.508060 2580 scope.go:117] "RemoveContainer" containerID="fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872" Jul 07 15:33:32.508327 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:33:32.508305 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872\": container with ID starting with fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872 not found: ID does not exist" containerID="fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872" Jul 07 15:33:32.508420 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.508334 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872"} err="failed to get container status \"fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872\": rpc error: code = NotFound desc = could not find container \"fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872\": container with ID starting with fdb3424aac091377283fe4372cef0314e949121ce5dcedd1d3f6169c7077b872 not found: ID does not exist" Jul 07 15:33:32.512348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.512327 2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/008d605b-4298-4107-a62f-1f87db9b2f49-dshm\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:32.512348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.512348 2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/008d605b-4298-4107-a62f-1f87db9b2f49-tls-certs\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:32.512494 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.512360 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsfl7\" (UniqueName: \"kubernetes.io/projected/008d605b-4298-4107-a62f-1f87db9b2f49-kube-api-access-hsfl7\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:32.524783 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.524749 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs"] Jul 07 15:33:32.526590 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:32.526566 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-ac6910/test-model-ac6910-kserve-8489bd595c-852gs"] Jul 07 15:33:33.098732 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.098699 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="008d605b-4298-4107-a62f-1f87db9b2f49" path="/var/lib/kubelet/pods/008d605b-4298-4107-a62f-1f87db9b2f49/volumes" Jul 07 15:33:33.140869 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.140825 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" podUID="7a1055c2-355c-4d00-8f72-fde0b9617a4e" containerName="main" containerID="cri-o://04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0" gracePeriod=45 Jul 07 15:33:33.387894 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.387870 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:33:33.504162 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.504128 2580 generic.go:356] "Generic (PLEG): container finished" podID="7a1055c2-355c-4d00-8f72-fde0b9617a4e" containerID="04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0" exitCode=0 Jul 07 15:33:33.504348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.504172 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" Jul 07 15:33:33.504348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.504213 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" event={"ID":"7a1055c2-355c-4d00-8f72-fde0b9617a4e","Type":"ContainerDied","Data":"04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0"} Jul 07 15:33:33.504348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.504250 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5" event={"ID":"7a1055c2-355c-4d00-8f72-fde0b9617a4e","Type":"ContainerDied","Data":"26143a5b9d8f8631b3850591d0f62e21d8c06ef7d1f4f3cb1d2c8f921d42656d"} Jul 07 15:33:33.504348 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.504273 2580 scope.go:117] "RemoveContainer" containerID="04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0" Jul 07 15:33:33.512200 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.512181 2580 scope.go:117] "RemoveContainer" containerID="04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0" Jul 07 15:33:33.512444 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:33:33.512425 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0\": container with ID starting with 04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0 not found: ID does not exist" containerID="04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0" Jul 07 15:33:33.512502 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.512453 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0"} err="failed to get container status \"04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0\": rpc error: code = NotFound desc = could not find container \"04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0\": container with ID starting with 04b0f7bfdbad160bf561c8463675396cc48e3f12a9fb72765f3809cf0e8521f0 not found: ID does not exist" Jul 07 15:33:33.521719 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.521696 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-home\") pod \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " Jul 07 15:33:33.521825 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.521747 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55bhk\" (UniqueName: \"kubernetes.io/projected/7a1055c2-355c-4d00-8f72-fde0b9617a4e-kube-api-access-55bhk\") pod \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " Jul 07 15:33:33.521825 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.521769 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-dshm\") pod \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " Jul 07 15:33:33.521825 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.521797 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tls-certs\") pod \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " Jul 07 15:33:33.521990 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.521913 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tmp-dir\") pod \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " Jul 07 15:33:33.521990 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.521944 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-model-cache\") pod \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\" (UID: \"7a1055c2-355c-4d00-8f72-fde0b9617a4e\") " Jul 07 15:33:33.521990 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.521946 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-home" (OuterVolumeSpecName: "home") pod "7a1055c2-355c-4d00-8f72-fde0b9617a4e" (UID: "7a1055c2-355c-4d00-8f72-fde0b9617a4e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:33:33.522262 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.522234 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7a1055c2-355c-4d00-8f72-fde0b9617a4e" (UID: "7a1055c2-355c-4d00-8f72-fde0b9617a4e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:33:33.522262 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.522253 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-model-cache" (OuterVolumeSpecName: "model-cache") pod "7a1055c2-355c-4d00-8f72-fde0b9617a4e" (UID: "7a1055c2-355c-4d00-8f72-fde0b9617a4e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:33:33.522391 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.522242 2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-home\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:33.524012 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.523987 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-dshm" (OuterVolumeSpecName: "dshm") pod "7a1055c2-355c-4d00-8f72-fde0b9617a4e" (UID: "7a1055c2-355c-4d00-8f72-fde0b9617a4e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:33:33.524103 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.524007 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a1055c2-355c-4d00-8f72-fde0b9617a4e-kube-api-access-55bhk" (OuterVolumeSpecName: "kube-api-access-55bhk") pod "7a1055c2-355c-4d00-8f72-fde0b9617a4e" (UID: "7a1055c2-355c-4d00-8f72-fde0b9617a4e"). InnerVolumeSpecName "kube-api-access-55bhk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:33:33.524103 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.524024 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7a1055c2-355c-4d00-8f72-fde0b9617a4e" (UID: "7a1055c2-355c-4d00-8f72-fde0b9617a4e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:33:33.623489 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.623400 2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tmp-dir\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:33.623489 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.623428 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-model-cache\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:33.623489 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.623438 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55bhk\" (UniqueName: \"kubernetes.io/projected/7a1055c2-355c-4d00-8f72-fde0b9617a4e-kube-api-access-55bhk\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:33.623489 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.623446 2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a1055c2-355c-4d00-8f72-fde0b9617a4e-dshm\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:33.623489 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.623454 2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a1055c2-355c-4d00-8f72-fde0b9617a4e-tls-certs\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:33:33.827003 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.826958 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5"] Jul 07 15:33:33.831303 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:33.831280 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-44430f/test-model-44430f-kserve-7b9769f655-gpxg5"] Jul 07 15:33:35.098744 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:33:35.098713 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a1055c2-355c-4d00-8f72-fde0b9617a4e" path="/var/lib/kubelet/pods/7a1055c2-355c-4d00-8f72-fde0b9617a4e/volumes" Jul 07 15:34:01.662678 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:01.662644 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:01.763325 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:01.763291 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:01.979443 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:01.979357 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:02.171687 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:02.171649 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:02.644340 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:02.644305 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:02.764637 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:02.764607 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:02.859210 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:02.859178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:03.074785 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:03.074750 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:05.501520 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:05.501484 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:34:09.382786 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:09.382747 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:09.445593 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:09.445561 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:09.714657 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:09.714573 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:09.949444 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:09.949402 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:10.329716 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:10.329686 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:10.678060 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:10.677958 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:10.786230 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:10.786198 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:13.407824 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:13.407787 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:13.490175 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:13.490145 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:13.585259 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:13.585191 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:13.916337 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:13.916306 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:14.135666 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:14.135608 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:14.238157 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:14.238068 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:17.961031 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:17.960997 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:18.521150 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:18.521120 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:18.904622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:18.904580 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:19.132376 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:19.132338 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:20.287257 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:20.287222 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:34:22.197122 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:22.197089 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:22.292268 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:22.292238 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:22.385283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:22.385245 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:22.940457 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:22.940426 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:23.041730 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:23.041693 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:26.750744 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:26.750711 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:33.984667 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:33.984628 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:34:35.466232 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:35.466199 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:35.876098 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:35.876065 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:35.974644 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:35.974611 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:36.329117 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:36.329083 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:36.638223 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:36.638136 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:42.206126 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:42.206074 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:42.307016 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:42.306966 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:42.470203 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:42.470121 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:42.737035 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:42.736926 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:43.061598 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:43.061570 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:43.384643 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:43.384557 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:43.483591 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:43.483550 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:43.682589 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:43.682510 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:46.481805 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:46.481767 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:34:49.766106 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:49.766060 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:49.866558 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:49.866530 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:50.064619 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:50.064593 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:50.323401 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:50.323322 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:50.723537 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:50.723446 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:51.058442 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:51.058365 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:51.125009 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:51.124965 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:53.641635 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:53.641603 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:53.728085 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:53.728057 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:53.799163 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:53.799129 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:54.295018 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:54.294965 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:54.421671 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:54.421638 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:54.510832 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:54.510804 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:56.269470 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:56.269439 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:56.388419 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:56.388385 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:58.252120 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:58.252088 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:58.685330 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:58.685303 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:59.038151 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:59.038062 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:59.402449 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:59.402399 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:34:59.691465 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:34:59.691385 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:35:01.898866 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:01.898831 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:01.991040 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:01.991001 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:02.093632 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:02.093597 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:02.195330 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:02.195250 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:02.888482 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:02.888450 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:02.988296 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:02.988267 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:06.432669 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:06.432616 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:13.858570 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:13.858500 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:13.959722 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:13.959689 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:15.377737 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:15.377708 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:35:16.345055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:16.345015 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:16.441532 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:16.441499 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:24.063678 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:24.063601 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:24.167482 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:24.167449 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:42.285130 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.285096 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6"] Jul 07 15:35:42.285698 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.285425 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a1055c2-355c-4d00-8f72-fde0b9617a4e" containerName="main" Jul 07 15:35:42.285698 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.285436 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a1055c2-355c-4d00-8f72-fde0b9617a4e" containerName="main" Jul 07 15:35:42.285698 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.285459 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="008d605b-4298-4107-a62f-1f87db9b2f49" containerName="main" Jul 07 15:35:42.285698 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.285464 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="008d605b-4298-4107-a62f-1f87db9b2f49" containerName="main" Jul 07 15:35:42.285698 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.285513 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a1055c2-355c-4d00-8f72-fde0b9617a4e" containerName="main" Jul 07 15:35:42.285698 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.285523 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="008d605b-4298-4107-a62f-1f87db9b2f49" containerName="main" Jul 07 15:35:42.288361 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.288345 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.292457 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.292435 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8f5391\"/\"auth-test-model-8f5391-kserve-self-signed-certs\"" Jul 07 15:35:42.292597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.292438 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8f5391\"/\"kube-root-ca.crt\"" Jul 07 15:35:42.292597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.292444 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8f5391\"/\"default-dockercfg-k9f9m\"" Jul 07 15:35:42.292597 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.292561 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8f5391\"/\"openshift-service-ca.crt\"" Jul 07 15:35:42.298619 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.298600 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6"] Jul 07 15:35:42.328624 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.328596 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:35:42.374374 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.374331 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-home\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.374374 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.374372 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-model-cache\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.374590 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.374396 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-dshm\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.374590 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.374455 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2nsr\" (UniqueName: \"kubernetes.io/projected/072eb826-79d2-43c9-b50d-f8ed1aaa042d-kube-api-access-w2nsr\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.374590 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.374495 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tls-certs\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.374590 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.374533 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tmp-dir\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.475375 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475328 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-home\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.475375 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475372 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-model-cache\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.475631 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475399 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-dshm\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.475631 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475427 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2nsr\" (UniqueName: \"kubernetes.io/projected/072eb826-79d2-43c9-b50d-f8ed1aaa042d-kube-api-access-w2nsr\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.475631 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475459 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tls-certs\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.475631 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475507 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tmp-dir\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.475861 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475823 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-model-cache\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.476016 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475876 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-home\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.476016 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.475927 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tmp-dir\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.477761 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.477743 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-dshm\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.477913 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.477896 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tls-certs\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.485542 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.485512 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2nsr\" (UniqueName: \"kubernetes.io/projected/072eb826-79d2-43c9-b50d-f8ed1aaa042d-kube-api-access-w2nsr\") pod \"auth-test-model-8f5391-kserve-566465bbdc-nn5n6\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.597169 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.597136 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:42.729056 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:42.729027 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6"] Jul 07 15:35:42.731179 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:35:42.731154 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod072eb826_79d2_43c9_b50d_f8ed1aaa042d.slice/crio-625a6dc5b764fbb3271f2ec104f4e736827e0a3459b9f7c9803cdf1df9136d69 WatchSource:0}: Error finding container 625a6dc5b764fbb3271f2ec104f4e736827e0a3459b9f7c9803cdf1df9136d69: Status 404 returned error can't find the container with id 625a6dc5b764fbb3271f2ec104f4e736827e0a3459b9f7c9803cdf1df9136d69 Jul 07 15:35:43.076105 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:43.076048 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" event={"ID":"072eb826-79d2-43c9-b50d-f8ed1aaa042d","Type":"ContainerStarted","Data":"cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5"} Jul 07 15:35:43.076296 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:43.076119 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" event={"ID":"072eb826-79d2-43c9-b50d-f8ed1aaa042d","Type":"ContainerStarted","Data":"625a6dc5b764fbb3271f2ec104f4e736827e0a3459b9f7c9803cdf1df9136d69"} Jul 07 15:35:43.097661 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:43.097609 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" podStartSLOduration=1.097592961 podStartE2EDuration="1.097592961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:35:43.096417036 +0000 UTC m=+2086.571253811" watchObservedRunningTime="2026-07-07 15:35:43.097592961 +0000 UTC m=+2086.572429709" Jul 07 15:35:45.777793 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:45.777760 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:35:52.597506 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:52.597461 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:52.597506 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:52.597518 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:52.609775 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:52.609744 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:35:53.134115 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:35:53.133496 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:36:01.690704 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.690669 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x"] Jul 07 15:36:01.693839 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.693820 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.698199 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.698172 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-600c1d\"/\"openshift-service-ca.crt\"" Jul 07 15:36:01.698199 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.698190 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-600c1d\"/\"auth-test-model-600c1d-kserve-self-signed-certs\"" Jul 07 15:36:01.698418 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.698239 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-600c1d\"/\"kube-root-ca.crt\"" Jul 07 15:36:01.698418 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.698193 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-600c1d\"/\"default-dockercfg-nblnj\"" Jul 07 15:36:01.708234 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.708208 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x"] Jul 07 15:36:01.716755 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.716720 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:36:01.733372 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.733336 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a94e0dca-7715-4d36-8901-f1ea9c89881c-tls-certs\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.733528 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.733412 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-home\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.733528 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.733442 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h74x2\" (UniqueName: \"kubernetes.io/projected/a94e0dca-7715-4d36-8901-f1ea9c89881c-kube-api-access-h74x2\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.733528 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.733514 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-tmp-dir\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.733793 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.733557 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-dshm\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.733793 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.733575 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-model-cache\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834392 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834353 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-dshm\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834392 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834391 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-model-cache\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834649 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834431 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a94e0dca-7715-4d36-8901-f1ea9c89881c-tls-certs\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834649 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834479 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-home\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834649 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834497 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h74x2\" (UniqueName: \"kubernetes.io/projected/a94e0dca-7715-4d36-8901-f1ea9c89881c-kube-api-access-h74x2\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834649 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834525 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-tmp-dir\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834848 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834777 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-model-cache\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834906 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834872 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-home\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.834944 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.834922 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-tmp-dir\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.836897 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.836871 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-dshm\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.837098 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.837083 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a94e0dca-7715-4d36-8901-f1ea9c89881c-tls-certs\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:01.844398 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:01.844372 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h74x2\" (UniqueName: \"kubernetes.io/projected/a94e0dca-7715-4d36-8901-f1ea9c89881c-kube-api-access-h74x2\") pod \"auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:02.002736 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:02.002623 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:02.142251 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:02.142224 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x"] Jul 07 15:36:02.144545 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:36:02.144507 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda94e0dca_7715_4d36_8901_f1ea9c89881c.slice/crio-f5c3644877a30b260e89ca2f5ccd5a8fee53d3167f9bccafa4f9492d93e08093 WatchSource:0}: Error finding container f5c3644877a30b260e89ca2f5ccd5a8fee53d3167f9bccafa4f9492d93e08093: Status 404 returned error can't find the container with id f5c3644877a30b260e89ca2f5ccd5a8fee53d3167f9bccafa4f9492d93e08093 Jul 07 15:36:02.158287 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:02.158255 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" event={"ID":"a94e0dca-7715-4d36-8901-f1ea9c89881c","Type":"ContainerStarted","Data":"f5c3644877a30b260e89ca2f5ccd5a8fee53d3167f9bccafa4f9492d93e08093"} Jul 07 15:36:03.164352 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:03.164313 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" event={"ID":"a94e0dca-7715-4d36-8901-f1ea9c89881c","Type":"ContainerStarted","Data":"67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5"} Jul 07 15:36:03.184620 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:03.184559 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" podStartSLOduration=2.184539604 podStartE2EDuration="2.184539604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:36:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:36:03.183244302 +0000 UTC m=+2106.658081045" watchObservedRunningTime="2026-07-07 15:36:03.184539604 +0000 UTC m=+2106.659376371" Jul 07 15:36:05.085271 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:05.085230 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:36:12.003295 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:12.003253 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:12.003705 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:12.003316 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:12.015760 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:12.015729 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:12.214485 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:12.214455 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:36:38.627247 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:38.627213 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:36:56.382346 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:36:56.382312 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:37:12.225092 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:37:12.225060 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:37:13.346776 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:37:13.346740 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:37:26.497422 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:37:26.497384 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:37:40.253173 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:37:40.253137 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:37:42.681129 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:37:42.681098 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:37:57.584577 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:37:57.584542 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:38:11.782410 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:11.782374 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6"] Jul 07 15:38:11.821948 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:11.821909 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:38:12.761646 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:12.761615 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x"] Jul 07 15:38:13.067369 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:13.067337 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:38:14.980399 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:14.980361 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:38:18.611935 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:18.611849 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:38:19.363381 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:19.363347 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:38:26.802130 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:26.802087 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" podUID="072eb826-79d2-43c9-b50d-f8ed1aaa042d" containerName="main" containerID="cri-o://cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5" gracePeriod=45 Jul 07 15:38:27.050303 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.050277 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:38:27.133625 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.133594 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-model-cache\") pod \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " Jul 07 15:38:27.133838 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.133639 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-dshm\") pod \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " Jul 07 15:38:27.133838 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.133663 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tmp-dir\") pod \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " Jul 07 15:38:27.133838 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.133684 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2nsr\" (UniqueName: \"kubernetes.io/projected/072eb826-79d2-43c9-b50d-f8ed1aaa042d-kube-api-access-w2nsr\") pod \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " Jul 07 15:38:27.133838 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.133723 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-home\") pod \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " Jul 07 15:38:27.133838 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.133824 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tls-certs\") pod \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\" (UID: \"072eb826-79d2-43c9-b50d-f8ed1aaa042d\") " Jul 07 15:38:27.134148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.133941 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-model-cache" (OuterVolumeSpecName: "model-cache") pod "072eb826-79d2-43c9-b50d-f8ed1aaa042d" (UID: "072eb826-79d2-43c9-b50d-f8ed1aaa042d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:38:27.134148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.133954 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "072eb826-79d2-43c9-b50d-f8ed1aaa042d" (UID: "072eb826-79d2-43c9-b50d-f8ed1aaa042d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:38:27.134148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.134081 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-home" (OuterVolumeSpecName: "home") pod "072eb826-79d2-43c9-b50d-f8ed1aaa042d" (UID: "072eb826-79d2-43c9-b50d-f8ed1aaa042d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:38:27.134148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.134131 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-model-cache\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:27.134148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.134143 2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tmp-dir\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:27.136031 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.136007 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/072eb826-79d2-43c9-b50d-f8ed1aaa042d-kube-api-access-w2nsr" (OuterVolumeSpecName: "kube-api-access-w2nsr") pod "072eb826-79d2-43c9-b50d-f8ed1aaa042d" (UID: "072eb826-79d2-43c9-b50d-f8ed1aaa042d"). InnerVolumeSpecName "kube-api-access-w2nsr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:38:27.136161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.136029 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "072eb826-79d2-43c9-b50d-f8ed1aaa042d" (UID: "072eb826-79d2-43c9-b50d-f8ed1aaa042d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:38:27.136161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.136054 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-dshm" (OuterVolumeSpecName: "dshm") pod "072eb826-79d2-43c9-b50d-f8ed1aaa042d" (UID: "072eb826-79d2-43c9-b50d-f8ed1aaa042d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:38:27.234619 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.234581 2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/072eb826-79d2-43c9-b50d-f8ed1aaa042d-tls-certs\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:27.234619 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.234611 2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-dshm\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:27.234619 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.234622 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2nsr\" (UniqueName: \"kubernetes.io/projected/072eb826-79d2-43c9-b50d-f8ed1aaa042d-kube-api-access-w2nsr\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:27.234857 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.234632 2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/072eb826-79d2-43c9-b50d-f8ed1aaa042d-home\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:27.781558 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.781518 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" podUID="a94e0dca-7715-4d36-8901-f1ea9c89881c" containerName="main" containerID="cri-o://67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5" gracePeriod=45 Jul 07 15:38:27.808895 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.808864 2580 generic.go:356] "Generic (PLEG): container finished" podID="072eb826-79d2-43c9-b50d-f8ed1aaa042d" containerID="cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5" exitCode=0 Jul 07 15:38:27.809256 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.808908 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" Jul 07 15:38:27.809256 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.808902 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" event={"ID":"072eb826-79d2-43c9-b50d-f8ed1aaa042d","Type":"ContainerDied","Data":"cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5"} Jul 07 15:38:27.809256 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.809018 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6" event={"ID":"072eb826-79d2-43c9-b50d-f8ed1aaa042d","Type":"ContainerDied","Data":"625a6dc5b764fbb3271f2ec104f4e736827e0a3459b9f7c9803cdf1df9136d69"} Jul 07 15:38:27.809256 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.809038 2580 scope.go:117] "RemoveContainer" containerID="cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5" Jul 07 15:38:27.861112 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.861075 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6"] Jul 07 15:38:27.866485 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.866464 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/auth-test-model-8f5391-kserve-566465bbdc-nn5n6"] Jul 07 15:38:27.891801 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.891781 2580 scope.go:117] "RemoveContainer" containerID="cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5" Jul 07 15:38:27.892150 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:38:27.892121 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5\": container with ID starting with cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5 not found: ID does not exist" containerID="cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5" Jul 07 15:38:27.892234 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:27.892166 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5"} err="failed to get container status \"cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5\": rpc error: code = NotFound desc = could not find container \"cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5\": container with ID starting with cd9b228fd3a874e90a7d0dc32b2a38ac4bc4a8e63a3445e70e05e102a359a1f5 not found: ID does not exist" Jul 07 15:38:28.042260 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.042197 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:38:28.142110 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142075 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h74x2\" (UniqueName: \"kubernetes.io/projected/a94e0dca-7715-4d36-8901-f1ea9c89881c-kube-api-access-h74x2\") pod \"a94e0dca-7715-4d36-8901-f1ea9c89881c\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " Jul 07 15:38:28.142276 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142169 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a94e0dca-7715-4d36-8901-f1ea9c89881c-tls-certs\") pod \"a94e0dca-7715-4d36-8901-f1ea9c89881c\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " Jul 07 15:38:28.142318 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142275 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-model-cache\") pod \"a94e0dca-7715-4d36-8901-f1ea9c89881c\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " Jul 07 15:38:28.142318 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142313 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-home\") pod \"a94e0dca-7715-4d36-8901-f1ea9c89881c\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " Jul 07 15:38:28.142392 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142334 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-dshm\") pod \"a94e0dca-7715-4d36-8901-f1ea9c89881c\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " Jul 07 15:38:28.142425 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142413 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-tmp-dir\") pod \"a94e0dca-7715-4d36-8901-f1ea9c89881c\" (UID: \"a94e0dca-7715-4d36-8901-f1ea9c89881c\") " Jul 07 15:38:28.142571 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142540 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-home" (OuterVolumeSpecName: "home") pod "a94e0dca-7715-4d36-8901-f1ea9c89881c" (UID: "a94e0dca-7715-4d36-8901-f1ea9c89881c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:38:28.142571 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142553 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-model-cache" (OuterVolumeSpecName: "model-cache") pod "a94e0dca-7715-4d36-8901-f1ea9c89881c" (UID: "a94e0dca-7715-4d36-8901-f1ea9c89881c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:38:28.142770 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142753 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-model-cache\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:28.142821 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142780 2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-home\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:28.142821 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.142752 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a94e0dca-7715-4d36-8901-f1ea9c89881c" (UID: "a94e0dca-7715-4d36-8901-f1ea9c89881c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:38:28.144412 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.144393 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-dshm" (OuterVolumeSpecName: "dshm") pod "a94e0dca-7715-4d36-8901-f1ea9c89881c" (UID: "a94e0dca-7715-4d36-8901-f1ea9c89881c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:38:28.144474 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.144430 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a94e0dca-7715-4d36-8901-f1ea9c89881c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a94e0dca-7715-4d36-8901-f1ea9c89881c" (UID: "a94e0dca-7715-4d36-8901-f1ea9c89881c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:38:28.144515 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.144500 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a94e0dca-7715-4d36-8901-f1ea9c89881c-kube-api-access-h74x2" (OuterVolumeSpecName: "kube-api-access-h74x2") pod "a94e0dca-7715-4d36-8901-f1ea9c89881c" (UID: "a94e0dca-7715-4d36-8901-f1ea9c89881c"). InnerVolumeSpecName "kube-api-access-h74x2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:38:28.243387 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.243352 2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-tmp-dir\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:28.243387 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.243383 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h74x2\" (UniqueName: \"kubernetes.io/projected/a94e0dca-7715-4d36-8901-f1ea9c89881c-kube-api-access-h74x2\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:28.243387 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.243393 2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a94e0dca-7715-4d36-8901-f1ea9c89881c-tls-certs\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:28.243620 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.243402 2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a94e0dca-7715-4d36-8901-f1ea9c89881c-dshm\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:38:28.815788 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.815755 2580 generic.go:356] "Generic (PLEG): container finished" podID="a94e0dca-7715-4d36-8901-f1ea9c89881c" containerID="67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5" exitCode=0 Jul 07 15:38:28.815788 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.815793 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" Jul 07 15:38:28.816386 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.815838 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" event={"ID":"a94e0dca-7715-4d36-8901-f1ea9c89881c","Type":"ContainerDied","Data":"67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5"} Jul 07 15:38:28.816386 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.815877 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x" event={"ID":"a94e0dca-7715-4d36-8901-f1ea9c89881c","Type":"ContainerDied","Data":"f5c3644877a30b260e89ca2f5ccd5a8fee53d3167f9bccafa4f9492d93e08093"} Jul 07 15:38:28.816386 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.815893 2580 scope.go:117] "RemoveContainer" containerID="67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5" Jul 07 15:38:28.824704 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.824685 2580 scope.go:117] "RemoveContainer" containerID="67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5" Jul 07 15:38:28.824966 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:38:28.824948 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5\": container with ID starting with 67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5 not found: ID does not exist" containerID="67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5" Jul 07 15:38:28.825071 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.824996 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5"} err="failed to get container status \"67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5\": rpc error: code = NotFound desc = could not find container \"67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5\": container with ID starting with 67b0620d4a4dba5ada393fa94e3d282a134be82f52e3ac8ea528eb8f3f45c7c5 not found: ID does not exist" Jul 07 15:38:28.839372 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.839345 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x"] Jul 07 15:38:28.844041 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:28.844019 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/auth-test-model-600c1d-kserve-5cf47cdb7-cfg2x"] Jul 07 15:38:29.098041 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:29.097951 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="072eb826-79d2-43c9-b50d-f8ed1aaa042d" path="/var/lib/kubelet/pods/072eb826-79d2-43c9-b50d-f8ed1aaa042d/volumes" Jul 07 15:38:29.098439 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:29.098419 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a94e0dca-7715-4d36-8901-f1ea9c89881c" path="/var/lib/kubelet/pods/a94e0dca-7715-4d36-8901-f1ea9c89881c/volumes" Jul 07 15:38:30.480694 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:30.480658 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:38:40.682283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.682244 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm"] Jul 07 15:38:40.682658 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.682580 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a94e0dca-7715-4d36-8901-f1ea9c89881c" containerName="main" Jul 07 15:38:40.682658 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.682591 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a94e0dca-7715-4d36-8901-f1ea9c89881c" containerName="main" Jul 07 15:38:40.682658 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.682613 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="072eb826-79d2-43c9-b50d-f8ed1aaa042d" containerName="main" Jul 07 15:38:40.682658 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.682618 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="072eb826-79d2-43c9-b50d-f8ed1aaa042d" containerName="main" Jul 07 15:38:40.682801 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.682665 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a94e0dca-7715-4d36-8901-f1ea9c89881c" containerName="main" Jul 07 15:38:40.682801 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.682674 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="072eb826-79d2-43c9-b50d-f8ed1aaa042d" containerName="main" Jul 07 15:38:40.685637 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.685621 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.690161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.690134 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-600c1d\"/\"kube-root-ca.crt\"" Jul 07 15:38:40.690161 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.690151 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-600c1d\"/\"default-dockercfg-nblnj\"" Jul 07 15:38:40.690373 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.690197 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-600c1d\"/\"sub-test-model-600c1d-kserve-self-signed-certs\"" Jul 07 15:38:40.690373 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.690147 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-600c1d\"/\"openshift-service-ca.crt\"" Jul 07 15:38:40.704549 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.704504 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm"] Jul 07 15:38:40.713622 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.713587 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:38:40.757145 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.757106 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-dshm\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.757145 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.757146 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-tmp-dir\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.757365 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.757263 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-home\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.757365 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.757292 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14444a7b-005e-4a92-a735-dc103101553f-tls-certs\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.757365 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.757360 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-model-cache\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.757481 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.757392 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wnzd\" (UniqueName: \"kubernetes.io/projected/14444a7b-005e-4a92-a735-dc103101553f-kube-api-access-9wnzd\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858147 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858107 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-home\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858147 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858147 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14444a7b-005e-4a92-a735-dc103101553f-tls-certs\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858402 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858196 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-model-cache\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858402 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858236 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wnzd\" (UniqueName: \"kubernetes.io/projected/14444a7b-005e-4a92-a735-dc103101553f-kube-api-access-9wnzd\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858402 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858266 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-dshm\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858402 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858291 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-tmp-dir\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858609 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858578 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-home\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858672 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858622 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-model-cache\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.858728 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.858696 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-tmp-dir\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.860434 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.860403 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-dshm\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.860734 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.860715 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14444a7b-005e-4a92-a735-dc103101553f-tls-certs\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.868592 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.868569 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wnzd\" (UniqueName: \"kubernetes.io/projected/14444a7b-005e-4a92-a735-dc103101553f-kube-api-access-9wnzd\") pod \"sub-test-model-600c1d-kserve-cbb66499f-ng6qm\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:40.994689 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:40.994582 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:41.126562 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:41.126529 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm"] Jul 07 15:38:41.129858 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:38:41.129827 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14444a7b_005e_4a92_a735_dc103101553f.slice/crio-d2fd1c7b075af9a5162611c4c3c9e34df424b036aab0caecf5f167fa3eb6564d WatchSource:0}: Error finding container d2fd1c7b075af9a5162611c4c3c9e34df424b036aab0caecf5f167fa3eb6564d: Status 404 returned error can't find the container with id d2fd1c7b075af9a5162611c4c3c9e34df424b036aab0caecf5f167fa3eb6564d Jul 07 15:38:41.881415 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:41.881375 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" event={"ID":"14444a7b-005e-4a92-a735-dc103101553f","Type":"ContainerStarted","Data":"b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317"} Jul 07 15:38:41.881415 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:41.881419 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" event={"ID":"14444a7b-005e-4a92-a735-dc103101553f","Type":"ContainerStarted","Data":"d2fd1c7b075af9a5162611c4c3c9e34df424b036aab0caecf5f167fa3eb6564d"} Jul 07 15:38:41.900609 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:41.900559 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" podStartSLOduration=1.900535826 podStartE2EDuration="1.900535826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:38:41.900048972 +0000 UTC m=+2265.374885720" watchObservedRunningTime="2026-07-07 15:38:41.900535826 +0000 UTC m=+2265.375372575" Jul 07 15:38:44.990895 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:44.990858 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:38:50.995661 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:50.995624 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:50.996091 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:50.995693 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:51.007829 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:51.007808 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:51.936205 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:51.936178 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:38:59.694412 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:38:59.694375 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:39:16.736168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:16.736134 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:17.771634 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:17.771596 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm"] Jul 07 15:39:17.795039 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:17.795007 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:19.801598 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:19.801562 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:39:26.575439 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.575406 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg"] Jul 07 15:39:26.578986 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.578956 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.581921 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.581895 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8f5391\"/\"openshift-service-ca.crt\"" Jul 07 15:39:26.583111 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.583088 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-8f5391\"/\"kube-root-ca.crt\"" Jul 07 15:39:26.583111 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.583086 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8f5391\"/\"default-dockercfg-k9f9m\"" Jul 07 15:39:26.583281 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.583141 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-8f5391\"/\"rate-test-model-8f5391-kserve-self-signed-certs\"" Jul 07 15:39:26.590103 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.590082 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg"] Jul 07 15:39:26.605337 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.605302 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:26.673468 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.673436 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p6ql\" (UniqueName: \"kubernetes.io/projected/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-kube-api-access-4p6ql\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.673646 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.673489 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tmp-dir\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.673646 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.673600 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-dshm\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.673646 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.673628 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-model-cache\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.673801 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.673647 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tls-certs\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.673801 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.673734 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-home\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.774552 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.774511 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p6ql\" (UniqueName: \"kubernetes.io/projected/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-kube-api-access-4p6ql\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.774734 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.774570 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tmp-dir\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.774734 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.774650 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-dshm\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.774812 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.774779 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-model-cache\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.774848 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.774816 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tls-certs\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.774882 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.774859 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-home\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.775195 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.775163 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tmp-dir\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.775195 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.775179 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-model-cache\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.775350 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.775212 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-home\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.776871 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.776842 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-dshm\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.777276 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.777260 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tls-certs\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.784766 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.784745 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p6ql\" (UniqueName: \"kubernetes.io/projected/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-kube-api-access-4p6ql\") pod \"rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:26.889038 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:26.888914 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:27.023388 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:27.023360 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg"] Jul 07 15:39:27.025298 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:39:27.025271 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb33b9347_d6a5_4d0f_90a8_b59f49604dd4.slice/crio-d0c620140dfe66407752a6dce42f29be124bd8d3f69bd6a1b371b9ded3edcb34 WatchSource:0}: Error finding container d0c620140dfe66407752a6dce42f29be124bd8d3f69bd6a1b371b9ded3edcb34: Status 404 returned error can't find the container with id d0c620140dfe66407752a6dce42f29be124bd8d3f69bd6a1b371b9ded3edcb34 Jul 07 15:39:27.076383 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:27.076353 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" event={"ID":"b33b9347-d6a5-4d0f-90a8-b59f49604dd4","Type":"ContainerStarted","Data":"d0c620140dfe66407752a6dce42f29be124bd8d3f69bd6a1b371b9ded3edcb34"} Jul 07 15:39:28.083033 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:28.082994 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" event={"ID":"b33b9347-d6a5-4d0f-90a8-b59f49604dd4","Type":"ContainerStarted","Data":"82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871"} Jul 07 15:39:28.113688 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:28.113638 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" podStartSLOduration=2.113622058 podStartE2EDuration="2.113622058s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:39:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:39:28.113331538 +0000 UTC m=+2311.588168287" watchObservedRunningTime="2026-07-07 15:39:28.113622058 +0000 UTC m=+2311.588458807" Jul 07 15:39:32.791603 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:32.791542 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" podUID="14444a7b-005e-4a92-a735-dc103101553f" containerName="main" containerID="cri-o://b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317" gracePeriod=45 Jul 07 15:39:33.043417 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.043358 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:39:33.107573 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.107539 2580 generic.go:356] "Generic (PLEG): container finished" podID="14444a7b-005e-4a92-a735-dc103101553f" containerID="b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317" exitCode=0 Jul 07 15:39:33.107734 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.107579 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" Jul 07 15:39:33.107734 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.107607 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" event={"ID":"14444a7b-005e-4a92-a735-dc103101553f","Type":"ContainerDied","Data":"b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317"} Jul 07 15:39:33.107734 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.107642 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm" event={"ID":"14444a7b-005e-4a92-a735-dc103101553f","Type":"ContainerDied","Data":"d2fd1c7b075af9a5162611c4c3c9e34df424b036aab0caecf5f167fa3eb6564d"} Jul 07 15:39:33.107734 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.107664 2580 scope.go:117] "RemoveContainer" containerID="b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317" Jul 07 15:39:33.116151 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.116127 2580 scope.go:117] "RemoveContainer" containerID="b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317" Jul 07 15:39:33.116417 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:39:33.116400 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317\": container with ID starting with b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317 not found: ID does not exist" containerID="b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317" Jul 07 15:39:33.116476 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.116428 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317"} err="failed to get container status \"b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317\": rpc error: code = NotFound desc = could not find container \"b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317\": container with ID starting with b8875abd586edbc099f5dcadd2a167d277e030e2635d22cbc0167c1519ba0317 not found: ID does not exist" Jul 07 15:39:33.130203 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130175 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-tmp-dir\") pod \"14444a7b-005e-4a92-a735-dc103101553f\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " Jul 07 15:39:33.130318 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130216 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-model-cache\") pod \"14444a7b-005e-4a92-a735-dc103101553f\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " Jul 07 15:39:33.130318 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130238 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-dshm\") pod \"14444a7b-005e-4a92-a735-dc103101553f\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " Jul 07 15:39:33.130318 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130264 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14444a7b-005e-4a92-a735-dc103101553f-tls-certs\") pod \"14444a7b-005e-4a92-a735-dc103101553f\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " Jul 07 15:39:33.130480 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130328 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9wnzd\" (UniqueName: \"kubernetes.io/projected/14444a7b-005e-4a92-a735-dc103101553f-kube-api-access-9wnzd\") pod \"14444a7b-005e-4a92-a735-dc103101553f\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " Jul 07 15:39:33.130480 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130365 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-home\") pod \"14444a7b-005e-4a92-a735-dc103101553f\" (UID: \"14444a7b-005e-4a92-a735-dc103101553f\") " Jul 07 15:39:33.130480 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130457 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "14444a7b-005e-4a92-a735-dc103101553f" (UID: "14444a7b-005e-4a92-a735-dc103101553f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:33.130635 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130473 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-model-cache" (OuterVolumeSpecName: "model-cache") pod "14444a7b-005e-4a92-a735-dc103101553f" (UID: "14444a7b-005e-4a92-a735-dc103101553f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:33.130689 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130662 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-home" (OuterVolumeSpecName: "home") pod "14444a7b-005e-4a92-a735-dc103101553f" (UID: "14444a7b-005e-4a92-a735-dc103101553f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:33.130743 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130725 2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-tmp-dir\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:39:33.130785 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.130752 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-model-cache\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:39:33.132343 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.132314 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-dshm" (OuterVolumeSpecName: "dshm") pod "14444a7b-005e-4a92-a735-dc103101553f" (UID: "14444a7b-005e-4a92-a735-dc103101553f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:39:33.132427 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.132399 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14444a7b-005e-4a92-a735-dc103101553f-kube-api-access-9wnzd" (OuterVolumeSpecName: "kube-api-access-9wnzd") pod "14444a7b-005e-4a92-a735-dc103101553f" (UID: "14444a7b-005e-4a92-a735-dc103101553f"). InnerVolumeSpecName "kube-api-access-9wnzd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:39:33.132632 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.132614 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14444a7b-005e-4a92-a735-dc103101553f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "14444a7b-005e-4a92-a735-dc103101553f" (UID: "14444a7b-005e-4a92-a735-dc103101553f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:39:33.231270 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.231224 2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-dshm\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:39:33.231270 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.231262 2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/14444a7b-005e-4a92-a735-dc103101553f-tls-certs\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:39:33.231270 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.231275 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9wnzd\" (UniqueName: \"kubernetes.io/projected/14444a7b-005e-4a92-a735-dc103101553f-kube-api-access-9wnzd\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:39:33.231560 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.231287 2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/14444a7b-005e-4a92-a735-dc103101553f-home\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:39:33.432297 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.432263 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm"] Jul 07 15:39:33.437646 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:33.437621 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-600c1d/sub-test-model-600c1d-kserve-cbb66499f-ng6qm"] Jul 07 15:39:35.098148 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:35.098117 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14444a7b-005e-4a92-a735-dc103101553f" path="/var/lib/kubelet/pods/14444a7b-005e-4a92-a735-dc103101553f/volumes" Jul 07 15:39:36.890093 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:36.890049 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:36.890497 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:36.890128 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:36.903294 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:36.903271 2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:37.137694 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:37.137663 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:39:39.487360 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:39.487322 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:39:55.714919 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:55.714828 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:57.405262 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:57.405231 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:57.512696 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:57.512609 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:39:59.518105 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:39:59.518072 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:40:16.879123 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:16.879085 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:40:17.841809 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:17.841753 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:17.945944 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:17.945903 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:25.395198 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:25.395167 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:25.497729 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:25.497685 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:31.682908 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:31.682874 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:40:37.614483 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:37.614454 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg"] Jul 07 15:40:37.649213 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:37.649178 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:38.618724 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:38.618675 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:39.869588 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:39.869558 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:40.247721 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:40.247632 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:40.349481 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:40.349437 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:40.448676 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:40.448640 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:40.604606 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:40.604572 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:44.475697 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:44.475662 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:40:45.329230 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:45.329195 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:40:52.635363 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.635304 2580 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" podUID="b33b9347-d6a5-4d0f-90a8-b59f49604dd4" containerName="main" containerID="cri-o://82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871" gracePeriod=45 Jul 07 15:40:52.658247 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:40:52.658217 2580 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb33b9347_d6a5_4d0f_90a8_b59f49604dd4.slice/crio-82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871.scope\": RecentStats: unable to find data in memory cache]" Jul 07 15:40:52.887180 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.887116 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:40:52.960746 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.960696 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4p6ql\" (UniqueName: \"kubernetes.io/projected/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-kube-api-access-4p6ql\") pod \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " Jul 07 15:40:52.960746 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.960755 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tmp-dir\") pod \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " Jul 07 15:40:52.961025 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.960788 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-model-cache\") pod \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " Jul 07 15:40:52.961025 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.960850 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-home\") pod \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " Jul 07 15:40:52.961025 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.960886 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-dshm\") pod \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " Jul 07 15:40:52.961025 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.960994 2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tls-certs\") pod \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\" (UID: \"b33b9347-d6a5-4d0f-90a8-b59f49604dd4\") " Jul 07 15:40:52.961248 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.961095 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-model-cache" (OuterVolumeSpecName: "model-cache") pod "b33b9347-d6a5-4d0f-90a8-b59f49604dd4" (UID: "b33b9347-d6a5-4d0f-90a8-b59f49604dd4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:52.961248 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.961105 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b33b9347-d6a5-4d0f-90a8-b59f49604dd4" (UID: "b33b9347-d6a5-4d0f-90a8-b59f49604dd4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:52.961248 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.961193 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-home" (OuterVolumeSpecName: "home") pod "b33b9347-d6a5-4d0f-90a8-b59f49604dd4" (UID: "b33b9347-d6a5-4d0f-90a8-b59f49604dd4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:52.961397 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.961366 2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tmp-dir\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:40:52.961397 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.961380 2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-model-cache\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:40:52.961397 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.961389 2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-home\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:40:52.963016 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.962988 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-dshm" (OuterVolumeSpecName: "dshm") pod "b33b9347-d6a5-4d0f-90a8-b59f49604dd4" (UID: "b33b9347-d6a5-4d0f-90a8-b59f49604dd4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:40:52.963130 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.963050 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-kube-api-access-4p6ql" (OuterVolumeSpecName: "kube-api-access-4p6ql") pod "b33b9347-d6a5-4d0f-90a8-b59f49604dd4" (UID: "b33b9347-d6a5-4d0f-90a8-b59f49604dd4"). InnerVolumeSpecName "kube-api-access-4p6ql". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:40:52.963130 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:52.963111 2580 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b33b9347-d6a5-4d0f-90a8-b59f49604dd4" (UID: "b33b9347-d6a5-4d0f-90a8-b59f49604dd4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 15:40:53.061837 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.061802 2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-dshm\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:40:53.061837 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.061832 2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-tls-certs\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:40:53.061837 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.061845 2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4p6ql\" (UniqueName: \"kubernetes.io/projected/b33b9347-d6a5-4d0f-90a8-b59f49604dd4-kube-api-access-4p6ql\") on node \"ip-10-0-142-14.ec2.internal\" DevicePath \"\"" Jul 07 15:40:53.470655 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.470618 2580 generic.go:356] "Generic (PLEG): container finished" podID="b33b9347-d6a5-4d0f-90a8-b59f49604dd4" containerID="82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871" exitCode=0 Jul 07 15:40:53.470863 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.470664 2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" Jul 07 15:40:53.470863 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.470707 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" event={"ID":"b33b9347-d6a5-4d0f-90a8-b59f49604dd4","Type":"ContainerDied","Data":"82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871"} Jul 07 15:40:53.470863 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.470756 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg" event={"ID":"b33b9347-d6a5-4d0f-90a8-b59f49604dd4","Type":"ContainerDied","Data":"d0c620140dfe66407752a6dce42f29be124bd8d3f69bd6a1b371b9ded3edcb34"} Jul 07 15:40:53.470863 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.470776 2580 scope.go:117] "RemoveContainer" containerID="82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871" Jul 07 15:40:53.478876 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.478854 2580 scope.go:117] "RemoveContainer" containerID="82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871" Jul 07 15:40:53.479180 ip-10-0-142-14 kubenswrapper[2580]: E0707 15:40:53.479158 2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871\": container with ID starting with 82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871 not found: ID does not exist" containerID="82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871" Jul 07 15:40:53.479247 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.479198 2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871"} err="failed to get container status \"82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871\": rpc error: code = NotFound desc = could not find container \"82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871\": container with ID starting with 82989a296bb3beeb879bf28f1bd9122e679de7f9b870284657cf0fa26cb6a871 not found: ID does not exist" Jul 07 15:40:53.505304 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.505270 2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg"] Jul 07 15:40:53.511285 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:53.511257 2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-8f5391/rate-test-model-8f5391-kserve-f5c7d6b55-jhlqg"] Jul 07 15:40:55.097912 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:40:55.097874 2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b33b9347-d6a5-4d0f-90a8-b59f49604dd4" path="/var/lib/kubelet/pods/b33b9347-d6a5-4d0f-90a8-b59f49604dd4/volumes" Jul 07 15:41:22.626108 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:22.626068 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:22.955605 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:22.955521 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:23.272398 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:23.272310 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:23.461435 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:23.461403 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:23.905178 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:23.905138 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:24.005631 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:24.005598 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:24.163285 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:24.163199 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:26.977855 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:26.977820 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-zpwl4"] Jul 07 15:41:30.515671 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:30.515643 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:30.581591 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:30.581562 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:30.812735 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:30.812701 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:31.084440 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:31.084359 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:31.554672 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:31.554590 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67ff9cf867-lj6vp_3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb/authorino/0.log" Jul 07 15:41:36.478055 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:36.478000 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b6pkm_59d6c10e-4db6-406d-8bfd-f1087111e87c/manager/0.log" Jul 07 15:41:37.649260 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:37.649233 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845dc9964f-7sd66_933e75bd-9c1a-4c3c-8e91-41a127689085/copy-manifests/0.log" Jul 07 15:41:37.656840 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:37.656821 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845dc9964f-7sd66_933e75bd-9c1a-4c3c-8e91-41a127689085/manager/0.log" Jul 07 15:41:39.262661 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:39.262627 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67ff9cf867-lj6vp_3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb/authorino/0.log" Jul 07 15:41:39.629469 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:39.629442 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-blwlz_f6aa854c-ba95-4128-864a-c3df8f8e0d72/kuadrant-console-plugin/0.log" Jul 07 15:41:40.050469 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:40.050394 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zpwl4_896b2f11-02ac-492e-880a-ab2f7e0946de/limitador/0.log" Jul 07 15:41:40.808637 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:40.808607 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8697c578dd-2mwlt_a000aa1a-dccb-46fe-bdb5-88ee94724ced/kube-auth-proxy/0.log" Jul 07 15:41:42.257659 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:42.257627 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9fqbx_07ae8b6f-7ebe-4723-91af-b35598b7c87c/main/0.log" Jul 07 15:41:42.378767 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:42.378737 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-hbqrl_81e0b56b-4af2-4f77-949f-6957e2a94584/main/0.log" Jul 07 15:41:46.403354 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:46.403319 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:46.503381 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:46.503345 2580 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" limit=1024 Jul 07 15:41:49.535516 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:49.535490 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6zmxl_0ebf6e5e-2938-4274-8bf7-5dcf5c4ceb04/global-pull-secret-syncer/0.log" Jul 07 15:41:49.639535 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:49.639503 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2rbx7_89a25915-f232-4d60-aab5-e657bcb013ef/konnectivity-agent/0.log" Jul 07 15:41:49.788537 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:49.788462 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-14.ec2.internal_8aaae9886cf90bd3452823e4171c4905/haproxy/0.log" Jul 07 15:41:55.183528 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:55.183489 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67ff9cf867-lj6vp_3ecc9daf-cf91-4fcd-9f9b-d6ec5d229fbb/authorino/0.log" Jul 07 15:41:55.296336 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:55.296311 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-blwlz_f6aa854c-ba95-4128-864a-c3df8f8e0d72/kuadrant-console-plugin/0.log" Jul 07 15:41:55.513964 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:55.513884 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-zpwl4_896b2f11-02ac-492e-880a-ab2f7e0946de/limitador/0.log" Jul 07 15:41:57.308493 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.308462 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_991c8258-721a-4e4e-aac0-1ec77172128c/alertmanager/0.log" Jul 07 15:41:57.334365 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.334336 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_991c8258-721a-4e4e-aac0-1ec77172128c/config-reloader/0.log" Jul 07 15:41:57.358470 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.358437 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_991c8258-721a-4e4e-aac0-1ec77172128c/kube-rbac-proxy-web/0.log" Jul 07 15:41:57.385350 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.385320 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_991c8258-721a-4e4e-aac0-1ec77172128c/kube-rbac-proxy/0.log" Jul 07 15:41:57.413283 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.413257 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_991c8258-721a-4e4e-aac0-1ec77172128c/kube-rbac-proxy-metric/0.log" Jul 07 15:41:57.441763 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.441736 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_991c8258-721a-4e4e-aac0-1ec77172128c/prom-label-proxy/0.log" Jul 07 15:41:57.468748 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.468724 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_991c8258-721a-4e4e-aac0-1ec77172128c/init-config-reloader/0.log" Jul 07 15:41:57.677416 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.677387 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-bw5tr_4a3f74dc-11ec-429a-bbc3-bfa50a730381/monitoring-plugin/0.log" Jul 07 15:41:57.896867 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.896827 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8t7b_aa25adb6-0689-4dea-9f16-4d3c51171d20/node-exporter/0.log" Jul 07 15:41:57.920770 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.920741 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8t7b_aa25adb6-0689-4dea-9f16-4d3c51171d20/kube-rbac-proxy/0.log" Jul 07 15:41:57.947683 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:57.947607 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8t7b_aa25adb6-0689-4dea-9f16-4d3c51171d20/init-textfile/0.log" Jul 07 15:41:58.066884 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.066843 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38c471af-c395-4004-9d1b-a1602ecdcf61/prometheus/0.log" Jul 07 15:41:58.094355 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.094324 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38c471af-c395-4004-9d1b-a1602ecdcf61/config-reloader/0.log" Jul 07 15:41:58.120301 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.120274 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38c471af-c395-4004-9d1b-a1602ecdcf61/thanos-sidecar/0.log" Jul 07 15:41:58.144837 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.144811 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38c471af-c395-4004-9d1b-a1602ecdcf61/kube-rbac-proxy-web/0.log" Jul 07 15:41:58.168089 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.168061 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38c471af-c395-4004-9d1b-a1602ecdcf61/kube-rbac-proxy/0.log" Jul 07 15:41:58.192223 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.192198 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38c471af-c395-4004-9d1b-a1602ecdcf61/kube-rbac-proxy-thanos/0.log" Jul 07 15:41:58.215781 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.215717 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_38c471af-c395-4004-9d1b-a1602ecdcf61/init-config-reloader/0.log" Jul 07 15:41:58.242927 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.242895 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-gn7fr_b87ab270-7821-46d7-9266-fdb6f5289aa6/prometheus-operator/0.log" Jul 07 15:41:58.263237 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:58.263208 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-gn7fr_b87ab270-7821-46d7-9266-fdb6f5289aa6/kube-rbac-proxy/0.log" Jul 07 15:41:59.889881 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.889841 2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74"] Jul 07 15:41:59.890373 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.890252 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14444a7b-005e-4a92-a735-dc103101553f" containerName="main" Jul 07 15:41:59.890373 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.890272 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="14444a7b-005e-4a92-a735-dc103101553f" containerName="main" Jul 07 15:41:59.890373 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.890299 2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b33b9347-d6a5-4d0f-90a8-b59f49604dd4" containerName="main" Jul 07 15:41:59.890373 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.890308 2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b33b9347-d6a5-4d0f-90a8-b59f49604dd4" containerName="main" Jul 07 15:41:59.890510 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.890378 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="14444a7b-005e-4a92-a735-dc103101553f" containerName="main" Jul 07 15:41:59.890510 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.890386 2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b33b9347-d6a5-4d0f-90a8-b59f49604dd4" containerName="main" Jul 07 15:41:59.893337 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.893320 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:41:59.896262 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.896239 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hkchs\"/\"kube-root-ca.crt\"" Jul 07 15:41:59.897281 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.897264 2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hkchs\"/\"openshift-service-ca.crt\"" Jul 07 15:41:59.897367 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.897270 2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hkchs\"/\"default-dockercfg-lzg8p\"" Jul 07 15:41:59.904600 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.904577 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74"] Jul 07 15:41:59.966058 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.966021 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-sys\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:41:59.966058 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.966070 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-proc\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:41:59.966314 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.966094 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9p2d\" (UniqueName: \"kubernetes.io/projected/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-kube-api-access-x9p2d\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:41:59.966314 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.966149 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-podres\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:41:59.966314 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:41:59.966213 2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-lib-modules\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.066986 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.066948 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-lib-modules\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.067168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.067024 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-sys\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.067168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.067054 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-proc\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.067168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.067075 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9p2d\" (UniqueName: \"kubernetes.io/projected/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-kube-api-access-x9p2d\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.067168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.067101 2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-podres\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.067168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.067103 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-sys\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.067168 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.067120 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-lib-modules\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.067381 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.067169 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-proc\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.067381 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.067211 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-podres\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.076311 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.076276 2580 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9p2d\" (UniqueName: \"kubernetes.io/projected/9ced9136-ecb4-4cfc-9c5f-38920921bbe6-kube-api-access-x9p2d\") pod \"perf-node-gather-daemonset-hct74\" (UID: \"9ced9136-ecb4-4cfc-9c5f-38920921bbe6\") " pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.203450 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.203368 2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.336362 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.336188 2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74"] Jul 07 15:42:00.339165 ip-10-0-142-14 kubenswrapper[2580]: W0707 15:42:00.339134 2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9ced9136_ecb4_4cfc_9c5f_38920921bbe6.slice/crio-60bb8ee18066b2ae91d540cab8717f918051abfa14f6d703544ede74b9b2fac2 WatchSource:0}: Error finding container 60bb8ee18066b2ae91d540cab8717f918051abfa14f6d703544ede74b9b2fac2: Status 404 returned error can't find the container with id 60bb8ee18066b2ae91d540cab8717f918051abfa14f6d703544ede74b9b2fac2 Jul 07 15:42:00.767980 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.767947 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" event={"ID":"9ced9136-ecb4-4cfc-9c5f-38920921bbe6","Type":"ContainerStarted","Data":"5572c330184bc43404892754b344e1afaa17de4b48bd8f47e2588fe75d726f7a"} Jul 07 15:42:00.768184 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.768015 2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" event={"ID":"9ced9136-ecb4-4cfc-9c5f-38920921bbe6","Type":"ContainerStarted","Data":"60bb8ee18066b2ae91d540cab8717f918051abfa14f6d703544ede74b9b2fac2"} Jul 07 15:42:00.768184 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.768050 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:00.786023 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:00.785948 2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" podStartSLOduration=1.7859317959999998 podStartE2EDuration="1.785931796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:41:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:42:00.784868697 +0000 UTC m=+2464.259705447" watchObservedRunningTime="2026-07-07 15:42:00.785931796 +0000 UTC m=+2464.260768544" Jul 07 15:42:02.710026 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:02.709997 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x88bq_ce46f22d-3634-4b1b-bbe9-d38925b54a45/dns/0.log" Jul 07 15:42:02.733900 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:02.733874 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-x88bq_ce46f22d-3634-4b1b-bbe9-d38925b54a45/kube-rbac-proxy/0.log" Jul 07 15:42:02.822471 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:02.822442 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pw298_b7e359fb-fdd2-4166-a0b6-859097b93e40/dns-node-resolver/0.log" Jul 07 15:42:03.385343 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:03.385294 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-c88c4f799-bsjsj_7abe3b37-5856-4cd4-acf1-a92a49ec2848/registry/0.log" Jul 07 15:42:03.409599 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:03.409570 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-crvz6_961c0f48-8801-47a4-8cb0-8f526398f88a/node-ca/0.log" Jul 07 15:42:04.568146 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:04.568114 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8697c578dd-2mwlt_a000aa1a-dccb-46fe-bdb5-88ee94724ced/kube-auth-proxy/0.log" Jul 07 15:42:05.496736 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:05.496686 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5kc47_0dbaa6cc-65a4-4ef0-989c-811bae822b8f/serve-healthcheck-canary/0.log" Jul 07 15:42:06.155887 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:06.155860 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zhpzx_511374b0-e4f6-4212-90da-0654203828b2/kube-rbac-proxy/0.log" Jul 07 15:42:06.180054 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:06.180028 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zhpzx_511374b0-e4f6-4212-90da-0654203828b2/exporter/0.log" Jul 07 15:42:06.206453 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:06.206420 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zhpzx_511374b0-e4f6-4212-90da-0654203828b2/extractor/0.log" Jul 07 15:42:06.790011 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:06.789983 2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hkchs/perf-node-gather-daemonset-hct74" Jul 07 15:42:08.701738 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:08.701712 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-b6pkm_59d6c10e-4db6-406d-8bfd-f1087111e87c/manager/0.log" Jul 07 15:42:09.319290 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:09.319250 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845dc9964f-7sd66_933e75bd-9c1a-4c3c-8e91-41a127689085/manager/0.log" Jul 07 15:42:09.345465 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:09.345431 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-845dc9964f-7sd66_933e75bd-9c1a-4c3c-8e91-41a127689085/copy-manifests/0.log" Jul 07 15:42:10.551615 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:10.551535 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8697c578dd-2mwlt_a000aa1a-dccb-46fe-bdb5-88ee94724ced/kube-auth-proxy/0.log" Jul 07 15:42:10.923503 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:10.923478 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d59ff9cf9-lrz9f_398c5e10-8688-402a-9dc4-c90dfa7a3f9a/manager/0.log" Jul 07 15:42:10.950145 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:10.950109 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-cpp8q_1e9c3f63-4447-4138-a8cf-d4ddbdcc1251/openshift-lws-operator/0.log" Jul 07 15:42:12.153045 ip-10-0-142-14 kubenswrapper[2580]: I0707 15:42:12.153018 2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8697c578dd-2mwlt_a000aa1a-dccb-46fe-bdb5-88ee94724ced/kube-auth-proxy/0.log"