Jul 03 11:12:26.004316 ip-10-0-141-129 systemd[1]: Starting Kubernetes Kubelet...
Jul 03 11:12:26.466515 ip-10-0-141-129 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 11:12:26.466515 ip-10-0-141-129 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 03 11:12:26.466515 ip-10-0-141-129 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 11:12:26.466515 ip-10-0-141-129 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 03 11:12:26.466515 ip-10-0-141-129 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 03 11:12:26.467482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.467396    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 03 11:12:26.471748 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471729    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 11:12:26.471748 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471748    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471753    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471757    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471759    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471762    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471765    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471767    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471772    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471776    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471779    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471782    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471788    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471791    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471794    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471797    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471799    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471802    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471804    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471807    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 11:12:26.471842 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471809    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471812    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471815    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471817    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471821    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471824    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471827    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471830    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471832    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471835    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471837    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471839    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471842    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471844    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471847    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471850    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471853    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471855    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471859    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 11:12:26.472312 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471861    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471863    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471866    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471868    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471871    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471875    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471878    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471882    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471884    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471887    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471889    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471892    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471894    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471896    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471899    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471902    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471905    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471907    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471910    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471912    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 11:12:26.472764 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471915    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471917    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471919    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471922    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471924    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471926    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471929    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471931    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471934    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471936    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471938    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471941    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471943    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471947    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471949    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471952    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471954    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471956    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471959    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471961    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 11:12:26.473290 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471964    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471966    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471968    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471971    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471973    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471976    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471978    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.471983    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472001    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472004    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472006    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472009    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472011    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472014    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472017    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472019    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472022    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472024    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472027    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472029    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 11:12:26.473856 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472753    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472760    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472763    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472766    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472769    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472772    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472775    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472778    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472780    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472783    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472785    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472788    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472790    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472792    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472795    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472797    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472800    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472802    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472805    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 11:12:26.474392 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472808    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472812    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472816    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472819    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472822    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472825    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472827    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472830    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472832    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472834    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472837    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472840    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472844    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472847    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472850    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472855    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472859    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472861    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472864    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 11:12:26.474863 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472867    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472870    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472873    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472876    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472879    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472881    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472884    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472887    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472890    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472892    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472894    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472897    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472899    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472902    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472905    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472907    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472910    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472912    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472914    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472917    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 11:12:26.475364 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472919    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472921    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472924    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472926    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472929    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472931    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472933    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472936    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472938    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472941    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472945    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472947    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472950    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472953    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472955    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472957    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472960    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472962    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472964    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 11:12:26.475854 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472967    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472969    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472972    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472974    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472977    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472979    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.472982    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473002    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473005    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473008    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473010    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473013    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473015    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473018    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473020    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473023    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473025    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473028    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473030    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473033    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 11:12:26.476438 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473036    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473038    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473417    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473422    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473425    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473427    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473430    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473433    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473436    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473438    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473441    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473443    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473446    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473448    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473451    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473453    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473456    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473458    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473464    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 11:12:26.476945 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473467    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473471    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473475    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473478    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473481    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473484    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473499    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473502    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473505    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473522    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473526    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473528    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473532    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473536    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473539    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473542    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473545    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473547    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473550    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 11:12:26.477448 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473552    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473555    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473558    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473561    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473564    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473567    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473569    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473572    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473574    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473577    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473579    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473582    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473586    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473589    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473591    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473595    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473597    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473600    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473602    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473605    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 11:12:26.477931 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473608    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473610    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473613    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473615    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473619    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473623    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473626    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473629    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473632    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473635    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473638    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473640    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473643    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473646    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473648    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473651    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473654    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473657    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473660    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473662    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 11:12:26.478439 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473665    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473667    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473670    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473672    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473676    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473679    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473681    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473684    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473687    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473689    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473692    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473694    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473697    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473699    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473702    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473704    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473707    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473709    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473712    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473714    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 11:12:26.478921 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473717    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473719    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.473722    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473793    2582 flags.go:64] FLAG: --address="0.0.0.0"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473800    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473806    2582 flags.go:64] FLAG: --anonymous-auth="true"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473810    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473816    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473819    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473823    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473828    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473831    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473834    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473837    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473840    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473844    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473848    2582 flags.go:64] FLAG: --cgroup-root=""
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473851    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473854    2582 flags.go:64] FLAG: --client-ca-file=""
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473857    2582 flags.go:64] FLAG: --cloud-provider="external"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473860    2582 flags.go:64] FLAG: --cluster-dns="[]"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473865    2582 flags.go:64] FLAG: --cluster-domain=""
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473868    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473871    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 03 11:12:26.479408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473874    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473877    2582 flags.go:64] FLAG: --container-log-max-files="5"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473881    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473885    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473888    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473891    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473894    2582 flags.go:64] FLAG: --contention-profiling="false"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473896    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473899    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473903    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473905    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473910    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473913    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473915    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473918    2582 flags.go:64] FLAG: --enable-load-reader="false"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473923    2582 flags.go:64] FLAG: --enable-server="true"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473927    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473931    2582 flags.go:64] FLAG: --event-burst="100"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473934    2582 flags.go:64] FLAG: --event-qps="50"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473937    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473940    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473942    2582 flags.go:64] FLAG: --eviction-hard=""
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473946    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473949    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473952    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 03 11:12:26.480032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473955    2582 flags.go:64] FLAG: --eviction-soft=""
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473958    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473960    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473963    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473966    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473969    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473971    2582 flags.go:64] FLAG: --fail-swap-on="true"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473974    2582 flags.go:64] FLAG: --feature-gates=""
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473978    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473981    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.473984    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474002    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474005    2582 flags.go:64] FLAG: --healthz-port="10248"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474008    2582 flags.go:64] FLAG: --help="false"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474010    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474013    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474016    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474019    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474023    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474026    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474029    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474031    2582 flags.go:64] FLAG: --image-service-endpoint=""
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474035    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 03 11:12:26.480653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474038    2582 flags.go:64] FLAG: --kube-api-burst="100"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474042    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474045    2582 flags.go:64] FLAG: --kube-api-qps="50"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474048    2582 flags.go:64] FLAG: --kube-reserved=""
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474050    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474053    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474056    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474059    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474062    2582 flags.go:64] FLAG: --lock-file=""
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474064    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474067    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474070    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474076    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474079    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474082    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474084    2582 flags.go:64] FLAG: --logging-format="text"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474087    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474090    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474093    2582 flags.go:64] FLAG: --manifest-url=""
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474096    2582 flags.go:64] FLAG: --manifest-url-header=""
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474103    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474106    2582 flags.go:64] FLAG: --max-open-files="1000000"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474111    2582 flags.go:64] FLAG: --max-pods="110"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474114    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474117    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 03 11:12:26.481261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474120    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474124    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474127    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474129    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474132    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474139    2582 flags.go:64] FLAG: --node-status-max-images="50"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474144    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474147    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474150    2582 flags.go:64] FLAG: --pod-cidr=""
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474153    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474159    2582 flags.go:64] FLAG: --pod-manifest-path=""
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474162    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474165    2582 flags.go:64] FLAG: --pods-per-core="0"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474168    2582 flags.go:64] FLAG: --port="10250"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474171    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474174    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bf7cc0f9a406f41d"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474177    2582 flags.go:64] FLAG: --qos-reserved=""
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474181    2582 flags.go:64] FLAG: --read-only-port="10255"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474183    2582 flags.go:64] FLAG: --register-node="true"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474186    2582 flags.go:64] FLAG: --register-with-taints=""
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474190    2582 flags.go:64] FLAG: --registry-burst="10"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474193    2582 flags.go:64] FLAG: --registry-qps="5"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474196    2582 flags.go:64] FLAG: --reserved-cpus=""
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474198    2582 flags.go:64] FLAG: --reserved-memory=""
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474202    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 03 11:12:26.481871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474205    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474209    2582 flags.go:64] FLAG: --rotate-certificates="false"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474211    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474215    2582 flags.go:64] FLAG: --runonce="false"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474217    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474220    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474223    2582 flags.go:64] FLAG: --seccomp-default="false"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474226    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474228    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474231    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474234    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474237    2582 flags.go:64] FLAG: --storage-driver-password="root"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474240    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474244    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474247    2582 flags.go:64] FLAG: --storage-driver-user="root"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474250    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474253    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474256    2582 flags.go:64] FLAG: --system-cgroups=""
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474259    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474264    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474267    2582 flags.go:64] FLAG: --tls-cert-file=""
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474270    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474274    2582 flags.go:64] FLAG: --tls-min-version=""
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474277    2582 flags.go:64] FLAG: --tls-private-key-file=""
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474280    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 03 11:12:26.482498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474283    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474286    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474289    2582 flags.go:64] FLAG: --v="2"
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474293    2582 flags.go:64] FLAG: --version="false"
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474297    2582 flags.go:64] FLAG: --vmodule=""
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474301    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474304    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474417    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474421    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474424    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474427    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474429    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474432    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474435    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474437    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474440    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474442    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474444    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474447    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474449    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474455    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 11:12:26.483137 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474458    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474460    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474463    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474465    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474468    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474471    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474474    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474476    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474479    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474483    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474485    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474488    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474490    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474493    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474495    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474498    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474500    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474504    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474507    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 11:12:26.483651 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474510    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474513    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474515    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474518    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474520    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474524    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474528    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474530    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474533    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474535    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474538    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474540    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474543    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474547    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474549    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474552    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474554    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474557    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474560    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 11:12:26.484205 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474563    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474565    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474568    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474571    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474574    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474576    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474579    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474582    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474584    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474587    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474589    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474591    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474594    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474597    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474599    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474601    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474604    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474607    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474610    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 11:12:26.484685 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474612    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474614    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474617    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474619    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474622    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474624    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474628    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474631    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474633    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474636    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474638    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474640    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474644    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474648    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474651    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474654    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474658    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474661    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474664    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474666    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 11:12:26.485158 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474669    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474672    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474674    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474677    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474679    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474682    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474684    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.474686    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.474695    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.481626    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.481643    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.482463    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.482470    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482527    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482533    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 11:12:26.485674 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482536    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482539    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482542    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482545    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482547    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482550    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482552    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482555    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482558    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482560    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482564    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482566    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482569    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482571    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482574    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482576    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482579    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482582    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482584    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482587    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 11:12:26.486223 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482589    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482592    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482594    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482597    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482599    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482602    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482605    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482608    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482611    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482614    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482616    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482619    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482622    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482625    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482627    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482630    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482632    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482635    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482637    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482640    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 11:12:26.486928 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482642    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482645    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482647    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482650    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482653    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482655    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482659    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482662    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482666    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482669    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482671    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482674    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482676    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482679    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482682    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482685    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482687    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482690    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482693    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482695    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 11:12:26.487642 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482698    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482700    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482704    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482708    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482711    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482714    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482717    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482720    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482722    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482725    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482727    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482730    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482732    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482735    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482737    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482740    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482743    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482746    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482749    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 11:12:26.488186 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482752    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482754    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482757    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482759    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482762    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482764    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482767    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482770    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482773    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482775    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482779    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482788    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482792    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482794    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482797    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482801    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482804    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 11:12:26.488656 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482807    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.482813    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482928    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482933    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482936    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482939    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482943    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482946    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482949    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482952    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482954    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482957    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482959    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482963    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 03 11:12:26.489254 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482965    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482968    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482971    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482973    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482975    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482978    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482980    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482982    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.482996    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483000    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483003    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483007    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483010    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483013    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483016    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483018    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483021    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483024    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483026    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483029    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 03 11:12:26.489607 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483031    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483034    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483036    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483039    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483041    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483044    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483046    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483049    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483051    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483054    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483056    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483059    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483062    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483065    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483067    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483070    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483072    2582 feature_gate.go:328] unrecognized feature gate: Example
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483074    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483077    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 03 11:12:26.490127 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483081    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483084    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483087    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483091    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483094    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483097    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483100    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483102    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483105    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483108    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483110    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483113    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483115    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483117    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483120    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483122    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483125    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483127    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483129    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483132    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 03 11:12:26.490878 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483134    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483136    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483139    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483142    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483144    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483147    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483150    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483152    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483155    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483157    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483159    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483162    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483164    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483167    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483169    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483172    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483175    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483177    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483180    2582 feature_gate.go:328] unrecognized feature gate: Example2
Jul 03 11:12:26.491584 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483182    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483185    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483187    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483190    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483192    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483194    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483197    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483199    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:26.483202    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.483207    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.483321    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.486745    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.488951    2582 server.go:1019] "Starting client certificate rotation"
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.489030    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 11:12:26.492132 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.489078    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 03 11:12:26.492537 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.491729    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 11:12:26.492911 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.492888    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 03 11:12:26.505066 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.505045    2582 log.go:25] "Validated CRI v1 runtime API"
Jul 03 11:12:26.507311 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.507291    2582 log.go:25] "Validated CRI v1 image API"
Jul 03 11:12:26.508688 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.508670    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 03 11:12:26.512707 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.512681    2582 fs.go:135] Filesystem UUIDs: map[3b4f34da-d133-4a51-9a11-4f05c946c71f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 83a6bb84-36ea-49f3-a6dc-66c520cd7ea6:/dev/nvme0n1p3]
Jul 03 11:12:26.512777 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.512707    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 03 11:12:26.515170 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.515153    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 11:12:26.519087 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.518945    2582 manager.go:216] Machine: {Timestamp:2026-07-03 11:12:26.517507687 +0000 UTC m=+0.372862454 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3082171 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22ed9a35d10fe978a8a9484d205be7 SystemUUID:ec22ed9a-35d1-0fe9-78a8-a9484d205be7 BootID:44ac0a21-cca7-419a-9dfd-01b947830058 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:6a:6c:c8:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:6a:6c:c8:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:f7:d2:b9:2c:f7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 03 11:12:26.519087 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.519075    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 03 11:12:26.519221 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.519210    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 03 11:12:26.523143 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.523112    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 03 11:12:26.523289 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.523146    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 03 11:12:26.524975 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.524964    2582 topology_manager.go:138] "Creating topology manager with none policy"
Jul 03 11:12:26.525029 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.524978    2582 container_manager_linux.go:309] "Creating device plugin manager"
Jul 03 11:12:26.525029 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.524999    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 11:12:26.525029 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.525013    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 03 11:12:26.526655 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.526644    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 03 11:12:26.530026 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530013    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 11:12:26.530156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530147    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 03 11:12:26.530193 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530180    2582 kubelet.go:486] "Attempting to sync node with API server"
Jul 03 11:12:26.530193 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530191    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 03 11:12:26.530294 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530207    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 03 11:12:26.530294 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530216    2582 kubelet.go:398] "Adding apiserver pod source"
Jul 03 11:12:26.530294 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530225    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 03 11:12:26.530620 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530607    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 11:12:26.530659 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.530633    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 03 11:12:26.532887 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.532872    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 03 11:12:26.534918 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.534904    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 03 11:12:26.534965 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.534936    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 03 11:12:26.536767 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536753    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 03 11:12:26.536810 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536778    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 03 11:12:26.536810 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536789    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 03 11:12:26.536810 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536797    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 03 11:12:26.536810 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536809    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 03 11:12:26.536977 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536827    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 03 11:12:26.536977 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536840    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 03 11:12:26.536977 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536848    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 03 11:12:26.536977 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536857    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 03 11:12:26.536977 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536865    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 03 11:12:26.536977 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536877    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 03 11:12:26.536977 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.536885    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 03 11:12:26.537724 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.537708    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 03 11:12:26.537724 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.537722    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 03 11:12:26.540354 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.540325    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v7d94"
Jul 03 11:12:26.542575 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.542556    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 03 11:12:26.543285 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.543269    2582 server.go:1268] "Started kubelet"
Jul 03 11:12:26.543363 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.543324    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 03 11:12:26.543430 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.543377    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 03 11:12:26.543477 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.543454    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 03 11:12:26.544170 ip-10-0-141-129 systemd[1]: Started Kubernetes Kubelet.
Jul 03 11:12:26.545481 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.545465    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 03 11:12:26.545637 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.545624    2582 server.go:310] "Adding debug handlers to kubelet server"
Jul 03 11:12:26.546294 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.546278    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-v7d94"
Jul 03 11:12:26.547492 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.547470    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 03 11:12:26.547562 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.547471    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 03 11:12:26.549568 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.549547    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 03 11:12:26.551863 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.550514    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-129.ec2.internal.18bec337b6d3ab32  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-129.ec2.internal,UID:ip-10-0-141-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-129.ec2.internal,},FirstTimestamp:2026-07-03 11:12:26.543237938 +0000 UTC m=+0.398592705,LastTimestamp:2026-07-03 11:12:26.543237938 +0000 UTC m=+0.398592705,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-129.ec2.internal,}"
Jul 03 11:12:26.552195 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.552173    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 03 11:12:26.552310 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.552196    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 03 11:12:26.552310 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.552258    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:26.553155 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.553135    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 03 11:12:26.553155 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.553155    2582 factory.go:55] Registering systemd factory
Jul 03 11:12:26.553312 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.553165    2582 factory.go:223] Registration of the systemd container factory successfully
Jul 03 11:12:26.553312 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.553163    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 03 11:12:26.554037 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.553981    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 03 11:12:26.554147 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.554132    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 03 11:12:26.554250 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.554077    2582 factory.go:153] Registering CRI-O factory
Jul 03 11:12:26.554250 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.554176    2582 factory.go:223] Registration of the crio container factory successfully
Jul 03 11:12:26.554250 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.554201    2582 factory.go:103] Registering Raw factory
Jul 03 11:12:26.554250 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.554214    2582 manager.go:1196] Started watching for new ooms in manager
Jul 03 11:12:26.554250 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.554246    2582 reconstruct.go:97] "Volume reconstruction finished"
Jul 03 11:12:26.554429 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.554254    2582 reconciler.go:29] "Reconciler: start to sync state"
Jul 03 11:12:26.555501 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.555486    2582 manager.go:349] Starting recovery of all containers
Jul 03 11:12:26.560261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.560235    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 11:12:26.567037 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.567014    2582 manager.go:354] Recovery completed
Jul 03 11:12:26.567398 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.567376    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-129.ec2.internal\" not found" node="ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.571581 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.571566    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 11:12:26.573459 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.573443    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 11:12:26.573528 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.573478    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 11:12:26.573528 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.573489    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID"
Jul 03 11:12:26.574008 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.573982    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 03 11:12:26.574079 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.574008    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 03 11:12:26.574079 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.574029    2582 state_mem.go:36] "Initialized new in-memory state store"
Jul 03 11:12:26.574079 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.574036    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 11:12:26.574812 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.574794    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 11:12:26.574889 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.574823    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 11:12:26.574889 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.574834    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID"
Jul 03 11:12:26.575647 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.575635    2582 policy_none.go:49] "None policy: Start"
Jul 03 11:12:26.575680 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.575652    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 03 11:12:26.575680 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.575664    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 03 11:12:26.577221 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.577210    2582 policy_none.go:47] "Start"
Jul 03 11:12:26.611810 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.611620    2582 manager.go:337] "Starting Device Plugin manager"
Jul 03 11:12:26.611934 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.611850    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 03 11:12:26.611934 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.611864    2582 server.go:87] "Starting device plugin registration server"
Jul 03 11:12:26.612179 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.612166    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 03 11:12:26.612232 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.612181    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 03 11:12:26.612313 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.612278    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 03 11:12:26.612405 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.612355    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 03 11:12:26.612405 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.612366    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 03 11:12:26.612954 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.612934    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 03 11:12:26.613067 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.612982    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:26.712384 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.712358    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 11:12:26.714066 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.713357    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 11:12:26.714066 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.713393    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 11:12:26.714066 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.713403    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID"
Jul 03 11:12:26.714066 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.713443    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.714275 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.714243    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 03 11:12:26.715713 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.715689    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 03 11:12:26.715838 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.715737    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 03 11:12:26.715838 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.715767    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 03 11:12:26.715838 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.715807    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 03 11:12:26.718390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.718332    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 11:12:26.719961 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.719947    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.720046 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.719968    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-129.ec2.internal\": node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:26.748954 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.748921    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:26.816424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.816377    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal"]
Jul 03 11:12:26.816583 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.816502    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 11:12:26.818378 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.818350    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 11:12:26.818483 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.818386    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 11:12:26.818483 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.818400    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID"
Jul 03 11:12:26.819945 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.819928    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 11:12:26.820061 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.820046    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.820109 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.820078    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 11:12:26.821628 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.821606    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 11:12:26.821628 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.821625    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 11:12:26.821754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.821637    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 11:12:26.821754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.821647    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 11:12:26.821754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.821658    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID"
Jul 03 11:12:26.821754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.821649    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID"
Jul 03 11:12:26.823181 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.823162    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.823269 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.823190    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 03 11:12:26.825429 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.825411    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientMemory"
Jul 03 11:12:26.825525 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.825444    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasNoDiskPressure"
Jul 03 11:12:26.825525 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.825459    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeHasSufficientPID"
Jul 03 11:12:26.845881 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.845854    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-129.ec2.internal\" not found" node="ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.849055 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.849033    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:26.850549 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.850533    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-129.ec2.internal\" not found" node="ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.856899 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.856881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a862d27acdd6adcd1a30a65484081bd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-129.ec2.internal\" (UID: \"4a862d27acdd6adcd1a30a65484081bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.856973 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.856906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/831aa4a8e60ac1bafce8327f1e975c1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"831aa4a8e60ac1bafce8327f1e975c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.856973 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.856924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/831aa4a8e60ac1bafce8327f1e975c1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"831aa4a8e60ac1bafce8327f1e975c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.949397 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:26.949360    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:26.957251 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.957228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/831aa4a8e60ac1bafce8327f1e975c1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"831aa4a8e60ac1bafce8327f1e975c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.957317 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.957257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/831aa4a8e60ac1bafce8327f1e975c1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"831aa4a8e60ac1bafce8327f1e975c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.957317 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.957275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a862d27acdd6adcd1a30a65484081bd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-129.ec2.internal\" (UID: \"4a862d27acdd6adcd1a30a65484081bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.957317 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.957277    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/831aa4a8e60ac1bafce8327f1e975c1a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"831aa4a8e60ac1bafce8327f1e975c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.957412 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.957321    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a862d27acdd6adcd1a30a65484081bd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-129.ec2.internal\" (UID: \"4a862d27acdd6adcd1a30a65484081bd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:26.957412 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:26.957336    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/831aa4a8e60ac1bafce8327f1e975c1a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal\" (UID: \"831aa4a8e60ac1bafce8327f1e975c1a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:27.049917 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:27.049848    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:27.149484 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:27.149434    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:27.150523 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:27.150507    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:27.154504 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:27.154489    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:28.629304 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:28.629266    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:28.729846 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:28.729765    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:28.830335 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:28.830302    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:28.865740 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:28.865706    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 03 11:12:28.866197 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:28.865873    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 11:12:28.866197 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:28.865894    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 03 11:12:28.930417 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:28.930374    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:28.931587 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:28.931540    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-02 11:07:27 +0000 UTC" deadline="2027-12-04 00:55:40.88805442 +0000 UTC"
Jul 03 11:12:28.931587 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:28.931587    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12445h43m11.956471169s"
Jul 03 11:12:28.997749 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:28.997631    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 11:12:29.031554 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:29.031508    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:29.051609 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:29.051564    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a862d27acdd6adcd1a30a65484081bd.slice/crio-e4b313dc93394452da2548befd7be77160e74f891f104095ac83a6fddd4eaddd WatchSource:0}: Error finding container e4b313dc93394452da2548befd7be77160e74f891f104095ac83a6fddd4eaddd: Status 404 returned error can't find the container with id e4b313dc93394452da2548befd7be77160e74f891f104095ac83a6fddd4eaddd
Jul 03 11:12:29.051976 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:29.051936    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod831aa4a8e60ac1bafce8327f1e975c1a.slice/crio-5a4bc6b9d2ffc653935e036d699a7a15f781109ebd69a75f50d1c4e2892bb00a WatchSource:0}: Error finding container 5a4bc6b9d2ffc653935e036d699a7a15f781109ebd69a75f50d1c4e2892bb00a: Status 404 returned error can't find the container with id 5a4bc6b9d2ffc653935e036d699a7a15f781109ebd69a75f50d1c4e2892bb00a
Jul 03 11:12:29.057507 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.057470    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 11:12:29.098517 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.098431    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" event={"ID":"831aa4a8e60ac1bafce8327f1e975c1a","Type":"ContainerStarted","Data":"5a4bc6b9d2ffc653935e036d699a7a15f781109ebd69a75f50d1c4e2892bb00a"}
Jul 03 11:12:29.099793 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.099753    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" event={"ID":"4a862d27acdd6adcd1a30a65484081bd","Type":"ContainerStarted","Data":"e4b313dc93394452da2548befd7be77160e74f891f104095ac83a6fddd4eaddd"}
Jul 03 11:12:29.132117 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:29.132044    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-129.ec2.internal\" not found"
Jul 03 11:12:29.196994 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.196972    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 11:12:29.231030 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.230990    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:29.241086 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.241049    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 11:12:29.242152 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.242135    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal"
Jul 03 11:12:29.252742 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.252663    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 03 11:12:29.754099 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.754057    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 11:12:29.909880 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.909845    2582 apiserver.go:52] "Watching apiserver"
Jul 03 11:12:29.919896 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.919867    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 03 11:12:29.920387 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.920361    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-t9rjx","kube-system/global-pull-secret-syncer-xnf6q","kube-system/konnectivity-agent-2cpnn","openshift-image-registry/node-ca-sfpc6","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal","openshift-multus/multus-fpmrz","openshift-network-diagnostics/network-check-target-zzdfx","openshift-network-operator/iptables-alerter-9l22r","openshift-ovn-kubernetes/ovnkube-node-6qfx4","kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26","openshift-cluster-node-tuning-operator/tuned-8qfxx","openshift-dns/node-resolver-9kk7g","openshift-multus/multus-additional-cni-plugins-td5zc"]
Jul 03 11:12:29.922547 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.922517    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:29.922668 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:29.922621    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:29.924130 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.924109    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:29.925368 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.925336    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:29.926695 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.926671    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 03 11:12:29.926958 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.926942    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v74bj\""
Jul 03 11:12:29.927230 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.927217    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 03 11:12:29.927409 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.927394    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 03 11:12:29.927911 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.927895    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 03 11:12:29.928002 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.927959    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l6gcs\""
Jul 03 11:12:29.928118 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.928098    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 03 11:12:29.928278 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.928149    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:29.928542 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.928521    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.930131 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.930054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.930447 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.930429    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 03 11:12:29.931026 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.930954    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 03 11:12:29.931026 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.930960    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 03 11:12:29.931278 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.931264    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-znzw9\""
Jul 03 11:12:29.931344 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.931298    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 03 11:12:29.931344 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.931307    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 03 11:12:29.931438 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.931357    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 03 11:12:29.931438 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.931367    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 03 11:12:29.931590 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.931576    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 03 11:12:29.932471 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.932054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.932471 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.932142    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 03 11:12:29.932638 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.932516    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-57wjb\""
Jul 03 11:12:29.932701 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.932653    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 03 11:12:29.932756 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.932704    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-76nlv\""
Jul 03 11:12:29.934160 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.934143    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 03 11:12:29.934376 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.934358    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 03 11:12:29.934628 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.934610    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 03 11:12:29.934716 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.934639    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 03 11:12:29.934788 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.934751    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 03 11:12:29.934878 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.934859    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:29.936015 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.935976    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 03 11:12:29.936141 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.936131    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-925q4\""
Jul 03 11:12:29.936893 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.936873    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:29.936989 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:29.936957    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:29.937412 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.937382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z4ppc\""
Jul 03 11:12:29.937491 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.937414    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 03 11:12:29.937647 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.937632    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 03 11:12:29.938476 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.938460    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:29.940715 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.940697    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:29.940842 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:29.940821    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:29.941306 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.941292    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 03 11:12:29.941447 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.941429    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 03 11:12:29.941541 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.941528    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 03 11:12:29.941794 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.941777    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m2dt2\""
Jul 03 11:12:29.942309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.942288    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 03 11:12:29.943713 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.943163    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:29.945249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.944914    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-slash\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.945249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.944947    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-registration-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:29.945249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.944974    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-system-cni-dir\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.945249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945009    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-os-release\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.945249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovnkube-config\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.945249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945123    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-socket-dir-parent\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.945249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945147    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-systemd\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.945249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4p5n\" (UniqueName: \"kubernetes.io/projected/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-kube-api-access-f4p5n\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.945706 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945684    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-k8s-cni-cncf-io\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.945829 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945703    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 03 11:12:29.945829 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-netns\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.945829 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945787    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-multus-certs\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.945829 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-etc-kubernetes\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.946093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4lr7\" (UniqueName: \"kubernetes.io/projected/2018a72c-f3d3-4507-b073-e52a336911ed-kube-api-access-v4lr7\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:29.946093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.946093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-log-socket\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.946093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.945961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-env-overrides\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.946093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovn-node-metrics-cert\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.946342 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946097    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-kubelet\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.946342 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:29.946342 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946199    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnjkm\" (UniqueName: \"kubernetes.io/projected/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-kube-api-access-hnjkm\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:29.946342 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946237    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-var-lib-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.946342 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da462a2b-e560-4bf0-820a-e35651982e4d-agent-certs\") pod \"konnectivity-agent-2cpnn\" (UID: \"da462a2b-e560-4bf0-820a-e35651982e4d\") " pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:29.946342 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946301    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-daemon-config\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.946342 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-serviceca\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:29.946655 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-cni-netd\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.946655 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946399    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovnkube-script-lib\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.946655 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-host\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:29.946655 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946489    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-cnibin\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.946655 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-cni-binary-copy\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.946655 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.946926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946660    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:29.946926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da462a2b-e560-4bf0-820a-e35651982e4d-konnectivity-ca\") pod \"konnectivity-agent-2cpnn\" (UID: \"da462a2b-e560-4bf0-820a-e35651982e4d\") " pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:29.946926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.946926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtrkj\" (UniqueName: \"kubernetes.io/projected/500de5a7-48d1-46bb-b9ec-deaf2df68351-kube-api-access-jtrkj\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.946926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946797    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qtl57\""
Jul 03 11:12:29.946926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-kubelet\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.946926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-system-cni-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.946926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-cnibin\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.947284 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.946563    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 03 11:12:29.947373 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947349    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-cni-bin\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.947463 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947397    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-ovn\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.947463 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-node-log\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.947565 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-hostroot\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.947565 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947537    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-device-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:29.947653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.947653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947617    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bb5k\" (UniqueName: \"kubernetes.io/projected/58604249-cb76-4e50-93d9-0e291df1d27d-kube-api-access-2bb5k\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:29.947653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-systemd-units\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.947788 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947688    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.947788 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947722    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.947788 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-conf-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.947788 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-socket-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:29.947958 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947803    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-sys-fs\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:29.947958 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.947830    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-etc-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.948145 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.948124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-cni-bin\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.948245 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.948200    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-os-release\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.948308 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.948283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:29.948416 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.948369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-run-netns\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:29.948416 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.948393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-cni-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.948525 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.948439    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/500de5a7-48d1-46bb-b9ec-deaf2df68351-cni-binary-copy\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.948525 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.948472    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-cni-multus\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:29.962635 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.962605    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpmz6"
Jul 03 11:12:29.972517 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:29.972467    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hpmz6"
Jul 03 11:12:30.032829 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.032704    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 03 11:12:30.049558 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049519    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-slash\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.049558 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049561    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-registration-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.049813 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049582    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-system-cni-dir\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.049813 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049645    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-slash\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.049813 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049717    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-registration-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.049813 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049696    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-system-cni-dir\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.049813 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-os-release\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovnkube-config\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-socket-dir-parent\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-modprobe-d\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd55c844-b0ae-410d-9462-8f799423de81-etc-tuned\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-systemd\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4p5n\" (UniqueName: \"kubernetes.io/projected/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-kube-api-access-f4p5n\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049923    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-os-release\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-k8s-cni-cncf-io\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-netns\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049990    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-k8s-cni-cncf-io\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.050005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.049997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-multus-certs\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050026    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-etc-kubernetes\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-host\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050055    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-systemd\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpd4h\" (UniqueName: \"kubernetes.io/projected/bd55c844-b0ae-410d-9462-8f799423de81-kube-api-access-qpd4h\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4lr7\" (UniqueName: \"kubernetes.io/projected/2018a72c-f3d3-4507-b073-e52a336911ed-kube-api-access-v4lr7\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-lib-modules\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-dbus\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050203    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-log-socket\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-env-overrides\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovn-node-metrics-cert\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-kubelet\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysctl-conf\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnjkm\" (UniqueName: \"kubernetes.io/projected/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-kube-api-access-hnjkm\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:30.050568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-var-lib-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da462a2b-e560-4bf0-820a-e35651982e4d-agent-certs\") pod \"konnectivity-agent-2cpnn\" (UID: \"da462a2b-e560-4bf0-820a-e35651982e4d\") " pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-daemon-config\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050435    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd55c844-b0ae-410d-9462-8f799423de81-tmp\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67k4x\" (UniqueName: \"kubernetes.io/projected/47131d70-f689-4280-87eb-86dd8236e628-kube-api-access-67k4x\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050481    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-serviceca\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-cni-netd\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050550    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovnkube-script-lib\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcm66\" (UniqueName: \"kubernetes.io/projected/0db82fa3-1b75-465b-bd57-529f7c295e01-kube-api-access-wcm66\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050609    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysctl-d\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050633    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovnkube-config\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4ktp\" (UniqueName: \"kubernetes.io/projected/10789ed6-ffaa-4d36-949b-b0fc9814122f-kube-api-access-g4ktp\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050666    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-host\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050723    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-netns\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-cnibin\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050795    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-etc-kubernetes\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050800    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-cni-binary-copy\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.051309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050884    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10789ed6-ffaa-4d36-949b-b0fc9814122f-host-slash\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050911    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da462a2b-e560-4bf0-820a-e35651982e4d-konnectivity-ca\") pod \"konnectivity-agent-2cpnn\" (UID: \"da462a2b-e560-4bf0-820a-e35651982e4d\") " pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050934    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtrkj\" (UniqueName: \"kubernetes.io/projected/500de5a7-48d1-46bb-b9ec-deaf2df68351-kube-api-access-jtrkj\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-kubernetes\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051023    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-run\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.050772    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-run-multus-certs\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051194    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-cni-netd\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051214    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-serviceca\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051288    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051293    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-host\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051326    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-cnibin\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051452    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-socket-dir-parent\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051879    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/da462a2b-e560-4bf0-820a-e35651982e4d-konnectivity-ca\") pod \"konnectivity-agent-2cpnn\" (UID: \"da462a2b-e560-4bf0-820a-e35651982e4d\") " pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:30.051910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051896    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-cni-binary-copy\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.052587 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.052084    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.052587 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.052218    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-var-lib-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.052587 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.052296    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovnkube-script-lib\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.052738 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.052647    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.052929 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.052908    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-kubelet\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.052971    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/58604249-cb76-4e50-93d9-0e291df1d27d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.053103 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053042    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-log-socket\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.053103 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-daemon-config\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053264 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.051046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10789ed6-ffaa-4d36-949b-b0fc9814122f-iptables-alerter-script\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.053264 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-kubelet\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.053264 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-system-cni-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053264 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-cnibin\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053455 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053289    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-cni-bin\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053455 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-ovn\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.053455 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-node-log\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.053455 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-hostroot\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053455 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053392    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-kubelet\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.053455 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47131d70-f689-4280-87eb-86dd8236e628-hosts-file\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053457    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-env-overrides\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-system-cni-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-device-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053585    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-ovn\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053591    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-hostroot\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053591    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053641    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-cni-bin\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053642    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-cnibin\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053644    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bb5k\" (UniqueName: \"kubernetes.io/projected/58604249-cb76-4e50-93d9-0e291df1d27d-kube-api-access-2bb5k\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.053717 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053671    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-node-log\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053799    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-systemd-units\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053805    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-device-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053867    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053869    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-systemd-units\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-conf-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053912    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-run-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053950    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053997    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-conf-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.053962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-socket-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054031    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/58604249-cb76-4e50-93d9-0e291df1d27d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-sys-fs\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054065    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-etc-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054063    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-socket-dir\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-cni-bin\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-os-release\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.054156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054135    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-sys-fs\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054142    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-etc-openvswitch\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054172    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-sys\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054187    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-cni-bin\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-var-lib-kubelet\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054207    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-os-release\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054238    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-kubelet-config\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-run-netns\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054320    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-cni-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/500de5a7-48d1-46bb-b9ec-deaf2df68351-cni-binary-copy\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054362    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2018a72c-f3d3-4507-b073-e52a336911ed-etc-selinux\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysconfig\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054380    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-host-run-netns\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-systemd\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47131d70-f689-4280-87eb-86dd8236e628-tmp-dir\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054482    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-multus-cni-dir\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.054820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-cni-multus\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.055489 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:30.055489 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054576    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/500de5a7-48d1-46bb-b9ec-deaf2df68351-host-var-lib-cni-multus\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.055489 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.054875    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/500de5a7-48d1-46bb-b9ec-deaf2df68351-cni-binary-copy\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.055685 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.055665    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-ovn-node-metrics-cert\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.055824 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.055782    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/da462a2b-e560-4bf0-820a-e35651982e4d-agent-certs\") pod \"konnectivity-agent-2cpnn\" (UID: \"da462a2b-e560-4bf0-820a-e35651982e4d\") " pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:30.062217 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.062190    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 11:12:30.062217 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.062217    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 11:12:30.062399 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.062230    2582 projected.go:196] Error preparing data for projected volume kube-api-access-rr8xx for pod openshift-network-diagnostics/network-check-target-zzdfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:30.062399 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.062310    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx podName:d9e4134e-ffee-4194-8124-c8ba7bbd4d69 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:30.562273538 +0000 UTC m=+3.039545118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rr8xx" (UniqueName: "kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx") pod "network-check-target-zzdfx" (UID: "d9e4134e-ffee-4194-8124-c8ba7bbd4d69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:30.074549 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.065375    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnjkm\" (UniqueName: \"kubernetes.io/projected/1fbc07b6-c4eb-4376-b0e8-39ab43b33689-kube-api-access-hnjkm\") pod \"node-ca-sfpc6\" (UID: \"1fbc07b6-c4eb-4376-b0e8-39ab43b33689\") " pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:30.074549 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.065867    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4lr7\" (UniqueName: \"kubernetes.io/projected/2018a72c-f3d3-4507-b073-e52a336911ed-kube-api-access-v4lr7\") pod \"aws-ebs-csi-driver-node-62b26\" (UID: \"2018a72c-f3d3-4507-b073-e52a336911ed\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.074549 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.066907    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bb5k\" (UniqueName: \"kubernetes.io/projected/58604249-cb76-4e50-93d9-0e291df1d27d-kube-api-access-2bb5k\") pod \"multus-additional-cni-plugins-td5zc\" (UID: \"58604249-cb76-4e50-93d9-0e291df1d27d\") " pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.074549 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.067043    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtrkj\" (UniqueName: \"kubernetes.io/projected/500de5a7-48d1-46bb-b9ec-deaf2df68351-kube-api-access-jtrkj\") pod \"multus-fpmrz\" (UID: \"500de5a7-48d1-46bb-b9ec-deaf2df68351\") " pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.074549 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.067270    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4p5n\" (UniqueName: \"kubernetes.io/projected/aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd-kube-api-access-f4p5n\") pod \"ovnkube-node-6qfx4\" (UID: \"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.074549 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.071287    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 03 11:12:30.154903 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.154869    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd55c844-b0ae-410d-9462-8f799423de81-tmp\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.154903 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.154905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67k4x\" (UniqueName: \"kubernetes.io/projected/47131d70-f689-4280-87eb-86dd8236e628-kube-api-access-67k4x\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.155172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.154934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcm66\" (UniqueName: \"kubernetes.io/projected/0db82fa3-1b75-465b-bd57-529f7c295e01-kube-api-access-wcm66\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:30.155172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.154954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysctl-d\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4ktp\" (UniqueName: \"kubernetes.io/projected/10789ed6-ffaa-4d36-949b-b0fc9814122f-kube-api-access-g4ktp\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.155172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10789ed6-ffaa-4d36-949b-b0fc9814122f-host-slash\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.155172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-kubernetes\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-run\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10789ed6-ffaa-4d36-949b-b0fc9814122f-iptables-alerter-script\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47131d70-f689-4280-87eb-86dd8236e628-hosts-file\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155186    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10789ed6-ffaa-4d36-949b-b0fc9814122f-host-slash\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155217    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-run\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155216    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-kubernetes\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155222    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-sys\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-var-lib-kubelet\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-kubelet-config\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysconfig\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155363    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-var-lib-kubelet\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155377    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-systemd\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47131d70-f689-4280-87eb-86dd8236e628-tmp-dir\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155408    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-kubelet-config\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155423    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysctl-d\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155314    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-sys\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.155466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155288    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/47131d70-f689-4280-87eb-86dd8236e628-hosts-file\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-modprobe-d\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd55c844-b0ae-410d-9462-8f799423de81-etc-tuned\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155518    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-systemd\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-host\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpd4h\" (UniqueName: \"kubernetes.io/projected/bd55c844-b0ae-410d-9462-8f799423de81-kube-api-access-qpd4h\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-lib-modules\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155607    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-modprobe-d\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155616    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-dbus\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.155620    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155652    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-host\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155670    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysctl-conf\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.155710    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs podName:0db82fa3-1b75-465b-bd57-529f7c295e01 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:30.655678111 +0000 UTC m=+3.132949698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs") pod "network-metrics-daemon-t9rjx" (UID: "0db82fa3-1b75-465b-bd57-529f7c295e01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155774    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/47131d70-f689-4280-87eb-86dd8236e628-tmp-dir\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155829    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysctl-conf\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155879    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-dbus\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.156390 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155897    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-lib-modules\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.157269 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.155952    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd55c844-b0ae-410d-9462-8f799423de81-etc-sysconfig\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.157269 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.155954    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:30.157269 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.156010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10789ed6-ffaa-4d36-949b-b0fc9814122f-iptables-alerter-script\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.157269 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.156029    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret podName:e83fc8e8-4d70-4183-8d30-b0eaa07e8503 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:30.656012067 +0000 UTC m=+3.133283627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret") pod "global-pull-secret-syncer-xnf6q" (UID: "e83fc8e8-4d70-4183-8d30-b0eaa07e8503") : object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:30.158167 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.158146    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd55c844-b0ae-410d-9462-8f799423de81-etc-tuned\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.160838 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.160816    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd55c844-b0ae-410d-9462-8f799423de81-tmp\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.164584 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.164555    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4ktp\" (UniqueName: \"kubernetes.io/projected/10789ed6-ffaa-4d36-949b-b0fc9814122f-kube-api-access-g4ktp\") pod \"iptables-alerter-9l22r\" (UID: \"10789ed6-ffaa-4d36-949b-b0fc9814122f\") " pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.164918 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.164899    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67k4x\" (UniqueName: \"kubernetes.io/projected/47131d70-f689-4280-87eb-86dd8236e628-kube-api-access-67k4x\") pod \"node-resolver-9kk7g\" (UID: \"47131d70-f689-4280-87eb-86dd8236e628\") " pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.165402 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.165385    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcm66\" (UniqueName: \"kubernetes.io/projected/0db82fa3-1b75-465b-bd57-529f7c295e01-kube-api-access-wcm66\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:30.170135 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.170114    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpd4h\" (UniqueName: \"kubernetes.io/projected/bd55c844-b0ae-410d-9462-8f799423de81-kube-api-access-qpd4h\") pod \"tuned-8qfxx\" (UID: \"bd55c844-b0ae-410d-9462-8f799423de81\") " pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.244725 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.244682    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26"
Jul 03 11:12:30.254663 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.254637    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:30.264428 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.264399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sfpc6"
Jul 03 11:12:30.272556 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.272527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-td5zc"
Jul 03 11:12:30.279570 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.279544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fpmrz"
Jul 03 11:12:30.287591 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.287518    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:30.293644 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.293618    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9kk7g"
Jul 03 11:12:30.299780 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.299755    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9l22r"
Jul 03 11:12:30.304730 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.304706    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8qfxx"
Jul 03 11:12:30.658640 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.658555    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:30.658640 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.658599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:30.658640 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.658631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:30.658931 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.658733    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:30.658931 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.658776    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 11:12:30.658931 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.658796    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs podName:0db82fa3-1b75-465b-bd57-529f7c295e01 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:31.658780671 +0000 UTC m=+4.136052253 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs") pod "network-metrics-daemon-t9rjx" (UID: "0db82fa3-1b75-465b-bd57-529f7c295e01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:30.658931 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.658797    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 11:12:30.658931 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.658815    2582 projected.go:196] Error preparing data for projected volume kube-api-access-rr8xx for pod openshift-network-diagnostics/network-check-target-zzdfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:30.658931 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.658733    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:30.658931 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.658863    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx podName:d9e4134e-ffee-4194-8124-c8ba7bbd4d69 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:31.658848155 +0000 UTC m=+4.136119720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rr8xx" (UniqueName: "kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx") pod "network-check-target-zzdfx" (UID: "d9e4134e-ffee-4194-8124-c8ba7bbd4d69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:30.658931 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:30.658879    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret podName:e83fc8e8-4d70-4183-8d30-b0eaa07e8503 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:31.65887329 +0000 UTC m=+4.136144851 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret") pod "global-pull-secret-syncer-xnf6q" (UID: "e83fc8e8-4d70-4183-8d30-b0eaa07e8503") : object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:30.976316 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.976226    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 11:07:29 +0000 UTC" deadline="2028-02-03 08:04:47.499408787 +0000 UTC"
Jul 03 11:12:30.976316 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:30.976263    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13916h52m16.523150846s"
Jul 03 11:12:31.030472 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:31.030443    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58604249_cb76_4e50_93d9_0e291df1d27d.slice/crio-e77e79096875d998d608d3f77b0d5d2ee5602515ef8e7d0e73f99d4634cab33c WatchSource:0}: Error finding container e77e79096875d998d608d3f77b0d5d2ee5602515ef8e7d0e73f99d4634cab33c: Status 404 returned error can't find the container with id e77e79096875d998d608d3f77b0d5d2ee5602515ef8e7d0e73f99d4634cab33c
Jul 03 11:12:31.040339 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:31.040307    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2018a72c_f3d3_4507_b073_e52a336911ed.slice/crio-a5f86b2d0c36f14997c04367eb37e68e4d1a05c34ec09c805f9cd102d20585a9 WatchSource:0}: Error finding container a5f86b2d0c36f14997c04367eb37e68e4d1a05c34ec09c805f9cd102d20585a9: Status 404 returned error can't find the container with id a5f86b2d0c36f14997c04367eb37e68e4d1a05c34ec09c805f9cd102d20585a9
Jul 03 11:12:31.041111 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:31.041063    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47131d70_f689_4280_87eb_86dd8236e628.slice/crio-170d94881a023a3e9200dc5736aab41a0b27062e6b6863f71bb3a45e12fea36f WatchSource:0}: Error finding container 170d94881a023a3e9200dc5736aab41a0b27062e6b6863f71bb3a45e12fea36f: Status 404 returned error can't find the container with id 170d94881a023a3e9200dc5736aab41a0b27062e6b6863f71bb3a45e12fea36f
Jul 03 11:12:31.041953 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:31.041900    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10789ed6_ffaa_4d36_949b_b0fc9814122f.slice/crio-c81bd4023c0da9caf4cb1a11bcbb5a4c4d61e9b2d79b2c43ae74c79b5c9c4618 WatchSource:0}: Error finding container c81bd4023c0da9caf4cb1a11bcbb5a4c4d61e9b2d79b2c43ae74c79b5c9c4618: Status 404 returned error can't find the container with id c81bd4023c0da9caf4cb1a11bcbb5a4c4d61e9b2d79b2c43ae74c79b5c9c4618
Jul 03 11:12:31.044239 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:31.044215    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda462a2b_e560_4bf0_820a_e35651982e4d.slice/crio-957a59245a3a74bfcc8efc8cb9abdabc2df7f6d47903632d9f2570eaba1cd9c1 WatchSource:0}: Error finding container 957a59245a3a74bfcc8efc8cb9abdabc2df7f6d47903632d9f2570eaba1cd9c1: Status 404 returned error can't find the container with id 957a59245a3a74bfcc8efc8cb9abdabc2df7f6d47903632d9f2570eaba1cd9c1
Jul 03 11:12:31.044548 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:31.044511    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fbc07b6_c4eb_4376_b0e8_39ab43b33689.slice/crio-2bb324ad3617ea37e5b3a8e5d038b1fcfd34cb27ee7e0114d2249ed64e8777a9 WatchSource:0}: Error finding container 2bb324ad3617ea37e5b3a8e5d038b1fcfd34cb27ee7e0114d2249ed64e8777a9: Status 404 returned error can't find the container with id 2bb324ad3617ea37e5b3a8e5d038b1fcfd34cb27ee7e0114d2249ed64e8777a9
Jul 03 11:12:31.045458 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:31.045433    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500de5a7_48d1_46bb_b9ec_deaf2df68351.slice/crio-1db8d71a908ba726c958d5cb2d73d9af4236be5ac58f78e5c9d0b1b6c21b7eda WatchSource:0}: Error finding container 1db8d71a908ba726c958d5cb2d73d9af4236be5ac58f78e5c9d0b1b6c21b7eda: Status 404 returned error can't find the container with id 1db8d71a908ba726c958d5cb2d73d9af4236be5ac58f78e5c9d0b1b6c21b7eda
Jul 03 11:12:31.047440 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:12:31.047369    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd55c844_b0ae_410d_9462_8f799423de81.slice/crio-e0283829036e24a448431a8983eca17421d8ccef8abb9794d8465a30d67c5037 WatchSource:0}: Error finding container e0283829036e24a448431a8983eca17421d8ccef8abb9794d8465a30d67c5037: Status 404 returned error can't find the container with id e0283829036e24a448431a8983eca17421d8ccef8abb9794d8465a30d67c5037
Jul 03 11:12:31.095044 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.095017    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:31.095232 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.095136    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:31.104521 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.104360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26" event={"ID":"2018a72c-f3d3-4507-b073-e52a336911ed","Type":"ContainerStarted","Data":"a5f86b2d0c36f14997c04367eb37e68e4d1a05c34ec09c805f9cd102d20585a9"}
Jul 03 11:12:31.105521 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.105495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"51ea9bf0b2b699c875b6ecbe46501ebe8c5999f4bc63a671df396d7c656b3064"}
Jul 03 11:12:31.106598 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.106577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fpmrz" event={"ID":"500de5a7-48d1-46bb-b9ec-deaf2df68351","Type":"ContainerStarted","Data":"1db8d71a908ba726c958d5cb2d73d9af4236be5ac58f78e5c9d0b1b6c21b7eda"}
Jul 03 11:12:31.107640 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.107621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9kk7g" event={"ID":"47131d70-f689-4280-87eb-86dd8236e628","Type":"ContainerStarted","Data":"170d94881a023a3e9200dc5736aab41a0b27062e6b6863f71bb3a45e12fea36f"}
Jul 03 11:12:31.108673 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.108651    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sfpc6" event={"ID":"1fbc07b6-c4eb-4376-b0e8-39ab43b33689","Type":"ContainerStarted","Data":"2bb324ad3617ea37e5b3a8e5d038b1fcfd34cb27ee7e0114d2249ed64e8777a9"}
Jul 03 11:12:31.109637 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.109615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td5zc" event={"ID":"58604249-cb76-4e50-93d9-0e291df1d27d","Type":"ContainerStarted","Data":"e77e79096875d998d608d3f77b0d5d2ee5602515ef8e7d0e73f99d4634cab33c"}
Jul 03 11:12:31.110616 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.110580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8qfxx" event={"ID":"bd55c844-b0ae-410d-9462-8f799423de81","Type":"ContainerStarted","Data":"e0283829036e24a448431a8983eca17421d8ccef8abb9794d8465a30d67c5037"}
Jul 03 11:12:31.111602 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.111584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2cpnn" event={"ID":"da462a2b-e560-4bf0-820a-e35651982e4d","Type":"ContainerStarted","Data":"957a59245a3a74bfcc8efc8cb9abdabc2df7f6d47903632d9f2570eaba1cd9c1"}
Jul 03 11:12:31.112567 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.112550    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9l22r" event={"ID":"10789ed6-ffaa-4d36-949b-b0fc9814122f","Type":"ContainerStarted","Data":"c81bd4023c0da9caf4cb1a11bcbb5a4c4d61e9b2d79b2c43ae74c79b5c9c4618"}
Jul 03 11:12:31.666925 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.666832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:31.666925 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.666917    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:31.667192 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.666971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:31.667192 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.667123    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:31.667192 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.667189    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret podName:e83fc8e8-4d70-4183-8d30-b0eaa07e8503 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:33.667169359 +0000 UTC m=+6.144440944 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret") pod "global-pull-secret-syncer-xnf6q" (UID: "e83fc8e8-4d70-4183-8d30-b0eaa07e8503") : object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:31.667611 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.667590    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 11:12:31.667708 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.667620    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 11:12:31.667708 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.667634    2582 projected.go:196] Error preparing data for projected volume kube-api-access-rr8xx for pod openshift-network-diagnostics/network-check-target-zzdfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:31.667708 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.667674    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx podName:d9e4134e-ffee-4194-8124-c8ba7bbd4d69 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:33.667660999 +0000 UTC m=+6.144932566 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rr8xx" (UniqueName: "kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx") pod "network-check-target-zzdfx" (UID: "d9e4134e-ffee-4194-8124-c8ba7bbd4d69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:31.667858 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.667738    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:31.667858 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:31.667783    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs podName:0db82fa3-1b75-465b-bd57-529f7c295e01 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:33.667772167 +0000 UTC m=+6.145043731 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs") pod "network-metrics-daemon-t9rjx" (UID: "0db82fa3-1b75-465b-bd57-529f7c295e01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:31.976918 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.976795    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-02 11:07:29 +0000 UTC" deadline="2028-01-29 09:30:28.740108565 +0000 UTC"
Jul 03 11:12:31.976918 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:31.976861    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13798h17m56.763251602s"
Jul 03 11:12:32.096490 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:32.096460    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:32.096657 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:32.096593    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:32.097008 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:32.096987    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:32.097121 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:32.097103    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:32.139133 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:32.139097    2582 generic.go:356] "Generic (PLEG): container finished" podID="831aa4a8e60ac1bafce8327f1e975c1a" containerID="b4f31cd4c638e0f1d59ed7eeec26a4ec0ef6133ad0e6f7d45a718df0061972da" exitCode=0
Jul 03 11:12:32.139378 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:32.139348    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" event={"ID":"831aa4a8e60ac1bafce8327f1e975c1a","Type":"ContainerDied","Data":"b4f31cd4c638e0f1d59ed7eeec26a4ec0ef6133ad0e6f7d45a718df0061972da"}
Jul 03 11:12:32.153278 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:32.153242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" event={"ID":"4a862d27acdd6adcd1a30a65484081bd","Type":"ContainerStarted","Data":"3570c45feb4d2cd9cd32742465abb172e3332ae660694d76e93f115ba8d48b2b"}
Jul 03 11:12:32.171716 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:32.171030    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-129.ec2.internal" podStartSLOduration=3.171006738 podStartE2EDuration="3.171006738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:32.17032129 +0000 UTC m=+4.647592875" watchObservedRunningTime="2026-07-03 11:12:32.171006738 +0000 UTC m=+4.648278322"
Jul 03 11:12:33.094819 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:33.094784    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:33.095381 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.094934    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:33.186711 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:33.186616    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" event={"ID":"831aa4a8e60ac1bafce8327f1e975c1a","Type":"ContainerStarted","Data":"e7482208d4cffc4da8bc64e7211505d385cd9c87db54857b61a7d1b0e7a1162e"}
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:33.685625    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:33.685687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:33.685731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.685885    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.685904    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.685918    2582 projected.go:196] Error preparing data for projected volume kube-api-access-rr8xx for pod openshift-network-diagnostics/network-check-target-zzdfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.685976    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx podName:d9e4134e-ffee-4194-8124-c8ba7bbd4d69 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:37.685956834 +0000 UTC m=+10.163228399 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rr8xx" (UniqueName: "kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx") pod "network-check-target-zzdfx" (UID: "d9e4134e-ffee-4194-8124-c8ba7bbd4d69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.686397    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.686451    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs podName:0db82fa3-1b75-465b-bd57-529f7c295e01 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:37.686435043 +0000 UTC m=+10.163706625 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs") pod "network-metrics-daemon-t9rjx" (UID: "0db82fa3-1b75-465b-bd57-529f7c295e01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.686528    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:33.686666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:33.686573    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret podName:e83fc8e8-4d70-4183-8d30-b0eaa07e8503 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:37.686560941 +0000 UTC m=+10.163832501 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret") pod "global-pull-secret-syncer-xnf6q" (UID: "e83fc8e8-4d70-4183-8d30-b0eaa07e8503") : object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:34.096299 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:34.096227    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:34.096735 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:34.096343    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:34.096735 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:34.096684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:34.097543 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:34.096772    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:35.094850 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:35.094472    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:35.094850 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:35.094578    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:36.097468 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:36.094683    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:36.097468 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:36.094823    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:36.097468 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:36.095260    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:36.097468 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:36.095352    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:37.094897 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:37.094864    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:37.095084 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.095005    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:37.718716 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:37.718678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:37.719167 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:37.718738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:37.719167 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:37.718779    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:37.719167 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.718927    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 11:12:37.719167 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.718944    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 11:12:37.719167 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.718957    2582 projected.go:196] Error preparing data for projected volume kube-api-access-rr8xx for pod openshift-network-diagnostics/network-check-target-zzdfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:37.719167 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.719011    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx podName:d9e4134e-ffee-4194-8124-c8ba7bbd4d69 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:45.718993056 +0000 UTC m=+18.196264632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rr8xx" (UniqueName: "kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx") pod "network-check-target-zzdfx" (UID: "d9e4134e-ffee-4194-8124-c8ba7bbd4d69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:37.719487 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.719421    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:37.719487 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.719467    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs podName:0db82fa3-1b75-465b-bd57-529f7c295e01 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:45.719452241 +0000 UTC m=+18.196723804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs") pod "network-metrics-daemon-t9rjx" (UID: "0db82fa3-1b75-465b-bd57-529f7c295e01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:37.719583 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.719527    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:37.719583 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:37.719559    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret podName:e83fc8e8-4d70-4183-8d30-b0eaa07e8503 nodeName:}" failed. No retries permitted until 2026-07-03 11:12:45.719548341 +0000 UTC m=+18.196819906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret") pod "global-pull-secret-syncer-xnf6q" (UID: "e83fc8e8-4d70-4183-8d30-b0eaa07e8503") : object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:38.095028 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:38.094947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:38.095198 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:38.095064    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:38.095654 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:38.095525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:38.095654 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:38.095616    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:39.094172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:39.094131    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:39.094613 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:39.094268    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:40.098530 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:40.098452    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:40.098983 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:40.098624    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:40.099032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:40.099004    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:40.099164 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:40.099112    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:41.094183 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:41.094153    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:41.094320 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:41.094266    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:42.094607 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:42.094573    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:42.095030 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:42.094585    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:42.095030 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:42.094704    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:42.095030 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:42.094764    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:43.094046 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:43.094009    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:43.094250 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:43.094170    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:44.097948 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:44.097916    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:44.098462 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:44.098031    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:44.098462 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:44.098107    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:44.098462 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:44.098209    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:45.094943 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:45.094909    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:45.095151 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.095057    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:45.784521 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:45.784484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:45.784541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:45.784580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.784636    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.784691    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.784708    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs podName:0db82fa3-1b75-465b-bd57-529f7c295e01 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:01.784687081 +0000 UTC m=+34.261958640 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs") pod "network-metrics-daemon-t9rjx" (UID: "0db82fa3-1b75-465b-bd57-529f7c295e01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.784724    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.784728    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret podName:e83fc8e8-4d70-4183-8d30-b0eaa07e8503 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:01.784717422 +0000 UTC m=+34.261988983 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret") pod "global-pull-secret-syncer-xnf6q" (UID: "e83fc8e8-4d70-4183-8d30-b0eaa07e8503") : object "kube-system"/"original-pull-secret" not registered
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.784741    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.784755    2582 projected.go:196] Error preparing data for projected volume kube-api-access-rr8xx for pod openshift-network-diagnostics/network-check-target-zzdfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:45.784935 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:45.784811    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx podName:d9e4134e-ffee-4194-8124-c8ba7bbd4d69 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:01.784794785 +0000 UTC m=+34.262066359 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rr8xx" (UniqueName: "kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx") pod "network-check-target-zzdfx" (UID: "d9e4134e-ffee-4194-8124-c8ba7bbd4d69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:12:46.094814 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:46.094735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:46.095014 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:46.094862    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:46.095014 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:46.094920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:46.095134 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:46.095034    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:47.094095 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:47.094051    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:47.094546 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:47.094199    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:48.095465 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:48.095433    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:48.095912 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:48.095540    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:48.095912 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:48.095636    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:48.095912 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:48.095740    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:49.094271 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:49.094237    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:49.094471 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:49.094399    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:50.095168 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.095054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:50.095539 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:50.095234    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:50.095539 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.095277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:50.095539 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:50.095354    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:50.223697 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.223655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fpmrz" event={"ID":"500de5a7-48d1-46bb-b9ec-deaf2df68351","Type":"ContainerStarted","Data":"72f2750f0c98a4b9404fd85356c0291d2104753d616bdb4e9bfa832a0ab51907"}
Jul 03 11:12:50.225211 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.225166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9kk7g" event={"ID":"47131d70-f689-4280-87eb-86dd8236e628","Type":"ContainerStarted","Data":"291aa5df2c10233cef6328f4a3599f1d03640067835ae2a15f85e04e318e2041"}
Jul 03 11:12:50.226624 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.226603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sfpc6" event={"ID":"1fbc07b6-c4eb-4376-b0e8-39ab43b33689","Type":"ContainerStarted","Data":"d7764835ccba33c0274498cb5829de9a9c6f727b1a6e6cb5873bded9786563e3"}
Jul 03 11:12:50.228676 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.228647    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8qfxx" event={"ID":"bd55c844-b0ae-410d-9462-8f799423de81","Type":"ContainerStarted","Data":"fc6c4245ce0cf056c44f08d8e594a6c0cdb70f097cb41266d311bcac1279dca5"}
Jul 03 11:12:50.231014 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.230989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2cpnn" event={"ID":"da462a2b-e560-4bf0-820a-e35651982e4d","Type":"ContainerStarted","Data":"9e118d4cc64d0af71e460a77a04bc99ef92071fc40fc17692fa88820eedf95c4"}
Jul 03 11:12:50.241294 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.241255    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-129.ec2.internal" podStartSLOduration=21.241242494 podStartE2EDuration="21.241242494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:33.201054465 +0000 UTC m=+5.678326049" watchObservedRunningTime="2026-07-03 11:12:50.241242494 +0000 UTC m=+22.718514076"
Jul 03 11:12:50.241403 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.241320    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fpmrz" podStartSLOduration=3.28038879 podStartE2EDuration="22.241314928s" totalImagesPullingTime="18.960926138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:50.241054977 +0000 UTC m=+22.718326559" watchObservedRunningTime="2026-07-03 11:12:50.241314928 +0000 UTC m=+22.718586518"
Jul 03 11:12:50.258560 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.258507    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2cpnn" podStartSLOduration=11.761627922 podStartE2EDuration="22.258486451s" totalImagesPullingTime="10.496858529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:50.256465558 +0000 UTC m=+22.733737132" watchObservedRunningTime="2026-07-03 11:12:50.258486451 +0000 UTC m=+22.735758029"
Jul 03 11:12:50.271373 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.271334    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sfpc6" podStartSLOduration=3.353287126 podStartE2EDuration="22.271320622s" totalImagesPullingTime="18.918033496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:50.271037292 +0000 UTC m=+22.748308874" watchObservedRunningTime="2026-07-03 11:12:50.271320622 +0000 UTC m=+22.748592204"
Jul 03 11:12:50.285161 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.285121    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9kk7g" podStartSLOduration=3.363499899 podStartE2EDuration="22.285111937s" totalImagesPullingTime="18.921612038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:50.284756754 +0000 UTC m=+22.762028349" watchObservedRunningTime="2026-07-03 11:12:50.285111937 +0000 UTC m=+22.762383520"
Jul 03 11:12:50.303195 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:50.303158    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8qfxx" podStartSLOduration=3.374502661 podStartE2EDuration="22.303144521s" totalImagesPullingTime="18.92864186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:50.302940965 +0000 UTC m=+22.780212547" watchObservedRunningTime="2026-07-03 11:12:50.303144521 +0000 UTC m=+22.780416103"
Jul 03 11:12:51.094850 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.094646    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:51.095004 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:51.094894    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:51.107728 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.107705    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:51.108294 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.108242    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:51.233944 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.233907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26" event={"ID":"2018a72c-f3d3-4507-b073-e52a336911ed","Type":"ContainerStarted","Data":"273a556ecd13a3b20696af59dbcd054eb87518f867fc07019c99309867e1e9c9"}
Jul 03 11:12:51.236376 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.236355    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:12:51.236686 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.236666    2582 generic.go:356] "Generic (PLEG): container finished" podID="aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd" containerID="53ff8a3e6a959fb62e6ca3100ea10fe08f19e8bcec6076330946d1dd7cfb9811" exitCode=1
Jul 03 11:12:51.236757 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.236741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"470e8de45de0d36b2a3bc3be3227450626100ca6f083e80ed8e6fa1a6303e61f"}
Jul 03 11:12:51.236829 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.236808    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"60d684e7dc73ea40ddf4ac94066205d7d5c1c9f2b10b090ce08d95f62777ea61"}
Jul 03 11:12:51.236960 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.236858    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"f4dc31d203b738b5057fff3f74ad52c465f407d25b3106aa4069512eb9308c35"}
Jul 03 11:12:51.236960 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.236913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"a621f86d3de4bb2c7aaaefc12a3b5df32f885f477f375be90818bb4867bd4a62"}
Jul 03 11:12:51.236960 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.236957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerDied","Data":"53ff8a3e6a959fb62e6ca3100ea10fe08f19e8bcec6076330946d1dd7cfb9811"}
Jul 03 11:12:51.237127 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.237006    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"636bf2f1921423fb176a4c216b37d8536ef7b6dac3297bac2c0740522bc2bc99"}
Jul 03 11:12:51.238050 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.238031    2582 generic.go:356] "Generic (PLEG): container finished" podID="58604249-cb76-4e50-93d9-0e291df1d27d" containerID="73794ad16a7e7cdf469260139e0e8cb130429dd06f269ec5c91771b40e4700dc" exitCode=0
Jul 03 11:12:51.238170 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.238147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td5zc" event={"ID":"58604249-cb76-4e50-93d9-0e291df1d27d","Type":"ContainerDied","Data":"73794ad16a7e7cdf469260139e0e8cb130429dd06f269ec5c91771b40e4700dc"}
Jul 03 11:12:51.238395 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.238374    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:51.239374 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.238847    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2cpnn"
Jul 03 11:12:51.602676 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:51.602630    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 03 11:12:52.004933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:52.004832    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-03T11:12:51.602649471Z","UUID":"173a9790-e390-41b4-a512-576f687c2d39","Handler":null,"Name":"","Endpoint":""}
Jul 03 11:12:52.006627 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:52.006604    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 03 11:12:52.006756 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:52.006644    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 03 11:12:52.096692 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:52.096661    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:52.096839 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:52.096783    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:52.097219 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:52.097170    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:52.097320 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:52.097264    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:52.242231 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:52.242194    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9l22r" event={"ID":"10789ed6-ffaa-4d36-949b-b0fc9814122f","Type":"ContainerStarted","Data":"cc3596027f701ca26d1d54aed2530fb619edb7244a573ff00fe969bf4d53b9f1"}
Jul 03 11:12:52.244508 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:52.244478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26" event={"ID":"2018a72c-f3d3-4507-b073-e52a336911ed","Type":"ContainerStarted","Data":"14971078df763bd8e72c85a3a43144bb9ea300517dbdd35ca2216ec5eb728b0d"}
Jul 03 11:12:52.261110 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:52.260992    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9l22r" podStartSLOduration=5.328838402 podStartE2EDuration="24.260969572s" totalImagesPullingTime="18.93213117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:52.260462773 +0000 UTC m=+24.737734404" watchObservedRunningTime="2026-07-03 11:12:52.260969572 +0000 UTC m=+24.738241156"
Jul 03 11:12:53.094126 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:53.094100    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:53.094303 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:53.094230    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:53.250055 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:53.250015    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26" event={"ID":"2018a72c-f3d3-4507-b073-e52a336911ed","Type":"ContainerStarted","Data":"9c042339fb995e2d003c3ef52fca97c6ca1a79ffe2d2a48b7b10dc50fbbbf7f2"}
Jul 03 11:12:53.253612 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:53.253589    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:12:53.254091 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:53.254048    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"b671e668550edea627120c4fe35d8eae3f78cc779ad809530c9bf18db7f79cc4"}
Jul 03 11:12:54.094808 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:54.094588    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:54.095048 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:54.094696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:54.095048 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:54.094914    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:54.095167 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:54.095055    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:55.095037 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:55.095011    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:55.095502 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:55.095153    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:56.094220 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.093997    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:56.094398 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.094063    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:56.094398 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:56.094246    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:56.094398 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:56.094334    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:56.263643 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.263614    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:12:56.264340 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.263984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"673e9bb457e6d47e300d8c934e82ffff54039e22bf036a8ee9a896f52a2b20db"}
Jul 03 11:12:56.264340 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.264309    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:56.264516 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.264498    2582 scope.go:117] "RemoveContainer" containerID="53ff8a3e6a959fb62e6ca3100ea10fe08f19e8bcec6076330946d1dd7cfb9811"
Jul 03 11:12:56.265955 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.265936    2582 generic.go:356] "Generic (PLEG): container finished" podID="58604249-cb76-4e50-93d9-0e291df1d27d" containerID="416c10ed2b586cd4f53f2ce072e011a2742f09a58524b7512614621b44315884" exitCode=0
Jul 03 11:12:56.266039 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.265965    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td5zc" event={"ID":"58604249-cb76-4e50-93d9-0e291df1d27d","Type":"ContainerDied","Data":"416c10ed2b586cd4f53f2ce072e011a2742f09a58524b7512614621b44315884"}
Jul 03 11:12:56.281344 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.281325    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:56.304436 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:56.304397    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62b26" podStartSLOduration=7.19027218 podStartE2EDuration="28.304383869s" totalImagesPullingTime="21.114111689s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:53.267904432 +0000 UTC m=+25.745176012" watchObservedRunningTime="2026-07-03 11:12:56.304383869 +0000 UTC m=+28.781655458"
Jul 03 11:12:57.094601 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.094574    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:57.094704 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:57.094683    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:57.271465 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.271392    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:12:57.271815 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.271720    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" event={"ID":"aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd","Type":"ContainerStarted","Data":"0bccea0285a24392058f70b261d3901b1530fcee8fbe5760c3f24fd3dc5cbcc6"}
Jul 03 11:12:57.271815 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.271811    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:57.271910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.271865    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:57.273894 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.273870    2582 generic.go:356] "Generic (PLEG): container finished" podID="58604249-cb76-4e50-93d9-0e291df1d27d" containerID="ae4eaa5d26a30c75f4da62b815a6d7ca73fbdde050819494a4151ad0999c7f70" exitCode=0
Jul 03 11:12:57.274014 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.273911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td5zc" event={"ID":"58604249-cb76-4e50-93d9-0e291df1d27d","Type":"ContainerDied","Data":"ae4eaa5d26a30c75f4da62b815a6d7ca73fbdde050819494a4151ad0999c7f70"}
Jul 03 11:12:57.288500 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.288477    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:12:57.306417 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.306375    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4" podStartSLOduration=10.308581137000001 podStartE2EDuration="29.306360959s" totalImagesPullingTime="18.997779822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:12:57.305284941 +0000 UTC m=+29.782556526" watchObservedRunningTime="2026-07-03 11:12:57.306360959 +0000 UTC m=+29.783632549"
Jul 03 11:12:57.641467 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.641345    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xnf6q"]
Jul 03 11:12:57.641597 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.641514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:57.641648 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:57.641613    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:57.643921 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.643898    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t9rjx"]
Jul 03 11:12:57.644038 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.644005    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:57.644149 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:57.644130    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:57.652984 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.652961    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zzdfx"]
Jul 03 11:12:57.653147 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.653062    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:57.653219 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:57.653169    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:57.963358 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:57.963162    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:12:58.124215 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:58.124184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:12:58.230456 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:58.230374    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:12:58.278115 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:58.278067    2582 generic.go:356] "Generic (PLEG): container finished" podID="58604249-cb76-4e50-93d9-0e291df1d27d" containerID="2bc26a4591ecdab388f8ad59802d8df1fcecc3d66e08d06c0020e5702c944e67" exitCode=0
Jul 03 11:12:58.278434 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:58.278167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td5zc" event={"ID":"58604249-cb76-4e50-93d9-0e291df1d27d","Type":"ContainerDied","Data":"2bc26a4591ecdab388f8ad59802d8df1fcecc3d66e08d06c0020e5702c944e67"}
Jul 03 11:12:59.094148 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:59.094114    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:12:59.094279 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:59.094177    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:12:59.094344 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:59.094276    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:12:59.094344 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:59.094295    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:12:59.094468 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:59.094352    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:12:59.094468 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:12:59.094424    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:12:59.458225 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:59.458140    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:12:59.559328 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:12:59.559283    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:01.095100 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:01.095047    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:13:01.095100 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:01.095088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:13:01.095100 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:01.095107    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:13:01.095666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.095200    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xnf6q" podUID="e83fc8e8-4d70-4183-8d30-b0eaa07e8503"
Jul 03 11:13:01.095666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.095347    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-t9rjx" podUID="0db82fa3-1b75-465b-bd57-529f7c295e01"
Jul 03 11:13:01.095666 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.095408    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zzdfx" podUID="d9e4134e-ffee-4194-8124-c8ba7bbd4d69"
Jul 03 11:13:01.805950 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:01.805858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:13:01.805950 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:01.805903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:13:01.805950 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:01.805933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:13:01.806241 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.806035    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 03 11:13:01.806241 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.806043    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:13:01.806241 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.806112    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret podName:e83fc8e8-4d70-4183-8d30-b0eaa07e8503 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:33.806096945 +0000 UTC m=+66.283368524 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret") pod "global-pull-secret-syncer-xnf6q" (UID: "e83fc8e8-4d70-4183-8d30-b0eaa07e8503") : object "kube-system"/"original-pull-secret" not registered
Jul 03 11:13:01.806241 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.806046    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 03 11:13:01.806241 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.806127    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs podName:0db82fa3-1b75-465b-bd57-529f7c295e01 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:33.80612073 +0000 UTC m=+66.283392289 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs") pod "network-metrics-daemon-t9rjx" (UID: "0db82fa3-1b75-465b-bd57-529f7c295e01") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 03 11:13:01.806241 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.806143    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 03 11:13:01.806241 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.806157    2582 projected.go:196] Error preparing data for projected volume kube-api-access-rr8xx for pod openshift-network-diagnostics/network-check-target-zzdfx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:13:01.806241 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:01.806205    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx podName:d9e4134e-ffee-4194-8124-c8ba7bbd4d69 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:33.806187425 +0000 UTC m=+66.283458987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rr8xx" (UniqueName: "kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx") pod "network-check-target-zzdfx" (UID: "d9e4134e-ffee-4194-8124-c8ba7bbd4d69") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 03 11:13:02.794932 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.794905    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-129.ec2.internal" event="NodeReady"
Jul 03 11:13:02.795442 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.795030    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 03 11:13:02.840217 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.840176    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-shr2q"]
Jul 03 11:13:02.860933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.860889    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7jgwx"]
Jul 03 11:13:02.861131 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.861029    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-shr2q"
Jul 03 11:13:02.864936 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.864908    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 03 11:13:02.865116 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.864986    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 03 11:13:02.865116 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.865044    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w5xwd\""
Jul 03 11:13:02.865245 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.865154    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 03 11:13:02.879124 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.879101    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-shr2q"]
Jul 03 11:13:02.879274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.879133    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7jgwx"]
Jul 03 11:13:02.879274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.879185    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:02.881664 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.881643    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 03 11:13:02.881784 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.881750    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 03 11:13:02.881850 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:02.881827    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kggc2\""
Jul 03 11:13:03.016283 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.016253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35a03107-6c93-4e42-8f11-5a2cb6889e31-config-volume\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.016283 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.016286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.016498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.016321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35a03107-6c93-4e42-8f11-5a2cb6889e31-tmp-dir\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.016498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.016354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w79w2\" (UniqueName: \"kubernetes.io/projected/46eb8232-a854-4f61-8313-2663b706525b-kube-api-access-w79w2\") pod \"ingress-canary-shr2q\" (UID: \"46eb8232-a854-4f61-8313-2663b706525b\") " pod="openshift-ingress-canary/ingress-canary-shr2q"
Jul 03 11:13:03.016498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.016450    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fh7c\" (UniqueName: \"kubernetes.io/projected/35a03107-6c93-4e42-8f11-5a2cb6889e31-kube-api-access-4fh7c\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.016498 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.016481    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46eb8232-a854-4f61-8313-2663b706525b-cert\") pod \"ingress-canary-shr2q\" (UID: \"46eb8232-a854-4f61-8313-2663b706525b\") " pod="openshift-ingress-canary/ingress-canary-shr2q"
Jul 03 11:13:03.094559 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.094521    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:13:03.094694 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.094564    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:13:03.094694 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.094564    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:13:03.097215 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.097186    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 11:13:03.097346 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.097254    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 11:13:03.097346 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.097282    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 11:13:03.097446 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.097395    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qx6zp\""
Jul 03 11:13:03.097446 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.097428    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 11:13:03.097544 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.097532    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wfk2t\""
Jul 03 11:13:03.117497 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.117478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w79w2\" (UniqueName: \"kubernetes.io/projected/46eb8232-a854-4f61-8313-2663b706525b-kube-api-access-w79w2\") pod \"ingress-canary-shr2q\" (UID: \"46eb8232-a854-4f61-8313-2663b706525b\") " pod="openshift-ingress-canary/ingress-canary-shr2q"
Jul 03 11:13:03.117605 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.117533    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fh7c\" (UniqueName: \"kubernetes.io/projected/35a03107-6c93-4e42-8f11-5a2cb6889e31-kube-api-access-4fh7c\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.117701 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.117683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46eb8232-a854-4f61-8313-2663b706525b-cert\") pod \"ingress-canary-shr2q\" (UID: \"46eb8232-a854-4f61-8313-2663b706525b\") " pod="openshift-ingress-canary/ingress-canary-shr2q"
Jul 03 11:13:03.117766 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.117715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35a03107-6c93-4e42-8f11-5a2cb6889e31-config-volume\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.117766 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.117739    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.117766 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.117764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35a03107-6c93-4e42-8f11-5a2cb6889e31-tmp-dir\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.117906 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:03.117825    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 11:13:03.117906 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:03.117878    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls podName:35a03107-6c93-4e42-8f11-5a2cb6889e31 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:03.61786376 +0000 UTC m=+36.095135320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls") pod "dns-default-7jgwx" (UID: "35a03107-6c93-4e42-8f11-5a2cb6889e31") : secret "dns-default-metrics-tls" not found
Jul 03 11:13:03.118037 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.118021    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/35a03107-6c93-4e42-8f11-5a2cb6889e31-tmp-dir\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.118230 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.118214    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/35a03107-6c93-4e42-8f11-5a2cb6889e31-config-volume\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.121959 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.121835    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/46eb8232-a854-4f61-8313-2663b706525b-cert\") pod \"ingress-canary-shr2q\" (UID: \"46eb8232-a854-4f61-8313-2663b706525b\") " pod="openshift-ingress-canary/ingress-canary-shr2q"
Jul 03 11:13:03.125968 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.125948    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fh7c\" (UniqueName: \"kubernetes.io/projected/35a03107-6c93-4e42-8f11-5a2cb6889e31-kube-api-access-4fh7c\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.126117 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.126102    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w79w2\" (UniqueName: \"kubernetes.io/projected/46eb8232-a854-4f61-8313-2663b706525b-kube-api-access-w79w2\") pod \"ingress-canary-shr2q\" (UID: \"46eb8232-a854-4f61-8313-2663b706525b\") " pod="openshift-ingress-canary/ingress-canary-shr2q"
Jul 03 11:13:03.169999 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.169920    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-shr2q"
Jul 03 11:13:03.294648 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.294608    2582 generic.go:356] "Generic (PLEG): container finished" podID="58604249-cb76-4e50-93d9-0e291df1d27d" containerID="32aa4a053874f11396effecd5810755ef83f9aad3eaff9fa988ee2aaac66a450" exitCode=0
Jul 03 11:13:03.294833 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.294657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td5zc" event={"ID":"58604249-cb76-4e50-93d9-0e291df1d27d","Type":"ContainerDied","Data":"32aa4a053874f11396effecd5810755ef83f9aad3eaff9fa988ee2aaac66a450"}
Jul 03 11:13:03.349673 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.349644    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-shr2q"]
Jul 03 11:13:03.353867 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:03.353840    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46eb8232_a854_4f61_8313_2663b706525b.slice/crio-1fa6d825e7790b68e8e019511f3c7ce7070bbf6d76a1403d0eb3c7614adace44 WatchSource:0}: Error finding container 1fa6d825e7790b68e8e019511f3c7ce7070bbf6d76a1403d0eb3c7614adace44: Status 404 returned error can't find the container with id 1fa6d825e7790b68e8e019511f3c7ce7070bbf6d76a1403d0eb3c7614adace44
Jul 03 11:13:03.534025 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.533990    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:03.621345 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.621305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:03.624301 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:03.621802    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 11:13:03.624301 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:03.621894    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls podName:35a03107-6c93-4e42-8f11-5a2cb6889e31 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:04.621861604 +0000 UTC m=+37.099133182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls") pod "dns-default-7jgwx" (UID: "35a03107-6c93-4e42-8f11-5a2cb6889e31") : secret "dns-default-metrics-tls" not found
Jul 03 11:13:03.632048 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.632017    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:03.858754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:03.858671    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:04.156469 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.156397    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xghh2"]
Jul 03 11:13:04.177563 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.177531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.183448 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.183421    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xghh2"]
Jul 03 11:13:04.189735 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.189583    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 03 11:13:04.189735 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.189583    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 03 11:13:04.189735 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.189588    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 03 11:13:04.191855 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.190914    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 03 11:13:04.191855 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.190915    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d5hq9\""
Jul 03 11:13:04.195099 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.195045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:04.265200 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.265169    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:04.301563 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.301530    2582 generic.go:356] "Generic (PLEG): container finished" podID="58604249-cb76-4e50-93d9-0e291df1d27d" containerID="b7965b489f80a58bfaabda1876d33fb803f82806a259b2d426d4403703bc84f6" exitCode=0
Jul 03 11:13:04.301749 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.301607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td5zc" event={"ID":"58604249-cb76-4e50-93d9-0e291df1d27d","Type":"ContainerDied","Data":"b7965b489f80a58bfaabda1876d33fb803f82806a259b2d426d4403703bc84f6"}
Jul 03 11:13:04.303336 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.303308    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-shr2q" event={"ID":"46eb8232-a854-4f61-8313-2663b706525b","Type":"ContainerStarted","Data":"1fa6d825e7790b68e8e019511f3c7ce7070bbf6d76a1403d0eb3c7614adace44"}
Jul 03 11:13:04.328024 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.327995    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8cdz\" (UniqueName: \"kubernetes.io/projected/d0076409-fb41-4787-b096-31ca8a6516ae-kube-api-access-f8cdz\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.328177 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.328035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.328177 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.328145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0076409-fb41-4787-b096-31ca8a6516ae-data-volume\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.328289 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.328194    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.328289 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.328239    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0076409-fb41-4787-b096-31ca8a6516ae-crio-socket\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.429168 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.429112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0076409-fb41-4787-b096-31ca8a6516ae-crio-socket\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.429317 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.429220    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8cdz\" (UniqueName: \"kubernetes.io/projected/d0076409-fb41-4787-b096-31ca8a6516ae-kube-api-access-f8cdz\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.429317 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.429250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.429317 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.429315    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0076409-fb41-4787-b096-31ca8a6516ae-data-volume\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.429465 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.429325    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d0076409-fb41-4787-b096-31ca8a6516ae-crio-socket\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.429465 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.429336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.429465 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.429402    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 11:13:04.429465 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.429457    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:04.929442669 +0000 UTC m=+37.406714230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : configmap "kube-rbac-proxy" not found
Jul 03 11:13:04.430013 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.429993    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:04.430155 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.430053    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:04.930035039 +0000 UTC m=+37.407306602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:04.430242 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.430220    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d0076409-fb41-4787-b096-31ca8a6516ae-data-volume\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.441107 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.440972    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8cdz\" (UniqueName: \"kubernetes.io/projected/d0076409-fb41-4787-b096-31ca8a6516ae-kube-api-access-f8cdz\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.501378 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.501349    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:04.556375 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.556342    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg"]
Jul 03 11:13:04.577372 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.577346    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg"]
Jul 03 11:13:04.577520 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.577471    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg"
Jul 03 11:13:04.581509 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.581484    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 03 11:13:04.581663 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.581615    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-9dn6z\""
Jul 03 11:13:04.581663 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.581650    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 03 11:13:04.605678 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.605643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:04.631400 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.631367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:04.631609 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.631495    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 11:13:04.631609 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.631558    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls podName:35a03107-6c93-4e42-8f11-5a2cb6889e31 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:06.63154071 +0000 UTC m=+39.108812294 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls") pod "dns-default-7jgwx" (UID: "35a03107-6c93-4e42-8f11-5a2cb6889e31") : secret "dns-default-metrics-tls" not found
Jul 03 11:13:04.698487 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.698409    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:04.732038 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.732007    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7dsl\" (UniqueName: \"kubernetes.io/projected/ab656b74-f87b-464f-a58d-437a39510257-kube-api-access-j7dsl\") pod \"migrator-d57d58cc9-9llmg\" (UID: \"ab656b74-f87b-464f-a58d-437a39510257\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg"
Jul 03 11:13:04.799305 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.799274    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:04.833417 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.833380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7dsl\" (UniqueName: \"kubernetes.io/projected/ab656b74-f87b-464f-a58d-437a39510257-kube-api-access-j7dsl\") pod \"migrator-d57d58cc9-9llmg\" (UID: \"ab656b74-f87b-464f-a58d-437a39510257\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg"
Jul 03 11:13:04.843502 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.843462    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7dsl\" (UniqueName: \"kubernetes.io/projected/ab656b74-f87b-464f-a58d-437a39510257-kube-api-access-j7dsl\") pod \"migrator-d57d58cc9-9llmg\" (UID: \"ab656b74-f87b-464f-a58d-437a39510257\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg"
Jul 03 11:13:04.887955 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.887917    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg"
Jul 03 11:13:04.933736 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.933706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.933905 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:04.933803    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:04.933905 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.933849    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 11:13:04.934008 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.933921    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:05.933899917 +0000 UTC m=+38.411171477 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : configmap "kube-rbac-proxy" not found
Jul 03 11:13:04.934008 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.933946    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:04.934008 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:04.934005    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:05.933987735 +0000 UTC m=+38.411259309 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:05.211748 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.211718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:05.274357 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.274320    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:05.310578 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.310542    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-td5zc" event={"ID":"58604249-cb76-4e50-93d9-0e291df1d27d","Type":"ContainerStarted","Data":"f1df3ea4f29ae4e7a8e2e80a84a0e854058422ab341555198d031e98eb2f0b5b"}
Jul 03 11:13:05.336032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.335968    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-td5zc" podStartSLOduration=8.378401569 podStartE2EDuration="37.335947333s" totalImagesPullingTime="28.957545764s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:05.334665098 +0000 UTC m=+37.811936680" watchObservedRunningTime="2026-07-03 11:13:05.335947333 +0000 UTC m=+37.813218924"
Jul 03 11:13:05.459917 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.459881    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:05.555058 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.554978    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:05.697209 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.697174    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg"]
Jul 03 11:13:05.699940 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:05.699911    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab656b74_f87b_464f_a58d_437a39510257.slice/crio-1a822dc17e1b077e4d1d6d074d33d5f5047d510c60fe37ea4429624b5319b6fa WatchSource:0}: Error finding container 1a822dc17e1b077e4d1d6d074d33d5f5047d510c60fe37ea4429624b5319b6fa: Status 404 returned error can't find the container with id 1a822dc17e1b077e4d1d6d074d33d5f5047d510c60fe37ea4429624b5319b6fa
Jul 03 11:13:05.943595 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.943567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:05.944266 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:05.943617    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:05.944266 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:05.943699    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 11:13:05.944266 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:05.943732    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:05.944266 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:05.943763    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:07.943749037 +0000 UTC m=+40.421020598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : configmap "kube-rbac-proxy" not found
Jul 03 11:13:05.944266 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:05.943796    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:07.943779041 +0000 UTC m=+40.421050600 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:06.106917 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:06.106891    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9kk7g_47131d70-f689-4280-87eb-86dd8236e628/dns-node-resolver/0.log"
Jul 03 11:13:06.314642 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:06.314607    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg" event={"ID":"ab656b74-f87b-464f-a58d-437a39510257","Type":"ContainerStarted","Data":"1a822dc17e1b077e4d1d6d074d33d5f5047d510c60fe37ea4429624b5319b6fa"}
Jul 03 11:13:06.316427 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:06.316391    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-shr2q" event={"ID":"46eb8232-a854-4f61-8313-2663b706525b","Type":"ContainerStarted","Data":"a6e679f6873d2ee688998751e3d94e034b86ef662e8bae3e7ba89a0b5b2398d1"}
Jul 03 11:13:06.332877 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:06.332822    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-shr2q" podStartSLOduration=1.804307969 podStartE2EDuration="4.332805079s" totalImagesPullingTime="2.52849711s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:06.331747131 +0000 UTC m=+38.809018715" watchObservedRunningTime="2026-07-03 11:13:06.332805079 +0000 UTC m=+38.810076661"
Jul 03 11:13:06.601304 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:06.601227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:06.650506 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:06.650463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:06.651087 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:06.651042    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 11:13:06.651211 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:06.651160    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls podName:35a03107-6c93-4e42-8f11-5a2cb6889e31 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:10.651138387 +0000 UTC m=+43.128409959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls") pod "dns-default-7jgwx" (UID: "35a03107-6c93-4e42-8f11-5a2cb6889e31") : secret "dns-default-metrics-tls" not found
Jul 03 11:13:06.702180 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:06.701983    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:07.050569 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:07.050526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:07.306234 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:07.306148    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sfpc6_1fbc07b6-c4eb-4376-b0e8-39ab43b33689/node-ca/0.log"
Jul 03 11:13:07.962931 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:07.962886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:07.963117 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:07.962975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:07.963117 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:07.963018    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 03 11:13:07.963117 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:07.963085    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:07.963117 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:07.963106    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:11.963087327 +0000 UTC m=+44.440358900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : configmap "kube-rbac-proxy" not found
Jul 03 11:13:07.963277 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:07.963154    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:11.96312947 +0000 UTC m=+44.440401030 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:08.021305 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:08.021273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:08.107327 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:08.107298    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shr2q_46eb8232-a854-4f61-8313-2663b706525b/serve-healthcheck-canary/0.log"
Jul 03 11:13:08.109433 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:08.109410    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:08.322682 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:08.322592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg" event={"ID":"ab656b74-f87b-464f-a58d-437a39510257","Type":"ContainerStarted","Data":"8dc2126e479703191986f6f4bc6a35e3053e5593d69d14ef6dbf89c12d61997a"}
Jul 03 11:13:08.322682 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:08.322646    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg" event={"ID":"ab656b74-f87b-464f-a58d-437a39510257","Type":"ContainerStarted","Data":"522c8ba7ee64762f98cf56d36e2cf1383868ea19aa417a3347f2f782827adbdc"}
Jul 03 11:13:08.943831 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:08.943792    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:10.681889 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:10.681841    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:10.682340 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:10.682009    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 03 11:13:10.682340 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:10.682096    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls podName:35a03107-6c93-4e42-8f11-5a2cb6889e31 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:18.68206078 +0000 UTC m=+51.159332340 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls") pod "dns-default-7jgwx" (UID: "35a03107-6c93-4e42-8f11-5a2cb6889e31") : secret "dns-default-metrics-tls" not found
Jul 03 11:13:11.005674 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.005582    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:11.153294 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.153255    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:11.333866 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.333788    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:11.434501 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.434463    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:11.536087 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.536047    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:11.716125 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.716089    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:11.991387 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.991304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:11.991387 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.991363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:11.991583 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:11.991478    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:11.991583 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:11.991556    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls podName:d0076409-fb41-4787-b096-31ca8a6516ae nodeName:}" failed. No retries permitted until 2026-07-03 11:13:19.991538331 +0000 UTC m=+52.468809895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xghh2" (UID: "d0076409-fb41-4787-b096-31ca8a6516ae") : secret "insights-runtime-extractor-tls" not found
Jul 03 11:13:11.991840 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:11.991823    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d0076409-fb41-4787-b096-31ca8a6516ae-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:12.686932 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:12.686901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:13.010809 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:13.010702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:13.110975 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:13.110948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:13.211578 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:13.211552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:13.311926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:13.311848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:13.476262 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:13.476229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:13.876335 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:13.876308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:14.480767 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:14.480736    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:14.682653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:14.682625    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:14.752593 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:14.752517    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:15.030868 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:15.030791    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:15.132892 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:15.132845    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:15.688253 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:15.688225    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:15.788239 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:15.788207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:16.077168 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:16.077059    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:16.485936 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:16.485906    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:16.879791 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:16.879712    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:17.084026 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:17.083995    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:17.477574 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:17.477542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:17.680094 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:17.680045    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:17.998488 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:17.998450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:18.483577 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:18.483541    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:18.743293 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:18.743196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:18.746543 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:18.746524    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a03107-6c93-4e42-8f11-5a2cb6889e31-metrics-tls\") pod \"dns-default-7jgwx\" (UID: \"35a03107-6c93-4e42-8f11-5a2cb6889e31\") " pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:18.788269 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:18.788232    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:18.894874 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:18.894841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:18.930416 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:18.930358    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-9llmg" podStartSLOduration=12.979419045 podStartE2EDuration="14.930342231s" totalImagesPullingTime="1.950923186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:08.343826787 +0000 UTC m=+40.821098369" watchObservedRunningTime="2026-07-03 11:13:18.930342231 +0000 UTC m=+51.407613790"
Jul 03 11:13:18.931425 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:18.931401    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7jgwx"]
Jul 03 11:13:18.934429 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:18.934404    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a03107_6c93_4e42_8f11_5a2cb6889e31.slice/crio-fc107c6b2c9026d1422019980896013a85ab765832fd772fefa4f0d3239bec1b WatchSource:0}: Error finding container fc107c6b2c9026d1422019980896013a85ab765832fd772fefa4f0d3239bec1b: Status 404 returned error can't find the container with id fc107c6b2c9026d1422019980896013a85ab765832fd772fefa4f0d3239bec1b
Jul 03 11:13:19.297780 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:19.297739    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:19.350735 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:19.350699    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jgwx" event={"ID":"35a03107-6c93-4e42-8f11-5a2cb6889e31","Type":"ContainerStarted","Data":"fc107c6b2c9026d1422019980896013a85ab765832fd772fefa4f0d3239bec1b"}
Jul 03 11:13:19.678635 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:19.678598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:19.781713 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:19.781679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:19.897180 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:19.897147    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:20.053785 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:20.053706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:20.056015 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:20.055983    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d0076409-fb41-4787-b096-31ca8a6516ae-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xghh2\" (UID: \"d0076409-fb41-4787-b096-31ca8a6516ae\") " pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:20.088206 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:20.088177    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xghh2"
Jul 03 11:13:20.499728 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:20.499694    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:20.659734 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:20.659704    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xghh2"]
Jul 03 11:13:20.662496 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:20.662469    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0076409_fb41_4787_b096_31ca8a6516ae.slice/crio-960a18e77d586ea8935532f69be868e4ad98162adc72bc92cfb4422064f68e83 WatchSource:0}: Error finding container 960a18e77d586ea8935532f69be868e4ad98162adc72bc92cfb4422064f68e83: Status 404 returned error can't find the container with id 960a18e77d586ea8935532f69be868e4ad98162adc72bc92cfb4422064f68e83
Jul 03 11:13:21.081656 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:21.081627    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:21.276843 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:21.276760    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:21.359467 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:21.359428    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xghh2" event={"ID":"d0076409-fb41-4787-b096-31ca8a6516ae","Type":"ContainerStarted","Data":"960a18e77d586ea8935532f69be868e4ad98162adc72bc92cfb4422064f68e83"}
Jul 03 11:13:21.361841 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:21.361812    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jgwx" event={"ID":"35a03107-6c93-4e42-8f11-5a2cb6889e31","Type":"ContainerStarted","Data":"9a8900c693388e9e56eb7497313197c50d031f187c9f6aa3c58aa36fa6635019"}
Jul 03 11:13:21.361972 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:21.361864    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jgwx" event={"ID":"35a03107-6c93-4e42-8f11-5a2cb6889e31","Type":"ContainerStarted","Data":"79b5b7d2ceef945f63503028b710b28e38510cbac53758e8072d340e33248d63"}
Jul 03 11:13:21.362033 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:21.361980    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:21.478328 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:21.478294    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:21.676029 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:21.675991    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:24.740594 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:24.740537    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:24.843315 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:24.843282    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:24.943836 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:24.943807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:25.246494 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:25.246407    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:25.378747 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:25.378716    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xghh2" event={"ID":"d0076409-fb41-4787-b096-31ca8a6516ae","Type":"ContainerStarted","Data":"c795f67ab90d105c3632054d8515ac97a881df62fa4390eecf8be184f1bfc92a"}
Jul 03 11:13:25.378906 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:25.378795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xghh2" event={"ID":"d0076409-fb41-4787-b096-31ca8a6516ae","Type":"ContainerStarted","Data":"3b0b57a4d139c94721f3902ef17b7802ceb204b5f17658a0af2b830ed00b7597"}
Jul 03 11:13:25.424587 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:25.424558    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:25.525646 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:25.525562    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:25.652351 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:25.652315    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:25.757400 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:25.757360    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:26.630886 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:26.630854    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:26.869039 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:26.869003    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:26.936011 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:26.935981    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:27.045566 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:27.045533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:28.028518 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:28.028487    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:28.098788 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:28.098755    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:28.389848 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:28.389763    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xghh2" event={"ID":"d0076409-fb41-4787-b096-31ca8a6516ae","Type":"ContainerStarted","Data":"93d193d08806198c622b506f65a223994738a3977b9448e62267a11cb6ecde22"}
Jul 03 11:13:28.419737 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:28.419680    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7jgwx" podStartSLOduration=24.490821809 podStartE2EDuration="26.419661825s" totalImagesPullingTime="1.928840016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:13:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:21.381494655 +0000 UTC m=+53.858766236" watchObservedRunningTime="2026-07-03 11:13:28.419661825 +0000 UTC m=+60.896933408"
Jul 03 11:13:28.419992 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:28.419836    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xghh2" podStartSLOduration=17.749853976 podStartE2EDuration="24.419823656s" totalImagesPullingTime="6.66996968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:13:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:28.419540871 +0000 UTC m=+60.896812463" watchObservedRunningTime="2026-07-03 11:13:28.419823656 +0000 UTC m=+60.897095239"
Jul 03 11:13:29.292240 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:29.292202    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qfx4"
Jul 03 11:13:30.476599 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.476528    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"]
Jul 03 11:13:30.478997 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.478976    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"
Jul 03 11:13:30.481785 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.481726    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 03 11:13:30.481980 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.481958    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"]
Jul 03 11:13:30.482112 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.482016    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 03 11:13:30.483246 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.483225    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 03 11:13:30.483365 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.483225    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t4wrm\""
Jul 03 11:13:30.483365 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.483234    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 03 11:13:30.483970 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.483952    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.487104 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.486823    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 03 11:13:30.487104 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.486888    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 03 11:13:30.487104 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.487021    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 03 11:13:30.487104 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.487056    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 03 11:13:30.490894 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.490874    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"]
Jul 03 11:13:30.501351 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.501329    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"]
Jul 03 11:13:30.534155 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.534130    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.534279 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.534177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.534279 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.534197    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jv4c\" (UniqueName: \"kubernetes.io/projected/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-kube-api-access-7jv4c\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.534364 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.534277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-ca\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.534364 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.534313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.534426 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.534361    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a92e205-595a-41e6-bfd5-805d8123f709-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54476f698d-7b5z5\" (UID: \"8a92e205-595a-41e6-bfd5-805d8123f709\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"
Jul 03 11:13:30.534426 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.534385    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-hub\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.534426 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.534400    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9h8m\" (UniqueName: \"kubernetes.io/projected/8a92e205-595a-41e6-bfd5-805d8123f709-kube-api-access-w9h8m\") pod \"managed-serviceaccount-addon-agent-54476f698d-7b5z5\" (UID: \"8a92e205-595a-41e6-bfd5-805d8123f709\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"
Jul 03 11:13:30.635207 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.635173    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.635207 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.635205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jv4c\" (UniqueName: \"kubernetes.io/projected/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-kube-api-access-7jv4c\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.635424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.635234    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-ca\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.635424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.635250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.635424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.635272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a92e205-595a-41e6-bfd5-805d8123f709-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54476f698d-7b5z5\" (UID: \"8a92e205-595a-41e6-bfd5-805d8123f709\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"
Jul 03 11:13:30.635424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.635293    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-hub\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.635424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.635311    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9h8m\" (UniqueName: \"kubernetes.io/projected/8a92e205-595a-41e6-bfd5-805d8123f709-kube-api-access-w9h8m\") pod \"managed-serviceaccount-addon-agent-54476f698d-7b5z5\" (UID: \"8a92e205-595a-41e6-bfd5-805d8123f709\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"
Jul 03 11:13:30.635424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.635366    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.636289 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.636239    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.638432 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.638386    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-ca\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.638662 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.638624    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.638954 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.638721    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-hub\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.639048 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.638962    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.639048 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.639008    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8a92e205-595a-41e6-bfd5-805d8123f709-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-54476f698d-7b5z5\" (UID: \"8a92e205-595a-41e6-bfd5-805d8123f709\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"
Jul 03 11:13:30.650351 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.650329    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jv4c\" (UniqueName: \"kubernetes.io/projected/316322c5-627a-4a15-bfbc-4dfc9b7c39cb-kube-api-access-7jv4c\") pod \"cluster-proxy-proxy-agent-68cb65d76-vvk5k\" (UID: \"316322c5-627a-4a15-bfbc-4dfc9b7c39cb\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.652315 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.652295    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9h8m\" (UniqueName: \"kubernetes.io/projected/8a92e205-595a-41e6-bfd5-805d8123f709-kube-api-access-w9h8m\") pod \"managed-serviceaccount-addon-agent-54476f698d-7b5z5\" (UID: \"8a92e205-595a-41e6-bfd5-805d8123f709\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"
Jul 03 11:13:30.659909 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.659886    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:30.760646 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.760577    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:30.797528 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.797485    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"
Jul 03 11:13:30.805411 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.805388    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"
Jul 03 11:13:30.856671 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.856554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:30.928680 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.928650    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5"]
Jul 03 11:13:30.931556 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:30.931533    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a92e205_595a_41e6_bfd5_805d8123f709.slice/crio-789932a7812e4d249978832dca4af09903a5fe1bf9c86b50cd271606069577e3 WatchSource:0}: Error finding container 789932a7812e4d249978832dca4af09903a5fe1bf9c86b50cd271606069577e3: Status 404 returned error can't find the container with id 789932a7812e4d249978832dca4af09903a5fe1bf9c86b50cd271606069577e3
Jul 03 11:13:30.939522 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.939499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:30.952262 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:30.952241    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k"]
Jul 03 11:13:30.955106 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:30.955067    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod316322c5_627a_4a15_bfbc_4dfc9b7c39cb.slice/crio-cf025129f6407f2482073834cf29fcf670720d6401043a1225f481a2ddcc59c3 WatchSource:0}: Error finding container cf025129f6407f2482073834cf29fcf670720d6401043a1225f481a2ddcc59c3: Status 404 returned error can't find the container with id cf025129f6407f2482073834cf29fcf670720d6401043a1225f481a2ddcc59c3
Jul 03 11:13:31.027714 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:31.027653    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:31.083221 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:31.083197    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:31.368447 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:31.368369    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7jgwx"
Jul 03 11:13:31.400853 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:31.400824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5" event={"ID":"8a92e205-595a-41e6-bfd5-805d8123f709","Type":"ContainerStarted","Data":"789932a7812e4d249978832dca4af09903a5fe1bf9c86b50cd271606069577e3"}
Jul 03 11:13:31.402023 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:31.402002    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k" event={"ID":"316322c5-627a-4a15-bfbc-4dfc9b7c39cb","Type":"ContainerStarted","Data":"cf025129f6407f2482073834cf29fcf670720d6401043a1225f481a2ddcc59c3"}
Jul 03 11:13:32.622117 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:32.622018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:32.721395 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:32.721362    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:32.827206 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:32.827172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:32.931052 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:32.931018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:33.018647 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.018580    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:33.330693 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.330609    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:33.808157 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.808065    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:33.863556 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.863516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:13:33.863740 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.863584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:13:33.863740 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.863631    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:13:33.866862 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.866836    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 03 11:13:33.868032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.868012    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 03 11:13:33.868167 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.868051    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 03 11:13:33.876576 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.876552    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 03 11:13:33.877222 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.877197    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0db82fa3-1b75-465b-bd57-529f7c295e01-metrics-certs\") pod \"network-metrics-daemon-t9rjx\" (UID: \"0db82fa3-1b75-465b-bd57-529f7c295e01\") " pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:13:33.880675 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.880651    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e83fc8e8-4d70-4183-8d30-b0eaa07e8503-original-pull-secret\") pod \"global-pull-secret-syncer-xnf6q\" (UID: \"e83fc8e8-4d70-4183-8d30-b0eaa07e8503\") " pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:13:33.887675 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:33.887627    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr8xx\" (UniqueName: \"kubernetes.io/projected/d9e4134e-ffee-4194-8124-c8ba7bbd4d69-kube-api-access-rr8xx\") pod \"network-check-target-zzdfx\" (UID: \"d9e4134e-ffee-4194-8124-c8ba7bbd4d69\") " pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:13:34.006483 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:34.006452    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wfk2t\""
Jul 03 11:13:34.012179 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:34.012160    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qx6zp\""
Jul 03 11:13:34.014337 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:34.014309    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:13:34.014438 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:34.014346    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xnf6q"
Jul 03 11:13:34.020505 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:34.020483    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-t9rjx"
Jul 03 11:13:34.206794 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:34.206754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:34.282003 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:34.281971    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:35.689250 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:35.686662    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-t9rjx"]
Jul 03 11:13:35.691207 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:35.691156    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db82fa3_1b75_465b_bd57_529f7c295e01.slice/crio-005ce564d854a0a6a4f3ca026821a004817bdf00e1759ac6cf0a8070bd2ad42f WatchSource:0}: Error finding container 005ce564d854a0a6a4f3ca026821a004817bdf00e1759ac6cf0a8070bd2ad42f: Status 404 returned error can't find the container with id 005ce564d854a0a6a4f3ca026821a004817bdf00e1759ac6cf0a8070bd2ad42f
Jul 03 11:13:35.698551 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:35.698527    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xnf6q"]
Jul 03 11:13:35.702059 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:35.702027    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83fc8e8_4d70_4183_8d30_b0eaa07e8503.slice/crio-9840c89caf6f6327885cede4fa195d1d9d904ba9431260d97e4097c8b25bb92e WatchSource:0}: Error finding container 9840c89caf6f6327885cede4fa195d1d9d904ba9431260d97e4097c8b25bb92e: Status 404 returned error can't find the container with id 9840c89caf6f6327885cede4fa195d1d9d904ba9431260d97e4097c8b25bb92e
Jul 03 11:13:35.717695 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:35.717672    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zzdfx"]
Jul 03 11:13:35.722109 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:35.722056    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9e4134e_ffee_4194_8124_c8ba7bbd4d69.slice/crio-7b2afdc03119099d5963a0fc85607661d81d73ad9de822640243bcae3c8ffa91 WatchSource:0}: Error finding container 7b2afdc03119099d5963a0fc85607661d81d73ad9de822640243bcae3c8ffa91: Status 404 returned error can't find the container with id 7b2afdc03119099d5963a0fc85607661d81d73ad9de822640243bcae3c8ffa91
Jul 03 11:13:35.780547 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:35.780411    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:35.880499 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:35.880470    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:36.426025 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.425929    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t9rjx" event={"ID":"0db82fa3-1b75-465b-bd57-529f7c295e01","Type":"ContainerStarted","Data":"005ce564d854a0a6a4f3ca026821a004817bdf00e1759ac6cf0a8070bd2ad42f"}
Jul 03 11:13:36.429997 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.429116    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5" event={"ID":"8a92e205-595a-41e6-bfd5-805d8123f709","Type":"ContainerStarted","Data":"6cbc8f1a27e3390ae06c15dc7c24f31d75779329458aa84e8e31114f1fad666e"}
Jul 03 11:13:36.432809 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.432736    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k" event={"ID":"316322c5-627a-4a15-bfbc-4dfc9b7c39cb","Type":"ContainerStarted","Data":"03bb9d191cab9ad1451496a3e9e9bdd9f2ddc00eaf136ea93f26dd2db1a79217"}
Jul 03 11:13:36.432809 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.432771    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k" event={"ID":"316322c5-627a-4a15-bfbc-4dfc9b7c39cb","Type":"ContainerStarted","Data":"a4ac063d67b8aa72cd0590fc86821ab3959e0584afe819fb26bdc260642d2f62"}
Jul 03 11:13:36.432809 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.432786    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k" event={"ID":"316322c5-627a-4a15-bfbc-4dfc9b7c39cb","Type":"ContainerStarted","Data":"e62277dafca4d0e08a86f4a58945f14f54172735b7310df6998020cc06a63798"}
Jul 03 11:13:36.436316 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.436288    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zzdfx" event={"ID":"d9e4134e-ffee-4194-8124-c8ba7bbd4d69","Type":"ContainerStarted","Data":"7b2afdc03119099d5963a0fc85607661d81d73ad9de822640243bcae3c8ffa91"}
Jul 03 11:13:36.437775 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.437748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xnf6q" event={"ID":"e83fc8e8-4d70-4183-8d30-b0eaa07e8503","Type":"ContainerStarted","Data":"9840c89caf6f6327885cede4fa195d1d9d904ba9431260d97e4097c8b25bb92e"}
Jul 03 11:13:36.445941 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.445892    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-54476f698d-7b5z5" podStartSLOduration=1.857728221 podStartE2EDuration="6.445877536s" totalImagesPullingTime="4.588149315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:36.444998178 +0000 UTC m=+68.922269761" watchObservedRunningTime="2026-07-03 11:13:36.445877536 +0000 UTC m=+68.923149119"
Jul 03 11:13:36.463430 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.463357    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68cb65d76-vvk5k" podStartSLOduration=1.87941645 podStartE2EDuration="6.463337836s" totalImagesPullingTime="4.583921386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:13:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:36.462537522 +0000 UTC m=+68.939809104" watchObservedRunningTime="2026-07-03 11:13:36.463337836 +0000 UTC m=+68.940609424"
Jul 03 11:13:36.996051 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:36.996020    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:37.066561 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:37.066523    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:37.446383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:37.445389    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t9rjx" event={"ID":"0db82fa3-1b75-465b-bd57-529f7c295e01","Type":"ContainerStarted","Data":"a5e79050114273bd4c18d2d321b7a9dc904c2536fb027f6dc946c147a19aa3cd"}
Jul 03 11:13:37.446383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:37.445456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-t9rjx" event={"ID":"0db82fa3-1b75-465b-bd57-529f7c295e01","Type":"ContainerStarted","Data":"ca4684bed9dfda04e7909d0290b16c3493eb921f3ca8e19760a4d4720ec15e6b"}
Jul 03 11:13:37.462157 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:37.462103    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-t9rjx" podStartSLOduration=68.250029509 podStartE2EDuration="1m9.462089399s" totalImagesPullingTime="1.21205989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:37.461147975 +0000 UTC m=+69.938419556" watchObservedRunningTime="2026-07-03 11:13:37.462089399 +0000 UTC m=+69.939360975"
Jul 03 11:13:37.551038 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:37.550944    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:37.621890 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:37.621841    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:37.743345 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:37.743264    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:38.056676 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:38.056598    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:38.128175 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:38.128142    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:39.657178 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:39.657143    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:39.756572 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:39.756533    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:40.862553 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:40.862518    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:41.461463 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:41.461426    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zzdfx" event={"ID":"d9e4134e-ffee-4194-8124-c8ba7bbd4d69","Type":"ContainerStarted","Data":"20cd2a67916bba36e67aef29d369fec7f0d8ef7f66cb658607a8484030139e29"}
Jul 03 11:13:41.461648 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:41.461524    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:13:41.462796 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:41.462760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xnf6q" event={"ID":"e83fc8e8-4d70-4183-8d30-b0eaa07e8503","Type":"ContainerStarted","Data":"00ee12c9b99b61cd7b3139216de4a70e64cad101a1c31e22833a2d3e90e93276"}
Jul 03 11:13:41.480155 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:41.480110    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zzdfx" podStartSLOduration=68.532473677 podStartE2EDuration="1m13.480095484s" totalImagesPullingTime="4.947621807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:41.479630194 +0000 UTC m=+73.956901798" watchObservedRunningTime="2026-07-03 11:13:41.480095484 +0000 UTC m=+73.957367061"
Jul 03 11:13:41.496626 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:41.496580    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xnf6q" podStartSLOduration=68.525650965 podStartE2EDuration="1m13.496564899s" totalImagesPullingTime="4.970913934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:41.495799364 +0000 UTC m=+73.973070949" watchObservedRunningTime="2026-07-03 11:13:41.496564899 +0000 UTC m=+73.973836481"
Jul 03 11:13:41.652953 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:41.652910    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:43.019339 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.019304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:43.122682 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.122646    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:43.219644 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.219603    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:43.366212 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.366124    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:43.404805 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.404779    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-74g8z"]
Jul 03 11:13:43.407280 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.407264    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.410361 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.410327    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 03 11:13:43.410527 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.410436    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 03 11:13:43.410745 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.410727    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 03 11:13:43.411722 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.411700    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 03 11:13:43.411836 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.411733    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s5r7q\""
Jul 03 11:13:43.411939 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.411927    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 03 11:13:43.411985 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.411930    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 03 11:13:43.472398 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.472367    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:43.531622 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whvsj\" (UniqueName: \"kubernetes.io/projected/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-kube-api-access-whvsj\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.531622 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531626    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-sys\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.531808 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531643    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-root\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.531808 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531660    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-metrics-client-ca\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.531808 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-tls\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.531808 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531768    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.531808 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531797    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.532003 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-textfile\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.532003 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.531837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-wtmp\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.584535 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.584493    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:43.632360 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632278    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632360 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-textfile\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632360 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632341    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-wtmp\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632588 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whvsj\" (UniqueName: \"kubernetes.io/projected/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-kube-api-access-whvsj\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632588 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-sys\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632588 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-root\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632588 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632476    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-wtmp\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632588 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-metrics-client-ca\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632588 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-tls\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632868 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632868 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632600    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-root\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632868 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632555    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-sys\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632868 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:43.632704    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 03 11:13:43.632868 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-textfile\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.632868 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:13:43.632780    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-tls podName:c59d85d4-8375-4b7d-9911-b7dae78b2cc7 nodeName:}" failed. No retries permitted until 2026-07-03 11:13:44.132759603 +0000 UTC m=+76.610031165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-tls") pod "node-exporter-74g8z" (UID: "c59d85d4-8375-4b7d-9911-b7dae78b2cc7") : secret "node-exporter-tls" not found
Jul 03 11:13:43.633274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632937    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-accelerators-collector-config\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.633274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.632994    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-metrics-client-ca\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.634962 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.634944    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.641453 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.641431    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whvsj\" (UniqueName: \"kubernetes.io/projected/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-kube-api-access-whvsj\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:43.760705 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:43.760670    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:44.015037 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.015005    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:44.117918 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.117887    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:44.135999 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.135975    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-tls\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:44.138486 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.138465    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c59d85d4-8375-4b7d-9911-b7dae78b2cc7-node-exporter-tls\") pod \"node-exporter-74g8z\" (UID: \"c59d85d4-8375-4b7d-9911-b7dae78b2cc7\") " pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:44.316997 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.316913    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-74g8z"
Jul 03 11:13:44.326968 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:44.326934    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc59d85d4_8375_4b7d_9911_b7dae78b2cc7.slice/crio-f5e5f324eb236e2020d39e3f582dec374d7e1b0dd83d4e5013206023611db826 WatchSource:0}: Error finding container f5e5f324eb236e2020d39e3f582dec374d7e1b0dd83d4e5013206023611db826: Status 404 returned error can't find the container with id f5e5f324eb236e2020d39e3f582dec374d7e1b0dd83d4e5013206023611db826
Jul 03 11:13:44.472749 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.472715    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74g8z" event={"ID":"c59d85d4-8375-4b7d-9911-b7dae78b2cc7","Type":"ContainerStarted","Data":"f5e5f324eb236e2020d39e3f582dec374d7e1b0dd83d4e5013206023611db826"}
Jul 03 11:13:44.488832 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.488805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:44.588710 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.588624    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:44.699207 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.699175    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:44.787579 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.787542    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:44.886978 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.886888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:44.988937 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:44.988898    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:45.478022 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.477984    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74g8z" event={"ID":"c59d85d4-8375-4b7d-9911-b7dae78b2cc7","Type":"ContainerStarted","Data":"c7aaa3ed14597bb78472b8345dad6caaab46f872c4dd5146a336a8b852a98b50"}
Jul 03 11:13:45.618765 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.618681    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-578fc76456-8mfrm"]
Jul 03 11:13:45.621208 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.621184    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.623989 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.623940    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 03 11:13:45.623989 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.623951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 03 11:13:45.624227 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.624212    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 03 11:13:45.624325 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.624289    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 03 11:13:45.624400 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.624386    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 03 11:13:45.624472 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.624459    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wqt8d\""
Jul 03 11:13:45.624535 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.624519    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9oktv18cb1vkf\""
Jul 03 11:13:45.640356 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.640325    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-578fc76456-8mfrm"]
Jul 03 11:13:45.748460 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.748423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.748460 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.748464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.748678 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.748486    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkvqq\" (UniqueName: \"kubernetes.io/projected/e258051b-f1db-4e54-bd78-28b33ff26636-kube-api-access-xkvqq\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.748678 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.748544    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-tls\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.748678 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.748580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.748678 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.748605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-grpc-tls\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.748678 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.748635    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.748678 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.748662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e258051b-f1db-4e54-bd78-28b33ff26636-metrics-client-ca\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.849289 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.849248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-tls\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.849482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.849296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.849482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.849327    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-grpc-tls\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.849482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.849358    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.849482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.849384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e258051b-f1db-4e54-bd78-28b33ff26636-metrics-client-ca\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.849482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.849427    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.849482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.849454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.849788 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.849484    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkvqq\" (UniqueName: \"kubernetes.io/projected/e258051b-f1db-4e54-bd78-28b33ff26636-kube-api-access-xkvqq\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.850461 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.850431    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e258051b-f1db-4e54-bd78-28b33ff26636-metrics-client-ca\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.852006 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.851980    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.852269 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.852240    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-tls\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.852537 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.852511    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.852579 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.852545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-grpc-tls\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.852579 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.852546    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.852671 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.852651    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e258051b-f1db-4e54-bd78-28b33ff26636-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.858064 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.858037    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkvqq\" (UniqueName: \"kubernetes.io/projected/e258051b-f1db-4e54-bd78-28b33ff26636-kube-api-access-xkvqq\") pod \"thanos-querier-578fc76456-8mfrm\" (UID: \"e258051b-f1db-4e54-bd78-28b33ff26636\") " pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:45.930260 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:45.930230    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:46.071291 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:46.071217    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-578fc76456-8mfrm"]
Jul 03 11:13:46.073743 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:13:46.073719    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode258051b_f1db_4e54_bd78_28b33ff26636.slice/crio-91c48920588235e6eb10862827c497d326628b062703209263b7a14d6e0dbce5 WatchSource:0}: Error finding container 91c48920588235e6eb10862827c497d326628b062703209263b7a14d6e0dbce5: Status 404 returned error can't find the container with id 91c48920588235e6eb10862827c497d326628b062703209263b7a14d6e0dbce5
Jul 03 11:13:46.368668 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:46.368581    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:46.465154 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:46.465117    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:46.483387 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:46.483353    2582 generic.go:356] "Generic (PLEG): container finished" podID="c59d85d4-8375-4b7d-9911-b7dae78b2cc7" containerID="c7aaa3ed14597bb78472b8345dad6caaab46f872c4dd5146a336a8b852a98b50" exitCode=0
Jul 03 11:13:46.483814 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:46.483442    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74g8z" event={"ID":"c59d85d4-8375-4b7d-9911-b7dae78b2cc7","Type":"ContainerDied","Data":"c7aaa3ed14597bb78472b8345dad6caaab46f872c4dd5146a336a8b852a98b50"}
Jul 03 11:13:46.484723 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:46.484695    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm" event={"ID":"e258051b-f1db-4e54-bd78-28b33ff26636","Type":"ContainerStarted","Data":"91c48920588235e6eb10862827c497d326628b062703209263b7a14d6e0dbce5"}
Jul 03 11:13:46.899157 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:46.899121    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:47.000172 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:47.000136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:47.490721 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:47.490681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74g8z" event={"ID":"c59d85d4-8375-4b7d-9911-b7dae78b2cc7","Type":"ContainerStarted","Data":"715e6f5a66b7ec8f2ca90fe5375f7e3c0420e5486faa896f497f7cfe12ffb7da"}
Jul 03 11:13:47.491113 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:47.490731    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-74g8z" event={"ID":"c59d85d4-8375-4b7d-9911-b7dae78b2cc7","Type":"ContainerStarted","Data":"cddc60b3567b38ed25352c1e7bf539d50ac1b68943cc66301400ab0719335997"}
Jul 03 11:13:47.510786 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:47.510733    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-74g8z" podStartSLOduration=3.416392258 podStartE2EDuration="4.510718015s" totalImagesPullingTime="1.020710156s" totalInitContainerRuntime="73.615601ms" isStatefulPod=true podCreationTimestamp="2026-07-03 11:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:47.508973939 +0000 UTC m=+79.986245523" watchObservedRunningTime="2026-07-03 11:13:47.510718015 +0000 UTC m=+79.987989597"
Jul 03 11:13:47.747291 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:47.747201    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:47.832911 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:47.832885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:48.053866 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:48.053711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:48.153301 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:48.153265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:48.235822 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:48.235784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:48.496613 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:48.496579    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm" event={"ID":"e258051b-f1db-4e54-bd78-28b33ff26636","Type":"ContainerStarted","Data":"88d812c46cc3713c60398fbbd5f4a4a0d4700052d3fbaa4033126b9eda70e934"}
Jul 03 11:13:48.497045 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:48.496827    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm" event={"ID":"e258051b-f1db-4e54-bd78-28b33ff26636","Type":"ContainerStarted","Data":"e3c9a88b932113f05b443657d386a99ee35d44f08ad36e5e38fb6643478b56e7"}
Jul 03 11:13:48.497327 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:48.497301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm" event={"ID":"e258051b-f1db-4e54-bd78-28b33ff26636","Type":"ContainerStarted","Data":"ab2d3002745bf60d22056e395fd2660819acf044d254fc88ae8cfaad6939b14d"}
Jul 03 11:13:48.555695 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:48.555644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:49.503989 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:49.503957    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm" event={"ID":"e258051b-f1db-4e54-bd78-28b33ff26636","Type":"ContainerStarted","Data":"e3392bd9798325ab60b54f20b3c61d85927acedb77f53e4e6b576aa0e3b4b427"}
Jul 03 11:13:49.504385 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:49.504021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm" event={"ID":"e258051b-f1db-4e54-bd78-28b33ff26636","Type":"ContainerStarted","Data":"501151ee6f976674a68b220cf6c2930d6703e4aac9282fe8430a6df0ff3f7e4a"}
Jul 03 11:13:49.504385 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:49.504066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm" event={"ID":"e258051b-f1db-4e54-bd78-28b33ff26636","Type":"ContainerStarted","Data":"e9df98a83b13e418e11ce04d124dd34e52b1907e56740c38bb0f88b8bc7ebff5"}
Jul 03 11:13:49.504385 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:49.504121    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:49.528635 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:49.528580    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm" podStartSLOduration=1.474644616 podStartE2EDuration="4.528565199s" totalImagesPullingTime="3.053920583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:13:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:13:49.526767746 +0000 UTC m=+82.004039331" watchObservedRunningTime="2026-07-03 11:13:49.528565199 +0000 UTC m=+82.005836780"
Jul 03 11:13:49.673467 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:49.673431    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:54.634959 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:54.634926    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:54.735422 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:54.735370    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:54.835855 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:54.835821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:55.513668 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:55.513642    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-578fc76456-8mfrm"
Jul 03 11:13:56.142163 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:56.142128    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:56.242900 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:56.242864    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:57.615209 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:57.615176    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:57.692053 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:57.692014    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:58.015159 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:58.015128    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:58.085743 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:58.085714    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:13:59.947875 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:13:59.947838    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:14:00.009219 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:00.009156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:14:00.066471 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:00.066444    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:14:12.467926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:12.467894    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zzdfx"
Jul 03 11:14:28.037822 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:28.037789    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:14:28.102649 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:28.102619    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:14:29.530773 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:29.530742    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shr2q_46eb8232-a854-4f61-8313-2663b706525b/serve-healthcheck-canary/0.log"
Jul 03 11:14:38.729766 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:38.729725    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:14:38.829482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:38.829450    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:14:38.917317 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:14:38.917291    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:02.663044 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:02.663008    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:02.930088 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:02.929969    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:12.787307 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:12.787276    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:12.856233 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:12.856203    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:12.927209 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:12.927176    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:13.519416 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:13.519383    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:13.585831 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:13.585787    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:24.168010 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:24.167885    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:24.268438 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:24.268400    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:24.329193 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:24.329153    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:59.611304 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:59.611270    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:15:59.670267 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:15:59.670236    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:17.892018 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:17.891983    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:17.952557 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:17.952529    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:18.769277 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:18.769240    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:22.327235 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:22.327209    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:22.795871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:22.795843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:29.885089 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:29.885036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:29.979246 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:29.979215    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:33.486906 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:33.486870    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:33.605132 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:33.605100    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:33.711196 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:33.711164    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:43.079642 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:43.079608    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:16:43.227942 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:16:43.227917    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:25.133521 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:25.133485    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:26.946827 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:26.946798    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:27.049387 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:27.049357    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:27.943294 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:27.943262    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:17:27.947765 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:27.947743    2582 kubelet.go:1648] "Image garbage collection succeeded"
Jul 03 11:17:27.948341 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:27.948323    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:17:48.309023 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:48.308993    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:48.818965 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:48.818933    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:52.830552 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:52.830512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:52.927733 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:52.927704    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:57.473767 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:57.473739    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:17:57.559097 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:17:57.559051    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:06.830447 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:06.830401    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:06.996960 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:06.996931    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:07.173951 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:07.173921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:07.349993 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:07.349943    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:09.228770 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:09.228734    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:09.617086 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:09.616968    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:16.340134 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:16.340097    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:16.440988 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:16.440963    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:17.016580 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.016549    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:17.245878 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.245849    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lbs5k"]
Jul 03 11:18:17.247854 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.247838    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lbs5k"
Jul 03 11:18:17.251636 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.251615    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 03 11:18:17.251946 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.251932    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 03 11:18:17.252901 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.252889    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-j9zps\""
Jul 03 11:18:17.267771 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.267706    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lbs5k"]
Jul 03 11:18:17.360425 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.360392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkcvf\" (UniqueName: \"kubernetes.io/projected/1f6dbc50-0bc5-444b-8fe9-b82f25c729cc-kube-api-access-tkcvf\") pod \"cert-manager-55b4d954d5-lbs5k\" (UID: \"1f6dbc50-0bc5-444b-8fe9-b82f25c729cc\") " pod="cert-manager/cert-manager-55b4d954d5-lbs5k"
Jul 03 11:18:17.360425 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.360437    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f6dbc50-0bc5-444b-8fe9-b82f25c729cc-bound-sa-token\") pod \"cert-manager-55b4d954d5-lbs5k\" (UID: \"1f6dbc50-0bc5-444b-8fe9-b82f25c729cc\") " pod="cert-manager/cert-manager-55b4d954d5-lbs5k"
Jul 03 11:18:17.461134 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.461062    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkcvf\" (UniqueName: \"kubernetes.io/projected/1f6dbc50-0bc5-444b-8fe9-b82f25c729cc-kube-api-access-tkcvf\") pod \"cert-manager-55b4d954d5-lbs5k\" (UID: \"1f6dbc50-0bc5-444b-8fe9-b82f25c729cc\") " pod="cert-manager/cert-manager-55b4d954d5-lbs5k"
Jul 03 11:18:17.461319 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.461149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f6dbc50-0bc5-444b-8fe9-b82f25c729cc-bound-sa-token\") pod \"cert-manager-55b4d954d5-lbs5k\" (UID: \"1f6dbc50-0bc5-444b-8fe9-b82f25c729cc\") " pod="cert-manager/cert-manager-55b4d954d5-lbs5k"
Jul 03 11:18:17.476639 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.476609    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1f6dbc50-0bc5-444b-8fe9-b82f25c729cc-bound-sa-token\") pod \"cert-manager-55b4d954d5-lbs5k\" (UID: \"1f6dbc50-0bc5-444b-8fe9-b82f25c729cc\") " pod="cert-manager/cert-manager-55b4d954d5-lbs5k"
Jul 03 11:18:17.476760 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.476747    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkcvf\" (UniqueName: \"kubernetes.io/projected/1f6dbc50-0bc5-444b-8fe9-b82f25c729cc-kube-api-access-tkcvf\") pod \"cert-manager-55b4d954d5-lbs5k\" (UID: \"1f6dbc50-0bc5-444b-8fe9-b82f25c729cc\") " pod="cert-manager/cert-manager-55b4d954d5-lbs5k"
Jul 03 11:18:17.556729 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.556616    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lbs5k"
Jul 03 11:18:17.688307 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.688281    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lbs5k"]
Jul 03 11:18:17.690594 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:18:17.690568    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f6dbc50_0bc5_444b_8fe9_b82f25c729cc.slice/crio-e957f9ef132d811028a78f9467dcfd4e1a84334a74789da369465ca9bd2d6a1b WatchSource:0}: Error finding container e957f9ef132d811028a78f9467dcfd4e1a84334a74789da369465ca9bd2d6a1b: Status 404 returned error can't find the container with id e957f9ef132d811028a78f9467dcfd4e1a84334a74789da369465ca9bd2d6a1b
Jul 03 11:18:17.692400 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:17.692376    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 11:18:18.406517 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:18.406421    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lbs5k" event={"ID":"1f6dbc50-0bc5-444b-8fe9-b82f25c729cc","Type":"ContainerStarted","Data":"e957f9ef132d811028a78f9467dcfd4e1a84334a74789da369465ca9bd2d6a1b"}
Jul 03 11:18:19.842650 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:19.842607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:19.940499 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:19.940467    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:21.419725 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:21.419689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lbs5k" event={"ID":"1f6dbc50-0bc5-444b-8fe9-b82f25c729cc","Type":"ContainerStarted","Data":"03605b54cadb2dd44b74272385b71b226445db43a203df2e1084c248203c8c1b"}
Jul 03 11:18:21.438493 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:21.438352    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lbs5k" podStartSLOduration=1.545541149 podStartE2EDuration="4.438329527s" totalImagesPullingTime="2.892788378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:18:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:18:21.437040602 +0000 UTC m=+353.914312183" watchObservedRunningTime="2026-07-03 11:18:21.438329527 +0000 UTC m=+353.915601110"
Jul 03 11:18:27.513707 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:27.513669    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:27.626996 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:27.626964    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:29.242879 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:29.242846    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:41.946219 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:41.946180    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:42.041908 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:42.041877    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:42.536588 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:42.536551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:42.914819 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:42.914797    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:43.013499 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.013468    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:43.069123 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.069082    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"]
Jul 03 11:18:43.073831 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.073809    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.076752 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.076730    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 03 11:18:43.076869 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.076813    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 03 11:18:43.076869 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.076818    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nbwwk\""
Jul 03 11:18:43.076869 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.076812    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 03 11:18:43.077049 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.076812    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 03 11:18:43.096040 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.096021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"]
Jul 03 11:18:43.150301 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.150275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f7bd01d-75af-4212-a85b-ffe9855867b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.150445 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.150390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7bd01d-75af-4212-a85b-ffe9855867b9-tmp\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.150445 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.150416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f7bd01d-75af-4212-a85b-ffe9855867b9-manifests\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.150445 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.150438    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f7bd01d-75af-4212-a85b-ffe9855867b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.150610 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.150487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8llg2\" (UniqueName: \"kubernetes.io/projected/5f7bd01d-75af-4212-a85b-ffe9855867b9-kube-api-access-8llg2\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.238774 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.238711    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:43.251045 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.251025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f7bd01d-75af-4212-a85b-ffe9855867b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.251116 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.251055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8llg2\" (UniqueName: \"kubernetes.io/projected/5f7bd01d-75af-4212-a85b-ffe9855867b9-kube-api-access-8llg2\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.251116 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.251109    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f7bd01d-75af-4212-a85b-ffe9855867b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.251197 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.251175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7bd01d-75af-4212-a85b-ffe9855867b9-tmp\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.251243 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.251201    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f7bd01d-75af-4212-a85b-ffe9855867b9-manifests\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.251609 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.251583    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5f7bd01d-75af-4212-a85b-ffe9855867b9-manifests\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.253718 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.253686    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5f7bd01d-75af-4212-a85b-ffe9855867b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.253819 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.253754    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5f7bd01d-75af-4212-a85b-ffe9855867b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.253973 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.253958    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5f7bd01d-75af-4212-a85b-ffe9855867b9-tmp\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.260660 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.260636    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8llg2\" (UniqueName: \"kubernetes.io/projected/5f7bd01d-75af-4212-a85b-ffe9855867b9-kube-api-access-8llg2\") pod \"opendatahub-operator-controller-manager-b8c56cd69-h8s9p\" (UID: \"5f7bd01d-75af-4212-a85b-ffe9855867b9\") " pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.336195 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.336166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:43.383507 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.383482    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:43.435921 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.435877    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:43.518269 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.518249    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"]
Jul 03 11:18:43.520326 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:18:43.520301    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7bd01d_75af_4212_a85b_ffe9855867b9.slice/crio-f3dc5f8a746ca1039e6d8323104c38eae6962909cbd23fafd5f6257e95cd558e WatchSource:0}: Error finding container f3dc5f8a746ca1039e6d8323104c38eae6962909cbd23fafd5f6257e95cd558e: Status 404 returned error can't find the container with id f3dc5f8a746ca1039e6d8323104c38eae6962909cbd23fafd5f6257e95cd558e
Jul 03 11:18:43.528131 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.528099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:43.624259 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:43.624229    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:44.498482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:44.498410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p" event={"ID":"5f7bd01d-75af-4212-a85b-ffe9855867b9","Type":"ContainerStarted","Data":"f3dc5f8a746ca1039e6d8323104c38eae6962909cbd23fafd5f6257e95cd558e"}
Jul 03 11:18:47.510634 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:47.510599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p" event={"ID":"5f7bd01d-75af-4212-a85b-ffe9855867b9","Type":"ContainerStarted","Data":"7908f5fb18e1287ae675e28295372ed307e20ce81f06a9738616ef4a3c7b5a18"}
Jul 03 11:18:48.515815 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:48.515777    2582 generic.go:356] "Generic (PLEG): container finished" podID="5f7bd01d-75af-4212-a85b-ffe9855867b9" containerID="7908f5fb18e1287ae675e28295372ed307e20ce81f06a9738616ef4a3c7b5a18" exitCode=0
Jul 03 11:18:48.516298 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:48.515836    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p" event={"ID":"5f7bd01d-75af-4212-a85b-ffe9855867b9","Type":"ContainerDied","Data":"7908f5fb18e1287ae675e28295372ed307e20ce81f06a9738616ef4a3c7b5a18"}
Jul 03 11:18:49.521756 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:49.521718    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p" event={"ID":"5f7bd01d-75af-4212-a85b-ffe9855867b9","Type":"ContainerStarted","Data":"393dae07671bf589ecd473c4b7f89bee0b7796c6660361187ccb49f708578343"}
Jul 03 11:18:49.522210 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:49.521823    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:18:49.550046 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:49.549995    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p" podStartSLOduration=2.284572135 podStartE2EDuration="6.549980126s" totalImagesPullingTime="3.244006384s" totalInitContainerRuntime="1.021401607s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:18:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:18:49.547553976 +0000 UTC m=+382.024825576" watchObservedRunningTime="2026-07-03 11:18:49.549980126 +0000 UTC m=+382.027251706"
Jul 03 11:18:51.559345 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:51.559293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:18:51.674361 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:18:51.674334    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:00.528064 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:00.528035    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b8c56cd69-h8s9p"
Jul 03 11:19:02.296883 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.296848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:02.433931 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.433896    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:02.583376 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.583296    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"]
Jul 03 11:19:02.593359 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.593330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.597648 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.597612    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fnjxq\""
Jul 03 11:19:02.597797 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.597611    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 03 11:19:02.597797 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.597614    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 03 11:19:02.597797 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.597614    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 03 11:19:02.597797 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.597621    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 03 11:19:02.597797 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.597621    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 03 11:19:02.607647 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.607624    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"]
Jul 03 11:19:02.695645 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.695611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6079c357-7d47-431e-ae35-2f3cf866cc32-cert\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.695645 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.695644    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsqvn\" (UniqueName: \"kubernetes.io/projected/6079c357-7d47-431e-ae35-2f3cf866cc32-kube-api-access-zsqvn\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.695839 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.695671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6079c357-7d47-431e-ae35-2f3cf866cc32-metrics-cert\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.695839 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.695693    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6079c357-7d47-431e-ae35-2f3cf866cc32-manager-config\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.796941 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.796906    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6079c357-7d47-431e-ae35-2f3cf866cc32-metrics-cert\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.796941 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.796941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6079c357-7d47-431e-ae35-2f3cf866cc32-manager-config\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.797168 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.797006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6079c357-7d47-431e-ae35-2f3cf866cc32-cert\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.797168 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.797025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsqvn\" (UniqueName: \"kubernetes.io/projected/6079c357-7d47-431e-ae35-2f3cf866cc32-kube-api-access-zsqvn\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.797826 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.797729    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6079c357-7d47-431e-ae35-2f3cf866cc32-manager-config\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.799562 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.799539    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6079c357-7d47-431e-ae35-2f3cf866cc32-metrics-cert\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.799690 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.799669    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6079c357-7d47-431e-ae35-2f3cf866cc32-cert\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.824698 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.824666    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsqvn\" (UniqueName: \"kubernetes.io/projected/6079c357-7d47-431e-ae35-2f3cf866cc32-kube-api-access-zsqvn\") pod \"lws-controller-manager-6f9f46b759-skd6k\" (UID: \"6079c357-7d47-431e-ae35-2f3cf866cc32\") " pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:02.902944 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:02.902865    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:03.051598 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:03.051566    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:03.060759 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:19:03.060731    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6079c357_7d47_431e_ae35_2f3cf866cc32.slice/crio-9067c068175686af489673fe5f662cd34fa750342574573c58a977b23a78a9a5 WatchSource:0}: Error finding container 9067c068175686af489673fe5f662cd34fa750342574573c58a977b23a78a9a5: Status 404 returned error can't find the container with id 9067c068175686af489673fe5f662cd34fa750342574573c58a977b23a78a9a5
Jul 03 11:19:03.063714 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:03.063693    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"]
Jul 03 11:19:03.264831 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:03.264803    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:03.357430 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:03.357399    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:03.456169 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:03.456136    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:03.572066 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:03.571976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k" event={"ID":"6079c357-7d47-431e-ae35-2f3cf866cc32","Type":"ContainerStarted","Data":"9067c068175686af489673fe5f662cd34fa750342574573c58a977b23a78a9a5"}
Jul 03 11:19:03.579596 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:03.579565    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:04.172091 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:04.172048    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:04.820414 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:04.820382    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:05.379026 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:05.378994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:05.581400 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:05.581372    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:06.585515 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:06.585479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k" event={"ID":"6079c357-7d47-431e-ae35-2f3cf866cc32","Type":"ContainerStarted","Data":"c33e3248caf64570a6aa0505f1c40ea4fccc4bd2a65fc542ead3c23c4e411071"}
Jul 03 11:19:06.585952 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:06.585578    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:06.851306 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:06.851223    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:11.812279 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:11.812245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:12.465190 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.465133    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k" podStartSLOduration=7.425355229 podStartE2EDuration="10.465116529s" totalImagesPullingTime="3.0397613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:19:06.618948801 +0000 UTC m=+399.096220382" watchObservedRunningTime="2026-07-03 11:19:12.465116529 +0000 UTC m=+404.942388111"
Jul 03 11:19:12.465571 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.465556    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"]
Jul 03 11:19:12.468887 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.468866    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.472779 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.472761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 03 11:19:12.473057 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.473043    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 03 11:19:12.473608 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.473588    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 03 11:19:12.473710 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.473619    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-r5vhc\""
Jul 03 11:19:12.473710 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.473623    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 03 11:19:12.475750 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.475732    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 03 11:19:12.476597 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.476579    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 03 11:19:12.490459 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.490435    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"]
Jul 03 11:19:12.573203 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.573166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.573382 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.573212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7n9q\" (UniqueName: \"kubernetes.io/projected/be4fb84d-39e2-4385-8466-49a64dadddfa-kube-api-access-g7n9q\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.573382 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.573235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.573382 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.573344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4fb84d-39e2-4385-8466-49a64dadddfa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.573382 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.573377    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.573516 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.573402    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.573516 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.573443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.673979 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.673939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4fb84d-39e2-4385-8466-49a64dadddfa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.673979 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.673982    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.674260 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.674014    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.674260 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.674042    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.674260 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.674098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.674260 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.674138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7n9q\" (UniqueName: \"kubernetes.io/projected/be4fb84d-39e2-4385-8466-49a64dadddfa-kube-api-access-g7n9q\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.674260 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.674161    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.674947 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.674812    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.676610 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.676579    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.676610 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.676601    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.676758 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.676633    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/be4fb84d-39e2-4385-8466-49a64dadddfa-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.676758 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.676639    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/be4fb84d-39e2-4385-8466-49a64dadddfa-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.684684 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.684652    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7n9q\" (UniqueName: \"kubernetes.io/projected/be4fb84d-39e2-4385-8466-49a64dadddfa-kube-api-access-g7n9q\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.684781 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.684659    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be4fb84d-39e2-4385-8466-49a64dadddfa-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-c4prh\" (UID: \"be4fb84d-39e2-4385-8466-49a64dadddfa\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.778522 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.778424    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:12.926671 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:12.926644    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"]
Jul 03 11:19:12.930203 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:19:12.930177    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4fb84d_39e2_4385_8466_49a64dadddfa.slice/crio-5c1ffde6c3df05f85dadb648fde387aa8e8bc1072a76d3dda9bb2ba986f57ae9 WatchSource:0}: Error finding container 5c1ffde6c3df05f85dadb648fde387aa8e8bc1072a76d3dda9bb2ba986f57ae9: Status 404 returned error can't find the container with id 5c1ffde6c3df05f85dadb648fde387aa8e8bc1072a76d3dda9bb2ba986f57ae9
Jul 03 11:19:13.612973 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:13.612930    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh" event={"ID":"be4fb84d-39e2-4385-8466-49a64dadddfa","Type":"ContainerStarted","Data":"5c1ffde6c3df05f85dadb648fde387aa8e8bc1072a76d3dda9bb2ba986f57ae9"}
Jul 03 11:19:15.039683 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:15.039639    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 03 11:19:15.039994 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:15.039709    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 03 11:19:15.622206 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:15.622175    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh" event={"ID":"be4fb84d-39e2-4385-8466-49a64dadddfa","Type":"ContainerStarted","Data":"fd0bb3647d52705f3a0fa1acfbee82587a359000e25d7c1755c7143c9323d018"}
Jul 03 11:19:15.622373 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:15.622308    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:19:15.830684 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:15.830627    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh" podStartSLOduration=1.723784279 podStartE2EDuration="3.830611229s" totalImagesPullingTime="2.10682695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:19:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:19:15.807325179 +0000 UTC m=+408.284596760" watchObservedRunningTime="2026-07-03 11:19:15.830611229 +0000 UTC m=+408.307882811"
Jul 03 11:19:15.954559 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:15.954524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:16.258640 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:16.258558    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:16.513873 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:16.513790    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:16.627404 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:16.627376    2582 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-c4prh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 03 11:19:16.627555 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:16.627427    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh" podUID="be4fb84d-39e2-4385-8466-49a64dadddfa" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 03 11:19:16.704657 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:16.704629    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:16.876391 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:16.876300    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:17.590781 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:17.590751    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f9f46b759-skd6k"
Jul 03 11:19:18.146132 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:18.146092    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:18.454864 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:18.454815    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:18.550427 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:18.550394    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:19.076895 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:19.076859    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:19.225681 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:19.225650    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:19.302656 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:19.302628    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:19:19.627024 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:19:19.626992    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-c4prh"
Jul 03 11:20:03.654572 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:03.654489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:03.757581 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:03.757532    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:03.880989 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:03.880957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:04.656021 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:04.655987    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:04.795743 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:04.795679    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:25.805696 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:25.805658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:25.946477 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:25.946434    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:33.440282 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:33.440247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:36.804762 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:36.804730    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:36.909745 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:36.909712    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:37.011038 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:37.011007    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:37.111690 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:37.111597    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:37.439434 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:37.439400    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:39.836586 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:39.836554    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:40.122806 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:40.122720    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:40.450481 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:40.450437    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:43.841827 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:43.841800    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:44.862988 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:44.862904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:46.963893 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:46.963855    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:48.713961 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:48.713921    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:50.059474 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:50.059441    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:50.211788 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:50.211697    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:53.828627 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:53.828589    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:53.933906 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:53.933869    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:57.282015 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:57.281947    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:57.382032 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:57.381998    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:57.470532 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:57.470488    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:57.829895 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:57.829836    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:58.047198 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:58.047166    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:58.188845 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:58.188811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:58.432055 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:58.432023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:20:58.523504 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:20:58.523427    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:01.415617 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:01.415576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:01.566164 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:01.566132    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:08.087865 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:08.087821    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:08.202539 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:08.202508    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:10.970162 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:10.970134    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:11.102267 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:11.102235    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:15.687067 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:15.687025    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:15.783964 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:15.783933    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:19.330033 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:19.329954    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:19.424463 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:19.424430    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:24.759568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:24.759534    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:24.876065 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:24.876036    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:25.987151 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:25.987119    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:26.092414 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:26.092383    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:29.276754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:29.276718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:29.836966 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:29.836935    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:33.739143 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:33.739111    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:33.836565 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:33.836536    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:33.936488 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:33.936448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:34.008846 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:34.008754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:36.301266 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:36.301235    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:36.975669 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:36.975632    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:38.049410 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.049352    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:38.176732 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.176696    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:38.275305 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.275270    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:38.431878 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.431845    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:21:38.435051 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.435034    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:38.438205 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.438183    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 03 11:21:38.438328 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.438184    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wfhwf\""
Jul 03 11:21:38.438328 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.438249    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 03 11:21:38.438328 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.438279    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 03 11:21:38.448419 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.448399    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:21:38.490023 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.489985    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:21:38.498935 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.498908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfdpm\" (UniqueName: \"kubernetes.io/projected/21569902-538d-40bf-8623-bb62f9d8bf03-kube-api-access-tfdpm\") pod \"limitador-limitador-54d6d988d5-54dmh\" (UID: \"21569902-538d-40bf-8623-bb62f9d8bf03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:38.499011 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.498949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21569902-538d-40bf-8623-bb62f9d8bf03-config-file\") pod \"limitador-limitador-54d6d988d5-54dmh\" (UID: \"21569902-538d-40bf-8623-bb62f9d8bf03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:38.600023 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.599986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfdpm\" (UniqueName: \"kubernetes.io/projected/21569902-538d-40bf-8623-bb62f9d8bf03-kube-api-access-tfdpm\") pod \"limitador-limitador-54d6d988d5-54dmh\" (UID: \"21569902-538d-40bf-8623-bb62f9d8bf03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:38.600023 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.600030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21569902-538d-40bf-8623-bb62f9d8bf03-config-file\") pod \"limitador-limitador-54d6d988d5-54dmh\" (UID: \"21569902-538d-40bf-8623-bb62f9d8bf03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:38.600680 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.600658    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/21569902-538d-40bf-8623-bb62f9d8bf03-config-file\") pod \"limitador-limitador-54d6d988d5-54dmh\" (UID: \"21569902-538d-40bf-8623-bb62f9d8bf03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:38.622224 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.622194    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfdpm\" (UniqueName: \"kubernetes.io/projected/21569902-538d-40bf-8623-bb62f9d8bf03-kube-api-access-tfdpm\") pod \"limitador-limitador-54d6d988d5-54dmh\" (UID: \"21569902-538d-40bf-8623-bb62f9d8bf03\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:38.745486 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.745387    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:38.899277 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:38.899247    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:21:38.903215 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:21:38.903186    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21569902_538d_40bf_8623_bb62f9d8bf03.slice/crio-9a05c8418b23bde7bb30f6b9283aad4a829ec54488a97523290b6cefb18a6749 WatchSource:0}: Error finding container 9a05c8418b23bde7bb30f6b9283aad4a829ec54488a97523290b6cefb18a6749: Status 404 returned error can't find the container with id 9a05c8418b23bde7bb30f6b9283aad4a829ec54488a97523290b6cefb18a6749
Jul 03 11:21:39.029126 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:39.029028    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:39.137145 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:39.137108    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh" event={"ID":"21569902-538d-40bf-8623-bb62f9d8bf03","Type":"ContainerStarted","Data":"9a05c8418b23bde7bb30f6b9283aad4a829ec54488a97523290b6cefb18a6749"}
Jul 03 11:21:39.183149 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:39.183116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:39.288108 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:39.288010    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:21:42.149464 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:42.149433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh" event={"ID":"21569902-538d-40bf-8623-bb62f9d8bf03","Type":"ContainerStarted","Data":"f814d14c097046ade5d740f94ed2901348b202aa6219e8a7efe4a68bc0d2add0"}
Jul 03 11:21:42.149854 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:42.149544    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:42.172433 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:42.172381    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh" podStartSLOduration=1.740104291 podStartE2EDuration="4.17236616s" totalImagesPullingTime="2.432261869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:21:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:21:42.171523633 +0000 UTC m=+554.648795215" watchObservedRunningTime="2026-07-03 11:21:42.17236616 +0000 UTC m=+554.649637741"
Jul 03 11:21:53.154726 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:53.154686    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-54dmh"
Jul 03 11:21:59.642117 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:21:59.642058    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:11.554387 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:11.554339    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:11.707821 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:11.707786    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:17.564495 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:17.564461    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:17.660684 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:17.660652    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:17.759803 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:17.759769    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:18.091852 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:18.091820    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:20.817703 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:20.817674    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:20.908186 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:20.908155    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:27.966946 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:27.966917    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:22:27.969895 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:27.969874    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:22:51.636239 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:51.636206    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:52.998901 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:52.998864    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:22:53.081791 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:22:53.081755    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:23:03.325356 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:03.325317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:03.417855 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:03.417804    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:23.604023 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:23.603968    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:23.904191 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:23.904165    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:23:35.525491 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:35.525446    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:36.401766 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:36.401728    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:23:41.595181 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.595139    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"]
Jul 03 11:23:41.600580 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.600550    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.604365 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.604343    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 03 11:23:41.604365 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.604349    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 03 11:23:41.604580 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.604384    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 03 11:23:41.604580 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.604345    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6qpt2\""
Jul 03 11:23:41.607593 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.607565    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"]
Jul 03 11:23:41.621219 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.621184    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:41.665668 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.665630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.665668 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.665671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.665933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.665692    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggfpp\" (UniqueName: \"kubernetes.io/projected/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-kube-api-access-ggfpp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.665933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.665712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.665933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.665771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.665933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.665868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.766942 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.766898    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.767187 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.766959    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.767187 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.766985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggfpp\" (UniqueName: \"kubernetes.io/projected/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-kube-api-access-ggfpp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.767187 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.767063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.767187 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.767118    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.767187 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.767145    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.767575 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.767548    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.767575 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.767565    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.767796 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.767765    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.769794 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.769772    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.770046 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.770028    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.776461 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.776439    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggfpp\" (UniqueName: \"kubernetes.io/projected/9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b-kube-api-access-ggfpp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7gjrk\" (UID: \"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:41.912161 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:41.912121    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:42.048467 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:42.048334    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"]
Jul 03 11:23:42.051302 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:23:42.051107    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a23a2b0_0f4a_4800_b12d_5bd5b07aad0b.slice/crio-a57235d42e0aa7154f638136d2ac2e6ab9a7e3710d08c1e828ad9e65a6dc7510 WatchSource:0}: Error finding container a57235d42e0aa7154f638136d2ac2e6ab9a7e3710d08c1e828ad9e65a6dc7510: Status 404 returned error can't find the container with id a57235d42e0aa7154f638136d2ac2e6ab9a7e3710d08c1e828ad9e65a6dc7510
Jul 03 11:23:42.052676 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:42.052647    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 11:23:42.591411 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:42.591358    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk" event={"ID":"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b","Type":"ContainerStarted","Data":"a57235d42e0aa7154f638136d2ac2e6ab9a7e3710d08c1e828ad9e65a6dc7510"}
Jul 03 11:23:42.702391 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:42.702359    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:23:43.396040 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:43.395957    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:43.596223 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:43.596186    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk" event={"ID":"9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b","Type":"ContainerStarted","Data":"0d3af9e539e362ffc6175a13c552a029a003c65daeaa48b220c3e115b528eac5"}
Jul 03 11:23:43.613999 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:43.613935    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk" podStartSLOduration=1.5879178779999998 podStartE2EDuration="2.613914891s" totalImagesPullingTime="1.025997013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:23:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:23:43.613631918 +0000 UTC m=+676.090903513" watchObservedRunningTime="2026-07-03 11:23:43.613914891 +0000 UTC m=+676.091186490"
Jul 03 11:23:45.232598 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:45.232551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:45.293781 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:45.293747    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:51.913251 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:51.913204    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:51.913721 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:51.913274    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:51.926093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:51.926046    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:52.640673 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:52.640640    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7gjrk"
Jul 03 11:23:53.036549 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:53.036513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:23:54.896886 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:54.896850    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:23:55.247532 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:23:55.247496    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:24:26.532031 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:24:26.531930    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:24:28.597978 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:24:28.597936    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:24:36.818426 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:24:36.818385    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:24:39.404423 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:24:39.404387    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:24:52.290840 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:24:52.290805    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:25:26.150144 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:25:26.150101    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:25:33.424426 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:25:33.424393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:25:33.524712 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:25:33.524681    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:25:34.573556 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:25:34.573524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:25:34.667753 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:25:34.667717    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:26:16.616423 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:16.616384    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:26:26.302965 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:26.302927    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:26:31.185395 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:31.185364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:26:31.249452 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:31.249420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:26:36.600935 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:36.600898    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:26:45.219790 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:45.219747    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:26:49.144501 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:49.144469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:26:56.715130 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:56.715093    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:26:58.629621 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:26:58.629592    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:00.715675 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:00.715643    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:25.232533 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:25.232450    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:27:27.990056 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:27.990028    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:27:27.990520 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:27.990123    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:27:37.153929 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:37.153895    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:37.247828 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:37.247799    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:37.428169 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:37.428018    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:37.704964 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:37.704869    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:27:44.222258 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:44.222217    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:44.408531 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:44.408500    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:44.569401 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:44.569263    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:44.740752 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:44.740714    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:50.996843 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:50.996808    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:27:51.175705 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:27:51.175665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:28:09.338144 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:28:09.338040    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:28:18.906726 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:28:18.906689    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:28:28.404769 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:28:28.404734    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:28:37.303252 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:28:37.303204    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:28:48.814197 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:28:48.814113    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:28:59.618981 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:28:59.618944    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:29:11.009844 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:29:11.009810    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:29:21.011650 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:29:21.011616    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:29:46.309617 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:29:46.309574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:29:57.601327 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:29:57.601285    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:30:00.374848 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.374813    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717970-f87kr"]
Jul 03 11:30:00.377875 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.377857    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr"
Jul 03 11:30:00.398240 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.398218    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:30:00.434178 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.434141    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbx8\" (UniqueName: \"kubernetes.io/projected/1ecbce33-6033-4ad8-85a2-d2309b498119-kube-api-access-xsbx8\") pod \"maas-api-key-cleanup-29717970-f87kr\" (UID: \"1ecbce33-6033-4ad8-85a2-d2309b498119\") " pod="opendatahub/maas-api-key-cleanup-29717970-f87kr"
Jul 03 11:30:00.444047 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.444020    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717970-f87kr"]
Jul 03 11:30:00.534528 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.534493    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbx8\" (UniqueName: \"kubernetes.io/projected/1ecbce33-6033-4ad8-85a2-d2309b498119-kube-api-access-xsbx8\") pod \"maas-api-key-cleanup-29717970-f87kr\" (UID: \"1ecbce33-6033-4ad8-85a2-d2309b498119\") " pod="opendatahub/maas-api-key-cleanup-29717970-f87kr"
Jul 03 11:30:00.545941 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.545911    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbx8\" (UniqueName: \"kubernetes.io/projected/1ecbce33-6033-4ad8-85a2-d2309b498119-kube-api-access-xsbx8\") pod \"maas-api-key-cleanup-29717970-f87kr\" (UID: \"1ecbce33-6033-4ad8-85a2-d2309b498119\") " pod="opendatahub/maas-api-key-cleanup-29717970-f87kr"
Jul 03 11:30:00.687979 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.687946    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr"
Jul 03 11:30:00.816622 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.816560    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717970-f87kr"]
Jul 03 11:30:00.819215 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:30:00.819187    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ecbce33_6033_4ad8_85a2_d2309b498119.slice/crio-bc37f56f0f8d63036cf96692c59c864d7dbfc29a8dda3e06c0034423bff6d0fc WatchSource:0}: Error finding container bc37f56f0f8d63036cf96692c59c864d7dbfc29a8dda3e06c0034423bff6d0fc: Status 404 returned error can't find the container with id bc37f56f0f8d63036cf96692c59c864d7dbfc29a8dda3e06c0034423bff6d0fc
Jul 03 11:30:00.821082 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:00.821051    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 11:30:01.005903 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:01.005822    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr" event={"ID":"1ecbce33-6033-4ad8-85a2-d2309b498119","Type":"ContainerStarted","Data":"bc37f56f0f8d63036cf96692c59c864d7dbfc29a8dda3e06c0034423bff6d0fc"}
Jul 03 11:30:04.022519 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:04.022480    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr" event={"ID":"1ecbce33-6033-4ad8-85a2-d2309b498119","Type":"ContainerStarted","Data":"a981cbc97646245349ee8dae0e9fac2032211fe1f27f97891399c3ff2838a2b3"}
Jul 03 11:30:04.039806 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:04.039751    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr" podStartSLOduration=1.62664425 podStartE2EDuration="4.039730383s" totalImagesPullingTime="2.413086133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:30:04.038533211 +0000 UTC m=+1056.515804792" watchObservedRunningTime="2026-07-03 11:30:04.039730383 +0000 UTC m=+1056.517001966"
Jul 03 11:30:05.027886 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:05.027854    2582 generic.go:356] "Generic (PLEG): container finished" podID="1ecbce33-6033-4ad8-85a2-d2309b498119" containerID="a981cbc97646245349ee8dae0e9fac2032211fe1f27f97891399c3ff2838a2b3" exitCode=0
Jul 03 11:30:05.028323 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:05.027942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr" event={"ID":"1ecbce33-6033-4ad8-85a2-d2309b498119","Type":"ContainerDied","Data":"a981cbc97646245349ee8dae0e9fac2032211fe1f27f97891399c3ff2838a2b3"}
Jul 03 11:30:06.160470 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:06.160446    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr"
Jul 03 11:30:06.285215 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:06.285137    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xsbx8\" (UniqueName: \"kubernetes.io/projected/1ecbce33-6033-4ad8-85a2-d2309b498119-kube-api-access-xsbx8\") pod \"1ecbce33-6033-4ad8-85a2-d2309b498119\" (UID: \"1ecbce33-6033-4ad8-85a2-d2309b498119\") "
Jul 03 11:30:06.287236 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:06.287209    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ecbce33-6033-4ad8-85a2-d2309b498119-kube-api-access-xsbx8" (OuterVolumeSpecName: "kube-api-access-xsbx8") pod "1ecbce33-6033-4ad8-85a2-d2309b498119" (UID: "1ecbce33-6033-4ad8-85a2-d2309b498119"). InnerVolumeSpecName "kube-api-access-xsbx8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:30:06.386559 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:06.386505    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xsbx8\" (UniqueName: \"kubernetes.io/projected/1ecbce33-6033-4ad8-85a2-d2309b498119-kube-api-access-xsbx8\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:30:07.036842 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:07.036807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr" event={"ID":"1ecbce33-6033-4ad8-85a2-d2309b498119","Type":"ContainerDied","Data":"bc37f56f0f8d63036cf96692c59c864d7dbfc29a8dda3e06c0034423bff6d0fc"}
Jul 03 11:30:07.037019 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:07.036855    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc37f56f0f8d63036cf96692c59c864d7dbfc29a8dda3e06c0034423bff6d0fc"
Jul 03 11:30:07.037019 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:07.036819    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717970-f87kr"
Jul 03 11:30:21.603854 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:21.603774    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:30:33.139714 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:33.139667    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:30:49.296618 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:49.296579    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:30:59.114333 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:30:59.114297    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:31:09.159504 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:31:09.159465    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:31:19.219343 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:31:19.219299    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:31:29.202623 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:31:29.202588    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:31:31.624428 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:31:31.624390    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:31:48.653321 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:31:48.653241    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:32:28.015094 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:32:28.015017    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:32:28.016324 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:32:28.016301    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:33:08.450890 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:33:08.450853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:33:17.801276 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:33:17.801242    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:33:27.992417 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:33:27.992384    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:33:28.585501 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:33:28.585468    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:33:28.687396 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:33:28.687367    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:33:40.031937 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:33:40.031900    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:33:48.316624 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:33:48.316588    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:33:57.407649 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:33:57.407613    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:34:08.121584 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:34:08.121544    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:34:18.544410 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:34:18.544373    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:34:28.445110 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:34:28.445057    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:34:39.142021 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:34:39.141984    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:34:49.419805 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:34:49.419725    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:35:02.608871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:35:02.608822    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:35:10.603531 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:35:10.603497    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:35:28.124161 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:35:28.124132    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:35:38.407668 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:35:38.407626    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:35:48.293930 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:35:48.293900    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:36:00.504692 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:36:00.504659    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:36:10.298800 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:36:10.298758    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:36:18.391719 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:36:18.391639    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:36:28.000393 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:36:28.000354    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:36:37.603981 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:36:37.603946    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:36:47.891220 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:36:47.891179    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:36:57.907206 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:36:57.907164    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:37:08.822249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:37:08.822210    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:37:20.512573 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:37:20.512534    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:37:28.038274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:37:28.038247    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:37:28.039783 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:37:28.039757    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:37:37.228894 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:37:37.228863    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:37:49.705035 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:37:49.704945    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:38:00.008820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:38:00.008787    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:38:06.993816 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:38:06.993779    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:38:22.503444 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:38:22.503402    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:38:35.198209 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:38:35.198176    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:38:44.909433 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:38:44.909386    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:38:48.837424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:38:48.837391    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:38:55.435779 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:38:55.435746    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:38:59.309506 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:38:59.309467    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:39:03.723525 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:03.723491    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:08.805163 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:08.805090    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:39:08.805623 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:08.805245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:11.730167 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:11.730133    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:11.839834 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:11.839803    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:12.117126 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:12.117011    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:18.679370 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:18.679283    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:18.754681 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:18.754648    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:19.089301 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:19.089270    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:19.205006 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:19.204977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:19.234249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:19.234174    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:39:20.299930 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.299901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:20.537955 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.537926    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"]
Jul 03 11:39:20.538863 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.538835    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ecbce33-6033-4ad8-85a2-d2309b498119" containerName="cleanup"
Jul 03 11:39:20.538863 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.538865    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ecbce33-6033-4ad8-85a2-d2309b498119" containerName="cleanup"
Jul 03 11:39:20.539104 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.539067    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ecbce33-6033-4ad8-85a2-d2309b498119" containerName="cleanup"
Jul 03 11:39:20.544464 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.544432    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.547277 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.547257    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-0715e8cc-serving-cert\""
Jul 03 11:39:20.548585 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.548566    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:39:20.558516 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.558487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"]
Jul 03 11:39:20.609206 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.609177    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:20.616856 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.616834    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.616993 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.616891    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlfd5\" (UniqueName: \"kubernetes.io/projected/3d75c55b-9da5-4244-89f1-b78e04b091ca-kube-api-access-jlfd5\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.616993 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.616920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d75c55b-9da5-4244-89f1-b78e04b091ca-openshift-service-ca\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.711882 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.711853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:20.718174 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.718149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlfd5\" (UniqueName: \"kubernetes.io/projected/3d75c55b-9da5-4244-89f1-b78e04b091ca-kube-api-access-jlfd5\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.718274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.718194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d75c55b-9da5-4244-89f1-b78e04b091ca-openshift-service-ca\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.718274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.718265    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.718392 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:20.718378    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-0715e8cc-serving-cert: secret "maas-api-e2e-ait-0715e8cc-serving-cert" not found
Jul 03 11:39:20.718479 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:20.718456    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls podName:3d75c55b-9da5-4244-89f1-b78e04b091ca nodeName:}" failed. No retries permitted until 2026-07-03 11:39:21.218436226 +0000 UTC m=+1613.695707792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls") pod "maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv" (UID: "3d75c55b-9da5-4244-89f1-b78e04b091ca") : secret "maas-api-e2e-ait-0715e8cc-serving-cert" not found
Jul 03 11:39:20.718822 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.718806    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d75c55b-9da5-4244-89f1-b78e04b091ca-openshift-service-ca\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.730666 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.730644    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlfd5\" (UniqueName: \"kubernetes.io/projected/3d75c55b-9da5-4244-89f1-b78e04b091ca-kube-api-access-jlfd5\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:20.810745 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:20.810676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:21.158643 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:21.158614    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:21.220865 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:21.220821    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:21.223407 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:21.223382    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls\") pod \"maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") " pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:21.257394 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:21.257365    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:21.454599 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:21.454506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:21.589289 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:21.589260    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"]
Jul 03 11:39:21.591995 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:39:21.591964    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d75c55b_9da5_4244_89f1_b78e04b091ca.slice/crio-de746e4512d05a8f806de28b00fda00bcfa93db63e72b437e5e37e56e7881a99 WatchSource:0}: Error finding container de746e4512d05a8f806de28b00fda00bcfa93db63e72b437e5e37e56e7881a99: Status 404 returned error can't find the container with id de746e4512d05a8f806de28b00fda00bcfa93db63e72b437e5e37e56e7881a99
Jul 03 11:39:21.593306 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:21.593285    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 11:39:22.271121 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:22.271056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv" event={"ID":"3d75c55b-9da5-4244-89f1-b78e04b091ca","Type":"ContainerStarted","Data":"de746e4512d05a8f806de28b00fda00bcfa93db63e72b437e5e37e56e7881a99"}
Jul 03 11:39:23.158739 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:23.158683    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:24.280781 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:24.280745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv" event={"ID":"3d75c55b-9da5-4244-89f1-b78e04b091ca","Type":"ContainerStarted","Data":"8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028"}
Jul 03 11:39:24.281320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:24.280862    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:24.305451 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:24.305401    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv" podStartSLOduration=2.6606032109999997 podStartE2EDuration="4.305380797s" totalImagesPullingTime="1.644777586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:39:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:39:24.303862869 +0000 UTC m=+1616.781134462" watchObservedRunningTime="2026-07-03 11:39:24.305380797 +0000 UTC m=+1616.782652380"
Jul 03 11:39:25.436836 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:25.436775    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:25.614795 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:25.614757    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:25.714820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:25.714732    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:25.864680 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:25.864643    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"]
Jul 03 11:39:25.895325 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:25.895293    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:26.288590 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.288553    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv" podUID="3d75c55b-9da5-4244-89f1-b78e04b091ca" containerName="maas-api" containerID="cri-o://8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028" gracePeriod=30
Jul 03 11:39:26.532522 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.532498    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:26.568895 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.568825    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d75c55b-9da5-4244-89f1-b78e04b091ca-openshift-service-ca\") pod \"3d75c55b-9da5-4244-89f1-b78e04b091ca\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") "
Jul 03 11:39:26.569019 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.568897    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlfd5\" (UniqueName: \"kubernetes.io/projected/3d75c55b-9da5-4244-89f1-b78e04b091ca-kube-api-access-jlfd5\") pod \"3d75c55b-9da5-4244-89f1-b78e04b091ca\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") "
Jul 03 11:39:26.569019 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.568935    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls\") pod \"3d75c55b-9da5-4244-89f1-b78e04b091ca\" (UID: \"3d75c55b-9da5-4244-89f1-b78e04b091ca\") "
Jul 03 11:39:26.569198 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.569177    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d75c55b-9da5-4244-89f1-b78e04b091ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d75c55b-9da5-4244-89f1-b78e04b091ca" (UID: "3d75c55b-9da5-4244-89f1-b78e04b091ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:39:26.571110 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.571067    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d75c55b-9da5-4244-89f1-b78e04b091ca-kube-api-access-jlfd5" (OuterVolumeSpecName: "kube-api-access-jlfd5") pod "3d75c55b-9da5-4244-89f1-b78e04b091ca" (UID: "3d75c55b-9da5-4244-89f1-b78e04b091ca"). InnerVolumeSpecName "kube-api-access-jlfd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:39:26.571216 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.571113    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d75c55b-9da5-4244-89f1-b78e04b091ca" (UID: "3d75c55b-9da5-4244-89f1-b78e04b091ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:39:26.669481 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.669453    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d75c55b-9da5-4244-89f1-b78e04b091ca-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:26.669481 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.669478    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlfd5\" (UniqueName: \"kubernetes.io/projected/3d75c55b-9da5-4244-89f1-b78e04b091ca-kube-api-access-jlfd5\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:26.669481 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:26.669488    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d75c55b-9da5-4244-89f1-b78e04b091ca-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:27.293378 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.293345    2582 generic.go:356] "Generic (PLEG): container finished" podID="3d75c55b-9da5-4244-89f1-b78e04b091ca" containerID="8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028" exitCode=0
Jul 03 11:39:27.293544 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.293389    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"
Jul 03 11:39:27.293544 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.293392    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv" event={"ID":"3d75c55b-9da5-4244-89f1-b78e04b091ca","Type":"ContainerDied","Data":"8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028"}
Jul 03 11:39:27.293544 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.293435    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv" event={"ID":"3d75c55b-9da5-4244-89f1-b78e04b091ca","Type":"ContainerDied","Data":"de746e4512d05a8f806de28b00fda00bcfa93db63e72b437e5e37e56e7881a99"}
Jul 03 11:39:27.294377 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.294362    2582 scope.go:117] "RemoveContainer" containerID="8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028"
Jul 03 11:39:27.303271 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.303254    2582 scope.go:117] "RemoveContainer" containerID="8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028"
Jul 03 11:39:27.303509 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:27.303486    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028\": container with ID starting with 8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028 not found: ID does not exist" containerID="8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028"
Jul 03 11:39:27.303572 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.303521    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028"} err="failed to get container status \"8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028\": rpc error: code = NotFound desc = could not find container \"8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028\": container with ID starting with 8b3dc93d222580949e18d08b4761fba7654729c0d701ea25fabf2de6d1e07028 not found: ID does not exist"
Jul 03 11:39:27.316254 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.316229    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"]
Jul 03 11:39:27.320984 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.320951    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-0715e8cc-697fdd7945-74vdv"]
Jul 03 11:39:27.629929 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:27.629902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:28.099116 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:28.099053    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d75c55b-9da5-4244-89f1-b78e04b091ca" path="/var/lib/kubelet/pods/3d75c55b-9da5-4244-89f1-b78e04b091ca/volumes"
Jul 03 11:39:29.452681 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:29.452644    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:31.710867 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:31.710830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:31.814665 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:31.814622    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:31.974000 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:31.973893    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:32.056149 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:32.056109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:33.265396 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.265355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:33.366416 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.366385    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"]
Jul 03 11:39:33.366767 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.366749    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d75c55b-9da5-4244-89f1-b78e04b091ca" containerName="maas-api"
Jul 03 11:39:33.366857 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.366771    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d75c55b-9da5-4244-89f1-b78e04b091ca" containerName="maas-api"
Jul 03 11:39:33.366908 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.366865    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d75c55b-9da5-4244-89f1-b78e04b091ca" containerName="maas-api"
Jul 03 11:39:33.371013 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.370991    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:33.373579 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.373559    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-af3804fd-serving-cert\""
Jul 03 11:39:33.373946 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.373929    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:39:33.389490 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.389463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"]
Jul 03 11:39:33.407874 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.407843    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:33.419582 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.419551    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce325e3f-857f-4595-a094-2c9af445996b-openshift-service-ca\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:33.419697 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.419590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:33.419740 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.419694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ccv9\" (UniqueName: \"kubernetes.io/projected/ce325e3f-857f-4595-a094-2c9af445996b-kube-api-access-5ccv9\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:33.502649 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.502617    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:33.520806 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.520746    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce325e3f-857f-4595-a094-2c9af445996b-openshift-service-ca\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:33.520806 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.520782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:33.520941 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.520849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ccv9\" (UniqueName: \"kubernetes.io/projected/ce325e3f-857f-4595-a094-2c9af445996b-kube-api-access-5ccv9\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:33.520997 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:33.520963    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-af3804fd-serving-cert: secret "maas-api-e2e-ait-af3804fd-serving-cert" not found
Jul 03 11:39:33.521050 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:33.521037    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls podName:ce325e3f-857f-4595-a094-2c9af445996b nodeName:}" failed. No retries permitted until 2026-07-03 11:39:34.021017951 +0000 UTC m=+1626.498289512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls") pod "maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl" (UID: "ce325e3f-857f-4595-a094-2c9af445996b") : secret "maas-api-e2e-ait-af3804fd-serving-cert" not found
Jul 03 11:39:33.521454 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.521434    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce325e3f-857f-4595-a094-2c9af445996b-openshift-service-ca\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:33.534961 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:33.534931    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ccv9\" (UniqueName: \"kubernetes.io/projected/ce325e3f-857f-4595-a094-2c9af445996b-kube-api-access-5ccv9\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:34.025795 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:34.025757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:34.025967 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:34.025907    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-af3804fd-serving-cert: secret "maas-api-e2e-ait-af3804fd-serving-cert" not found
Jul 03 11:39:34.026009 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:34.025975    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls podName:ce325e3f-857f-4595-a094-2c9af445996b nodeName:}" failed. No retries permitted until 2026-07-03 11:39:35.025959637 +0000 UTC m=+1627.503231198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls") pod "maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl" (UID: "ce325e3f-857f-4595-a094-2c9af445996b") : secret "maas-api-e2e-ait-af3804fd-serving-cert" not found
Jul 03 11:39:34.171247 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:34.171207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:34.275237 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:34.275202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:34.528986 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:34.528939    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:35.034993 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:35.034953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:35.037504 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:35.037470    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls\") pod \"maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") " pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:35.181185 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:35.181138    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:35.313883 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:35.313861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"]
Jul 03 11:39:35.316284 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:39:35.316258    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce325e3f_857f_4595_a094_2c9af445996b.slice/crio-0ce054d757085ff9ddd46b3c8e2a0b5f7dda4ade0e224528a11a57d7ec7ee65d WatchSource:0}: Error finding container 0ce054d757085ff9ddd46b3c8e2a0b5f7dda4ade0e224528a11a57d7ec7ee65d: Status 404 returned error can't find the container with id 0ce054d757085ff9ddd46b3c8e2a0b5f7dda4ade0e224528a11a57d7ec7ee65d
Jul 03 11:39:35.325732 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:35.325710    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl" event={"ID":"ce325e3f-857f-4595-a094-2c9af445996b","Type":"ContainerStarted","Data":"0ce054d757085ff9ddd46b3c8e2a0b5f7dda4ade0e224528a11a57d7ec7ee65d"}
Jul 03 11:39:35.407190 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:35.407160    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:36.331804 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:36.331768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl" event={"ID":"ce325e3f-857f-4595-a094-2c9af445996b","Type":"ContainerStarted","Data":"983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc"}
Jul 03 11:39:36.332200 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:36.331927    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:37.915970 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:37.915912    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl" podStartSLOduration=4.59273619 podStartE2EDuration="4.91589294s" totalImagesPullingTime="323.15675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:39:36.387881769 +0000 UTC m=+1628.865153351" watchObservedRunningTime="2026-07-03 11:39:37.91589294 +0000 UTC m=+1630.393164522"
Jul 03 11:39:37.916401 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:37.916235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:39:38.354914 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:38.354828    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:38.840245 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:38.840210    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"]
Jul 03 11:39:38.840397 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:38.840381    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl" podUID="ce325e3f-857f-4595-a094-2c9af445996b" containerName="maas-api" containerID="cri-o://983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc" gracePeriod=30
Jul 03 11:39:38.890383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:38.890336    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:39.083090 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.083051    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:39.172591 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.172554    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ccv9\" (UniqueName: \"kubernetes.io/projected/ce325e3f-857f-4595-a094-2c9af445996b-kube-api-access-5ccv9\") pod \"ce325e3f-857f-4595-a094-2c9af445996b\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") "
Jul 03 11:39:39.172757 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.172601    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce325e3f-857f-4595-a094-2c9af445996b-openshift-service-ca\") pod \"ce325e3f-857f-4595-a094-2c9af445996b\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") "
Jul 03 11:39:39.172757 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.172695    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls\") pod \"ce325e3f-857f-4595-a094-2c9af445996b\" (UID: \"ce325e3f-857f-4595-a094-2c9af445996b\") "
Jul 03 11:39:39.172972 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.172945    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce325e3f-857f-4595-a094-2c9af445996b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce325e3f-857f-4595-a094-2c9af445996b" (UID: "ce325e3f-857f-4595-a094-2c9af445996b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:39:39.174873 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.174845    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce325e3f-857f-4595-a094-2c9af445996b" (UID: "ce325e3f-857f-4595-a094-2c9af445996b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:39:39.174972 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.174877    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce325e3f-857f-4595-a094-2c9af445996b-kube-api-access-5ccv9" (OuterVolumeSpecName: "kube-api-access-5ccv9") pod "ce325e3f-857f-4595-a094-2c9af445996b" (UID: "ce325e3f-857f-4595-a094-2c9af445996b"). InnerVolumeSpecName "kube-api-access-5ccv9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:39:39.273721 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.273682    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce325e3f-857f-4595-a094-2c9af445996b-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:39.273721 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.273712    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ccv9\" (UniqueName: \"kubernetes.io/projected/ce325e3f-857f-4595-a094-2c9af445996b-kube-api-access-5ccv9\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:39.273721 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.273721    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce325e3f-857f-4595-a094-2c9af445996b-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:39.347308 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.347274    2582 generic.go:356] "Generic (PLEG): container finished" podID="ce325e3f-857f-4595-a094-2c9af445996b" containerID="983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc" exitCode=0
Jul 03 11:39:39.347474 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.347318    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"
Jul 03 11:39:39.347474 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.347375    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl" event={"ID":"ce325e3f-857f-4595-a094-2c9af445996b","Type":"ContainerDied","Data":"983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc"}
Jul 03 11:39:39.347474 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.347423    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl" event={"ID":"ce325e3f-857f-4595-a094-2c9af445996b","Type":"ContainerDied","Data":"0ce054d757085ff9ddd46b3c8e2a0b5f7dda4ade0e224528a11a57d7ec7ee65d"}
Jul 03 11:39:39.347474 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.347445    2582 scope.go:117] "RemoveContainer" containerID="983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc"
Jul 03 11:39:39.356027 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.356009    2582 scope.go:117] "RemoveContainer" containerID="983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc"
Jul 03 11:39:39.356316 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:39.356298    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc\": container with ID starting with 983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc not found: ID does not exist" containerID="983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc"
Jul 03 11:39:39.356376 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.356325    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc"} err="failed to get container status \"983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc\": rpc error: code = NotFound desc = could not find container \"983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc\": container with ID starting with 983a621013eee5cf47bee4a8aec43473e90b179b51d74efb3bda4375ae629dfc not found: ID does not exist"
Jul 03 11:39:39.369554 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.369532    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"]
Jul 03 11:39:39.377698 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:39.377675    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-af3804fd-67796d6d87-kxsrl"]
Jul 03 11:39:40.099350 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:40.099320    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce325e3f-857f-4595-a094-2c9af445996b" path="/var/lib/kubelet/pods/ce325e3f-857f-4595-a094-2c9af445996b/volumes"
Jul 03 11:39:44.623295 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:44.623258    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:44.713540 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:44.713506    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:45.089215 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:45.089186    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:45.167116 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:45.167035    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:46.326330 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:46.326299    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:48.704776 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:48.704740    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:39:51.180879 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:51.180847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:51.283331 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:51.283287    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:51.558211 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:51.558181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:51.643916 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:51.643887    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:52.866523 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.866488    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:52.927485 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.927448    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"]
Jul 03 11:39:52.927797 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.927781    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce325e3f-857f-4595-a094-2c9af445996b" containerName="maas-api"
Jul 03 11:39:52.927877 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.927800    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce325e3f-857f-4595-a094-2c9af445996b" containerName="maas-api"
Jul 03 11:39:52.927926 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.927890    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce325e3f-857f-4595-a094-2c9af445996b" containerName="maas-api"
Jul 03 11:39:52.932195 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.932172    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:52.941363 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.941339    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-658af5a0-serving-cert\""
Jul 03 11:39:52.941467 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.941430    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:39:52.956418 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.956394    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"]
Jul 03 11:39:52.986641 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:52.986613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:53.086173 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.086133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk92d\" (UniqueName: \"kubernetes.io/projected/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-kube-api-access-gk92d\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.086357 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.086247    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-openshift-service-ca\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.086357 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.086283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.117216 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.117140    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:53.187663 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.187626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk92d\" (UniqueName: \"kubernetes.io/projected/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-kube-api-access-gk92d\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.187866 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.187695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-openshift-service-ca\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.187866 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.187722    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.187866 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:53.187851    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-658af5a0-serving-cert: secret "maas-api-e2e-derive-658af5a0-serving-cert" not found
Jul 03 11:39:53.188018 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:53.187917    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls podName:f41998b5-7d1e-4f9f-a39b-3a89652d4b37 nodeName:}" failed. No retries permitted until 2026-07-03 11:39:53.687895593 +0000 UTC m=+1646.165167170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls") pod "maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9" (UID: "f41998b5-7d1e-4f9f-a39b-3a89652d4b37") : secret "maas-api-e2e-derive-658af5a0-serving-cert" not found
Jul 03 11:39:53.188320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.188302    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-openshift-service-ca\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.200112 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.200063    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk92d\" (UniqueName: \"kubernetes.io/projected/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-kube-api-access-gk92d\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.368379 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.368298    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:53.692284 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.692243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.694799 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.694776    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls\") pod \"maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") " pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.841975 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.841935    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:53.986905 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:53.986825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:54.009151 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:54.009124    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"]
Jul 03 11:39:54.013231 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:39:54.013208    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41998b5_7d1e_4f9f_a39b_3a89652d4b37.slice/crio-89a9dacc13238c08702e15bab647fad2592bdcedd00791b3f2951f8066ac03cc WatchSource:0}: Error finding container 89a9dacc13238c08702e15bab647fad2592bdcedd00791b3f2951f8066ac03cc: Status 404 returned error can't find the container with id 89a9dacc13238c08702e15bab647fad2592bdcedd00791b3f2951f8066ac03cc
Jul 03 11:39:54.152003 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:54.151966    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:54.415242 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:54.415210    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9" event={"ID":"f41998b5-7d1e-4f9f-a39b-3a89652d4b37","Type":"ContainerStarted","Data":"a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6"}
Jul 03 11:39:54.415359 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:54.415285    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9" event={"ID":"f41998b5-7d1e-4f9f-a39b-3a89652d4b37","Type":"ContainerStarted","Data":"89a9dacc13238c08702e15bab647fad2592bdcedd00791b3f2951f8066ac03cc"}
Jul 03 11:39:54.415359 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:54.415348    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:54.448330 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:54.448284    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9" podStartSLOduration=2.112695772 podStartE2EDuration="2.448269687s" totalImagesPullingTime="335.573915ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:39:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:39:54.447738315 +0000 UTC m=+1646.925009897" watchObservedRunningTime="2026-07-03 11:39:54.448269687 +0000 UTC m=+1646.925541269"
Jul 03 11:39:54.889884 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:54.889853    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:57.263627 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:57.263587    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:57.422206 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:57.422174    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:57.554127 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:57.554023    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:58.077025 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.076997    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"]
Jul 03 11:39:58.077220 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.077180    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9" podUID="f41998b5-7d1e-4f9f-a39b-3a89652d4b37" containerName="maas-api" containerID="cri-o://a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6" gracePeriod=30
Jul 03 11:39:58.217887 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.217856    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:39:58.319298 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.319271    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:58.432755 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.432725    2582 generic.go:356] "Generic (PLEG): container finished" podID="f41998b5-7d1e-4f9f-a39b-3a89652d4b37" containerID="a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6" exitCode=0
Jul 03 11:39:58.432928 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.432772    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"
Jul 03 11:39:58.432928 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.432768    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9" event={"ID":"f41998b5-7d1e-4f9f-a39b-3a89652d4b37","Type":"ContainerDied","Data":"a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6"}
Jul 03 11:39:58.432928 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.432906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9" event={"ID":"f41998b5-7d1e-4f9f-a39b-3a89652d4b37","Type":"ContainerDied","Data":"89a9dacc13238c08702e15bab647fad2592bdcedd00791b3f2951f8066ac03cc"}
Jul 03 11:39:58.433035 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.432937    2582 scope.go:117] "RemoveContainer" containerID="a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6"
Jul 03 11:39:58.433995 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.433975    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-openshift-service-ca\") pod \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") "
Jul 03 11:39:58.434091 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.434007    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls\") pod \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") "
Jul 03 11:39:58.434136 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.434098    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk92d\" (UniqueName: \"kubernetes.io/projected/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-kube-api-access-gk92d\") pod \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\" (UID: \"f41998b5-7d1e-4f9f-a39b-3a89652d4b37\") "
Jul 03 11:39:58.434440 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.434416    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f41998b5-7d1e-4f9f-a39b-3a89652d4b37" (UID: "f41998b5-7d1e-4f9f-a39b-3a89652d4b37"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:39:58.436348 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.436315    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-kube-api-access-gk92d" (OuterVolumeSpecName: "kube-api-access-gk92d") pod "f41998b5-7d1e-4f9f-a39b-3a89652d4b37" (UID: "f41998b5-7d1e-4f9f-a39b-3a89652d4b37"). InnerVolumeSpecName "kube-api-access-gk92d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:39:58.436348 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.436315    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f41998b5-7d1e-4f9f-a39b-3a89652d4b37" (UID: "f41998b5-7d1e-4f9f-a39b-3a89652d4b37"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:39:58.450037 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.450021    2582 scope.go:117] "RemoveContainer" containerID="a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6"
Jul 03 11:39:58.450366 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:39:58.450347    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6\": container with ID starting with a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6 not found: ID does not exist" containerID="a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6"
Jul 03 11:39:58.450433 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.450375    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6"} err="failed to get container status \"a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6\": rpc error: code = NotFound desc = could not find container \"a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6\": container with ID starting with a97212bc6276845d4f55dc7b2abe2255f7c85b7f153cec4c2cc58644edb370f6 not found: ID does not exist"
Jul 03 11:39:58.535593 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.535553    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk92d\" (UniqueName: \"kubernetes.io/projected/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-kube-api-access-gk92d\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:58.535593 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.535587    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:58.535593 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.535600    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41998b5-7d1e-4f9f-a39b-3a89652d4b37-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:39:58.767295 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.767262    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"]
Jul 03 11:39:58.771910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.771881    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-658af5a0-6d46fb6966-8h7n9"]
Jul 03 11:39:58.982791 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:39:58.982749    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:00.099217 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:00.099177    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41998b5-7d1e-4f9f-a39b-3a89652d4b37" path="/var/lib/kubelet/pods/f41998b5-7d1e-4f9f-a39b-3a89652d4b37/volumes"
Jul 03 11:40:03.714384 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:03.714342    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:03.810813 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:03.810780    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:04.316052 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:04.316021    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:04.451556 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:04.451524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:05.884645 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:05.884613    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:09.713466 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:09.713435    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:12.121860 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:12.121825    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:12.272869 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:12.272832    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:12.406403 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:12.406373    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:12.525540 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:12.525510    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:12.879828 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:12.879739    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:38.890763 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:38.890725    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:45.265743 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:45.265685    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:45.396505 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:45.396477    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:40:45.504811 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:40:45.504784    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:01.433037 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:01.432951    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:07.579448 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:07.579395    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:07.690293 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:07.690261    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:07.800819 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:07.800767    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:18.393607 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:18.393572    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:19.162844 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:19.162811    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:25.494975 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:25.494934    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:25.629338 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:25.629296    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:25.757893 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:25.757817    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:25.873896 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:25.873863    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:26.596979 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:26.596948    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:26.756689 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:26.756657    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:26.892014 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:26.891892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:28.422622 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:28.422588    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:28.912126 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:28.912095    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:41:34.452753 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:34.452696    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:34.552249 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:34.552219    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:35.110637 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:35.110607    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:37.532202 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:37.532169    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:41:41.557347 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:41.557318    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:41.770216 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:41.770179    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:41.892925 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:41.892818    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:42.363165 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:42.363128    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:42.501008 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:42.500972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:45.673513 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.673479    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:45.762150 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.762118    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"]
Jul 03 11:41:45.762410 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.762399    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41998b5-7d1e-4f9f-a39b-3a89652d4b37" containerName="maas-api"
Jul 03 11:41:45.762456 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.762412    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41998b5-7d1e-4f9f-a39b-3a89652d4b37" containerName="maas-api"
Jul 03 11:41:45.762495 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.762471    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41998b5-7d1e-4f9f-a39b-3a89652d4b37" containerName="maas-api"
Jul 03 11:41:45.764297 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.764280    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:45.767698 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.767681    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:41:45.768393 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.768374    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-c6d643e5-serving-cert\""
Jul 03 11:41:45.785943 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.785913    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"]
Jul 03 11:41:45.812018 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.811984    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:45.860973 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.860934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:45.860973 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.860973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9a679f-cadf-43da-ad95-ed609a6fd391-openshift-service-ca\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:45.861221 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.861088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rz79g\" (UniqueName: \"kubernetes.io/projected/eb9a679f-cadf-43da-ad95-ed609a6fd391-kube-api-access-rz79g\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:45.907067 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.907032    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:45.961837 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.961735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rz79g\" (UniqueName: \"kubernetes.io/projected/eb9a679f-cadf-43da-ad95-ed609a6fd391-kube-api-access-rz79g\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:45.961837 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.961812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:45.962111 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.961838    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9a679f-cadf-43da-ad95-ed609a6fd391-openshift-service-ca\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:45.962111 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:41:45.961982    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-c6d643e5-serving-cert: secret "maas-api-e2e-mt-c6d643e5-serving-cert" not found
Jul 03 11:41:45.962111 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:41:45.962097    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls podName:eb9a679f-cadf-43da-ad95-ed609a6fd391 nodeName:}" failed. No retries permitted until 2026-07-03 11:41:46.462047703 +0000 UTC m=+1758.939319276 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls") pod "maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj" (UID: "eb9a679f-cadf-43da-ad95-ed609a6fd391") : secret "maas-api-e2e-mt-c6d643e5-serving-cert" not found
Jul 03 11:41:45.962487 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.962470    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9a679f-cadf-43da-ad95-ed609a6fd391-openshift-service-ca\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:45.982617 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:45.982587    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rz79g\" (UniqueName: \"kubernetes.io/projected/eb9a679f-cadf-43da-ad95-ed609a6fd391-kube-api-access-rz79g\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:46.102307 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:46.102273    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:46.467389 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:46.467348    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:46.469959 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:46.469929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls\") pod \"maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") " pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:46.594002 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:46.593972    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:46.673980 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:46.673947    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:46.777261 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:46.774050    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:46.819954 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:46.819930    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"]
Jul 03 11:41:46.821917 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:41:46.821882    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb9a679f_cadf_43da_ad95_ed609a6fd391.slice/crio-90df046142330611a643037dd75433e8142028985971d25f04082958bd13a26f WatchSource:0}: Error finding container 90df046142330611a643037dd75433e8142028985971d25f04082958bd13a26f: Status 404 returned error can't find the container with id 90df046142330611a643037dd75433e8142028985971d25f04082958bd13a26f
Jul 03 11:41:46.869749 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:46.869708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj" event={"ID":"eb9a679f-cadf-43da-ad95-ed609a6fd391","Type":"ContainerStarted","Data":"90df046142330611a643037dd75433e8142028985971d25f04082958bd13a26f"}
Jul 03 11:41:47.875703 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:47.875668    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj" event={"ID":"eb9a679f-cadf-43da-ad95-ed609a6fd391","Type":"ContainerStarted","Data":"abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f"}
Jul 03 11:41:47.876103 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:47.875732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:47.895402 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:47.895345    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj" podStartSLOduration=2.548249884 podStartE2EDuration="2.895329861s" totalImagesPullingTime="347.079977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:41:47.893514854 +0000 UTC m=+1760.370786438" watchObservedRunningTime="2026-07-03 11:41:47.895329861 +0000 UTC m=+1760.372601456"
Jul 03 11:41:50.146193 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:50.146159    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:50.827812 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:50.827779    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:50.935740 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:50.935713    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:51.230274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:51.230244    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:53.212650 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:53.212605    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:41:53.885601 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:53.885573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:57.218284 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:57.218247    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:57.325010 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:57.324977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:57.881840 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:57.881809    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:58.271782 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.271752    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:58.368405 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.368377    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"]
Jul 03 11:41:58.368569 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.368543    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj" podUID="eb9a679f-cadf-43da-ad95-ed609a6fd391" containerName="maas-api" containerID="cri-o://abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f" gracePeriod=30
Jul 03 11:41:58.405986 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.405951    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:41:58.606596 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.606573    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:58.646968 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.646936    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls\") pod \"eb9a679f-cadf-43da-ad95-ed609a6fd391\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") "
Jul 03 11:41:58.647147 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.646999    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rz79g\" (UniqueName: \"kubernetes.io/projected/eb9a679f-cadf-43da-ad95-ed609a6fd391-kube-api-access-rz79g\") pod \"eb9a679f-cadf-43da-ad95-ed609a6fd391\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") "
Jul 03 11:41:58.649226 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.649202    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eb9a679f-cadf-43da-ad95-ed609a6fd391" (UID: "eb9a679f-cadf-43da-ad95-ed609a6fd391"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:41:58.649338 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.649222    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb9a679f-cadf-43da-ad95-ed609a6fd391-kube-api-access-rz79g" (OuterVolumeSpecName: "kube-api-access-rz79g") pod "eb9a679f-cadf-43da-ad95-ed609a6fd391" (UID: "eb9a679f-cadf-43da-ad95-ed609a6fd391"). InnerVolumeSpecName "kube-api-access-rz79g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:41:58.748289 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.748255    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9a679f-cadf-43da-ad95-ed609a6fd391-openshift-service-ca\") pod \"eb9a679f-cadf-43da-ad95-ed609a6fd391\" (UID: \"eb9a679f-cadf-43da-ad95-ed609a6fd391\") "
Jul 03 11:41:58.748475 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.748375    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eb9a679f-cadf-43da-ad95-ed609a6fd391-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:41:58.748475 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.748385    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rz79g\" (UniqueName: \"kubernetes.io/projected/eb9a679f-cadf-43da-ad95-ed609a6fd391-kube-api-access-rz79g\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:41:58.748674 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.748650    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb9a679f-cadf-43da-ad95-ed609a6fd391-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eb9a679f-cadf-43da-ad95-ed609a6fd391" (UID: "eb9a679f-cadf-43da-ad95-ed609a6fd391"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:41:58.849111 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.848986    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eb9a679f-cadf-43da-ad95-ed609a6fd391-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:41:58.924677 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.924631    2582 generic.go:356] "Generic (PLEG): container finished" podID="eb9a679f-cadf-43da-ad95-ed609a6fd391" containerID="abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f" exitCode=0
Jul 03 11:41:58.924677 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.924684    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj" event={"ID":"eb9a679f-cadf-43da-ad95-ed609a6fd391","Type":"ContainerDied","Data":"abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f"}
Jul 03 11:41:58.924933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.924690    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"
Jul 03 11:41:58.924933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.924755    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj" event={"ID":"eb9a679f-cadf-43da-ad95-ed609a6fd391","Type":"ContainerDied","Data":"90df046142330611a643037dd75433e8142028985971d25f04082958bd13a26f"}
Jul 03 11:41:58.924933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.924779    2582 scope.go:117] "RemoveContainer" containerID="abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f"
Jul 03 11:41:58.933950 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.933932    2582 scope.go:117] "RemoveContainer" containerID="abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f"
Jul 03 11:41:58.934231 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:41:58.934209    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f\": container with ID starting with abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f not found: ID does not exist" containerID="abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f"
Jul 03 11:41:58.934290 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.934239    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f"} err="failed to get container status \"abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f\": rpc error: code = NotFound desc = could not find container \"abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f\": container with ID starting with abec5b77b076dabfaad902311317a5bb8d8b3d868abcadb7689350ffce958e7f not found: ID does not exist"
Jul 03 11:41:58.952714 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.952678    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"]
Jul 03 11:41:58.960040 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:41:58.960012    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-c6d643e5-69c474bdc8-tlwgj"]
Jul 03 11:42:00.098804 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:00.098766    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb9a679f-cadf-43da-ad95-ed609a6fd391" path="/var/lib/kubelet/pods/eb9a679f-cadf-43da-ad95-ed609a6fd391/volumes"
Jul 03 11:42:04.351691 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:04.351660    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:42:05.813944 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:05.813902    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:06.125066 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:06.124975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:06.475226 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:06.475192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:06.669544 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:06.669512    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:06.918885 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:06.918848    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:14.310604 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:14.310552    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:14.586331 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:14.586245    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:14.788547 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:14.788513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:14.915213 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:14.915181    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:21.927208 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:21.927130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:22.054239 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:22.054205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:24.449642 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:24.449610    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:24.706747 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:24.706655    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:28.064181 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:28.064149    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:42:28.064656 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:28.064331    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:42:28.589059 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:28.589026    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:29.003908 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:29.003867    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:30.107872 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:30.107831    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:32.161291 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.161258    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:32.260603 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.260573    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"]
Jul 03 11:42:32.260866 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.260855    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb9a679f-cadf-43da-ad95-ed609a6fd391" containerName="maas-api"
Jul 03 11:42:32.260962 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.260868    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb9a679f-cadf-43da-ad95-ed609a6fd391" containerName="maas-api"
Jul 03 11:42:32.260962 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.260923    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb9a679f-cadf-43da-ad95-ed609a6fd391" containerName="maas-api"
Jul 03 11:42:32.265031 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.265013    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.268372 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.268344    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-83f02be8-serving-cert\""
Jul 03 11:42:32.268516 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.268468    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:42:32.279819 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.279791    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"]
Jul 03 11:42:32.308296 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.308250    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:32.313338 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.313319    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.313404 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.313353    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/012fcb03-aa96-4575-b8da-a5bd931912d6-openshift-service-ca\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.313404 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.313384    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbmz6\" (UniqueName: \"kubernetes.io/projected/012fcb03-aa96-4575-b8da-a5bd931912d6-kube-api-access-lbmz6\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.414145 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.414038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.414145 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.414101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/012fcb03-aa96-4575-b8da-a5bd931912d6-openshift-service-ca\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.414145 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.414142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbmz6\" (UniqueName: \"kubernetes.io/projected/012fcb03-aa96-4575-b8da-a5bd931912d6-kube-api-access-lbmz6\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.414360 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:42:32.414199    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-83f02be8-serving-cert: secret "maas-api-e2e-mt-83f02be8-serving-cert" not found
Jul 03 11:42:32.414360 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:42:32.414275    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls podName:012fcb03-aa96-4575-b8da-a5bd931912d6 nodeName:}" failed. No retries permitted until 2026-07-03 11:42:32.914258993 +0000 UTC m=+1805.391530554 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls") pod "maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq" (UID: "012fcb03-aa96-4575-b8da-a5bd931912d6") : secret "maas-api-e2e-mt-83f02be8-serving-cert" not found
Jul 03 11:42:32.414782 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.414766    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/012fcb03-aa96-4575-b8da-a5bd931912d6-openshift-service-ca\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.417399 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.417376    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:32.439368 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.439334    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbmz6\" (UniqueName: \"kubernetes.io/projected/012fcb03-aa96-4575-b8da-a5bd931912d6-kube-api-access-lbmz6\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.918389 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.918343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:32.918602 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:42:32.918517    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-83f02be8-serving-cert: secret "maas-api-e2e-mt-83f02be8-serving-cert" not found
Jul 03 11:42:32.918670 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:42:32.918624    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls podName:012fcb03-aa96-4575-b8da-a5bd931912d6 nodeName:}" failed. No retries permitted until 2026-07-03 11:42:33.918603116 +0000 UTC m=+1806.395874693 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls") pod "maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq" (UID: "012fcb03-aa96-4575-b8da-a5bd931912d6") : secret "maas-api-e2e-mt-83f02be8-serving-cert" not found
Jul 03 11:42:32.989245 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:32.989212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:33.090443 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:33.090398    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:33.928278 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:33.928217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:33.930838 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:33.930819    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls\") pod \"maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") " pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:34.075359 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:34.075328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:34.229478 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:34.229406    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"]
Jul 03 11:42:34.233112 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:42:34.233067    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod012fcb03_aa96_4575_b8da_a5bd931912d6.slice/crio-27e11f8711e9aca8da21b170f55c74221dfdd32f72a880b066242009dbd4db93 WatchSource:0}: Error finding container 27e11f8711e9aca8da21b170f55c74221dfdd32f72a880b066242009dbd4db93: Status 404 returned error can't find the container with id 27e11f8711e9aca8da21b170f55c74221dfdd32f72a880b066242009dbd4db93
Jul 03 11:42:35.072045 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:35.071999    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq" event={"ID":"012fcb03-aa96-4575-b8da-a5bd931912d6","Type":"ContainerStarted","Data":"ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f"}
Jul 03 11:42:35.072447 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:35.072064    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq" event={"ID":"012fcb03-aa96-4575-b8da-a5bd931912d6","Type":"ContainerStarted","Data":"27e11f8711e9aca8da21b170f55c74221dfdd32f72a880b066242009dbd4db93"}
Jul 03 11:42:35.072447 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:35.072207    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:36.680234 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:36.680195    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:38.823186 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:38.823134    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq" podStartSLOduration=6.420774758 podStartE2EDuration="6.823114949s" totalImagesPullingTime="402.340191ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:42:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:42:35.128051375 +0000 UTC m=+1807.605322957" watchObservedRunningTime="2026-07-03 11:42:38.823114949 +0000 UTC m=+1811.300386590"
Jul 03 11:42:38.824303 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:38.824286    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:42:41.081903 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:41.081879    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:42:56.281269 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:56.281233    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:42:59.520424 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:42:59.520386    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:43:32.631853 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:32.631812    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:43:35.018583 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.018556    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:43:35.461313 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.461279    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"]
Jul 03 11:43:35.461499 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.461474    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq" podUID="012fcb03-aa96-4575-b8da-a5bd931912d6" containerName="maas-api" containerID="cri-o://ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f" gracePeriod=30
Jul 03 11:43:35.512860 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.512824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:43:35.706859 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.706837    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:43:35.824061 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.823966    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls\") pod \"012fcb03-aa96-4575-b8da-a5bd931912d6\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") "
Jul 03 11:43:35.824061 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.824012    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/012fcb03-aa96-4575-b8da-a5bd931912d6-openshift-service-ca\") pod \"012fcb03-aa96-4575-b8da-a5bd931912d6\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") "
Jul 03 11:43:35.824310 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.824115    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lbmz6\" (UniqueName: \"kubernetes.io/projected/012fcb03-aa96-4575-b8da-a5bd931912d6-kube-api-access-lbmz6\") pod \"012fcb03-aa96-4575-b8da-a5bd931912d6\" (UID: \"012fcb03-aa96-4575-b8da-a5bd931912d6\") "
Jul 03 11:43:35.824456 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.824429    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/012fcb03-aa96-4575-b8da-a5bd931912d6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "012fcb03-aa96-4575-b8da-a5bd931912d6" (UID: "012fcb03-aa96-4575-b8da-a5bd931912d6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:43:35.826375 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.826351    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/012fcb03-aa96-4575-b8da-a5bd931912d6-kube-api-access-lbmz6" (OuterVolumeSpecName: "kube-api-access-lbmz6") pod "012fcb03-aa96-4575-b8da-a5bd931912d6" (UID: "012fcb03-aa96-4575-b8da-a5bd931912d6"). InnerVolumeSpecName "kube-api-access-lbmz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:43:35.826375 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.826367    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "012fcb03-aa96-4575-b8da-a5bd931912d6" (UID: "012fcb03-aa96-4575-b8da-a5bd931912d6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:43:35.925255 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.925226    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbmz6\" (UniqueName: \"kubernetes.io/projected/012fcb03-aa96-4575-b8da-a5bd931912d6-kube-api-access-lbmz6\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:43:35.925255 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.925252    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/012fcb03-aa96-4575-b8da-a5bd931912d6-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:43:35.925255 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:35.925262    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/012fcb03-aa96-4575-b8da-a5bd931912d6-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:43:36.330003 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.329966    2582 generic.go:356] "Generic (PLEG): container finished" podID="012fcb03-aa96-4575-b8da-a5bd931912d6" containerID="ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f" exitCode=0
Jul 03 11:43:36.330490 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.330023    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"
Jul 03 11:43:36.330490 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.330062    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq" event={"ID":"012fcb03-aa96-4575-b8da-a5bd931912d6","Type":"ContainerDied","Data":"ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f"}
Jul 03 11:43:36.330490 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.330189    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq" event={"ID":"012fcb03-aa96-4575-b8da-a5bd931912d6","Type":"ContainerDied","Data":"27e11f8711e9aca8da21b170f55c74221dfdd32f72a880b066242009dbd4db93"}
Jul 03 11:43:36.330490 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.330222    2582 scope.go:117] "RemoveContainer" containerID="ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f"
Jul 03 11:43:36.338385 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.338352    2582 scope.go:117] "RemoveContainer" containerID="ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f"
Jul 03 11:43:36.338655 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:43:36.338633    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f\": container with ID starting with ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f not found: ID does not exist" containerID="ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f"
Jul 03 11:43:36.338726 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.338665    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f"} err="failed to get container status \"ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f\": rpc error: code = NotFound desc = could not find container \"ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f\": container with ID starting with ec02d7bf5c8a47081a759b5f10646d86010f343052cede199a6c82cc4901a95f not found: ID does not exist"
Jul 03 11:43:36.356891 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.356867    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"]
Jul 03 11:43:36.369171 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:36.369113    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-83f02be8-7cfd5f47f6-r2kbq"]
Jul 03 11:43:38.101136 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:38.101100    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="012fcb03-aa96-4575-b8da-a5bd931912d6" path="/var/lib/kubelet/pods/012fcb03-aa96-4575-b8da-a5bd931912d6/volumes"
Jul 03 11:43:41.066427 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:41.066393    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:43:46.163187 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:46.163151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:43:46.718495 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:43:46.718467    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:44:23.683915 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:23.683882    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:25.179930 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:25.179901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:26.906998 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:26.906943    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:44:29.962833 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:29.962790    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:30.060894 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:30.060861    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:30.292313 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:30.292205    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:30.509555 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:30.509524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:31.780394 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:31.780355    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:31.881832 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:31.881803    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:32.641367 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:32.641333    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:32.737910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:32.737876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:34.210532 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:34.210489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:40.631245 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:40.631211    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:40.725861 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:40.725827    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:41.210163 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:41.210125    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:44:41.367922 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:41.367888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:47.850299 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:47.850265    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:47.960187 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:47.960139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:48.066842 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:48.066799    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:51.211363 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:51.211316    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:44:58.624288 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:58.624251    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:44:58.982449 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:44:58.982415    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:00.173744 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.173714    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717985-fwttv"]
Jul 03 11:45:00.174123 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.173988    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="012fcb03-aa96-4575-b8da-a5bd931912d6" containerName="maas-api"
Jul 03 11:45:00.174123 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.173998    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="012fcb03-aa96-4575-b8da-a5bd931912d6" containerName="maas-api"
Jul 03 11:45:00.174123 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.174090    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="012fcb03-aa96-4575-b8da-a5bd931912d6" containerName="maas-api"
Jul 03 11:45:00.176585 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.176568    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717985-fwttv"
Jul 03 11:45:00.179580 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.179558    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:45:00.188200 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.188178    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717985-fwttv"]
Jul 03 11:45:00.308813 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.308771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4g2p\" (UniqueName: \"kubernetes.io/projected/090562ef-3619-4a77-a5fe-e0f086ecc758-kube-api-access-x4g2p\") pod \"maas-api-key-cleanup-29717985-fwttv\" (UID: \"090562ef-3619-4a77-a5fe-e0f086ecc758\") " pod="opendatahub/maas-api-key-cleanup-29717985-fwttv"
Jul 03 11:45:00.409914 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.409877    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4g2p\" (UniqueName: \"kubernetes.io/projected/090562ef-3619-4a77-a5fe-e0f086ecc758-kube-api-access-x4g2p\") pod \"maas-api-key-cleanup-29717985-fwttv\" (UID: \"090562ef-3619-4a77-a5fe-e0f086ecc758\") " pod="opendatahub/maas-api-key-cleanup-29717985-fwttv"
Jul 03 11:45:00.420119 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.420089    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4g2p\" (UniqueName: \"kubernetes.io/projected/090562ef-3619-4a77-a5fe-e0f086ecc758-kube-api-access-x4g2p\") pod \"maas-api-key-cleanup-29717985-fwttv\" (UID: \"090562ef-3619-4a77-a5fe-e0f086ecc758\") " pod="opendatahub/maas-api-key-cleanup-29717985-fwttv"
Jul 03 11:45:00.486177 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.486090    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717985-fwttv"
Jul 03 11:45:00.617803 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.617778    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717985-fwttv"]
Jul 03 11:45:00.620470 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:45:00.620441    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod090562ef_3619_4a77_a5fe_e0f086ecc758.slice/crio-e7b7f43ec9ab38120f868da7665a11115dd335907ddea5108f1cd368d2dc167c WatchSource:0}: Error finding container e7b7f43ec9ab38120f868da7665a11115dd335907ddea5108f1cd368d2dc167c: Status 404 returned error can't find the container with id e7b7f43ec9ab38120f868da7665a11115dd335907ddea5108f1cd368d2dc167c
Jul 03 11:45:00.668358 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:00.668330    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717985-fwttv" event={"ID":"090562ef-3619-4a77-a5fe-e0f086ecc758","Type":"ContainerStarted","Data":"e7b7f43ec9ab38120f868da7665a11115dd335907ddea5108f1cd368d2dc167c"}
Jul 03 11:45:01.673507 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:01.673474    2582 generic.go:356] "Generic (PLEG): container finished" podID="090562ef-3619-4a77-a5fe-e0f086ecc758" containerID="a464cf653b8d1633ad1cd1ca6c0fe90b777434612ca85c96e99bb7c0dc04ad41" exitCode=0
Jul 03 11:45:01.673866 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:01.673528    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717985-fwttv" event={"ID":"090562ef-3619-4a77-a5fe-e0f086ecc758","Type":"ContainerDied","Data":"a464cf653b8d1633ad1cd1ca6c0fe90b777434612ca85c96e99bb7c0dc04ad41"}
Jul 03 11:45:02.802852 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:02.802822    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717985-fwttv"
Jul 03 11:45:02.931891 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:02.931786    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4g2p\" (UniqueName: \"kubernetes.io/projected/090562ef-3619-4a77-a5fe-e0f086ecc758-kube-api-access-x4g2p\") pod \"090562ef-3619-4a77-a5fe-e0f086ecc758\" (UID: \"090562ef-3619-4a77-a5fe-e0f086ecc758\") "
Jul 03 11:45:02.934081 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:02.934036    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/090562ef-3619-4a77-a5fe-e0f086ecc758-kube-api-access-x4g2p" (OuterVolumeSpecName: "kube-api-access-x4g2p") pod "090562ef-3619-4a77-a5fe-e0f086ecc758" (UID: "090562ef-3619-4a77-a5fe-e0f086ecc758"). InnerVolumeSpecName "kube-api-access-x4g2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:45:03.033377 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:03.033334    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4g2p\" (UniqueName: \"kubernetes.io/projected/090562ef-3619-4a77-a5fe-e0f086ecc758-kube-api-access-x4g2p\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:45:03.682173 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:03.682134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717985-fwttv" event={"ID":"090562ef-3619-4a77-a5fe-e0f086ecc758","Type":"ContainerDied","Data":"e7b7f43ec9ab38120f868da7665a11115dd335907ddea5108f1cd368d2dc167c"}
Jul 03 11:45:03.682173 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:03.682171    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717985-fwttv"
Jul 03 11:45:03.682383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:03.682195    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e7b7f43ec9ab38120f868da7665a11115dd335907ddea5108f1cd368d2dc167c"
Jul 03 11:45:19.989591 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:19.989502    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:26.425153 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:26.425113    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:26.500089 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:26.500054    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:26.816721 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:26.816636    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:27.199864 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:27.199830    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:27.386227 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:27.386197    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:30.036563 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.036528    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:30.140238 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.140207    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:30.271676 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.271639    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"]
Jul 03 11:45:30.272112 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.272093    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="090562ef-3619-4a77-a5fe-e0f086ecc758" containerName="cleanup"
Jul 03 11:45:30.272185 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.272117    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="090562ef-3619-4a77-a5fe-e0f086ecc758" containerName="cleanup"
Jul 03 11:45:30.272221 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.272207    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="090562ef-3619-4a77-a5fe-e0f086ecc758" containerName="cleanup"
Jul 03 11:45:30.275618 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.275595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.278298 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.278277    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-017645-serving-cert\""
Jul 03 11:45:30.278423 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.278367    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:45:30.294719 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.294656    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"]
Jul 03 11:45:30.344005 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.343977    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2284f0e4-fdd6-4154-8e6c-61e41da86180-openshift-service-ca\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.344183 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.344015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.344183 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.344083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlgx2\" (UniqueName: \"kubernetes.io/projected/2284f0e4-fdd6-4154-8e6c-61e41da86180-kube-api-access-qlgx2\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.352441 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.352420    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:30.444438 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.444403    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2284f0e4-fdd6-4154-8e6c-61e41da86180-openshift-service-ca\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.444438 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.444440    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.444638 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.444462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlgx2\" (UniqueName: \"kubernetes.io/projected/2284f0e4-fdd6-4154-8e6c-61e41da86180-kube-api-access-qlgx2\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.444638 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:45:30.444553    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-a-017645-serving-cert: secret "maas-api-e2e-inf-a-017645-serving-cert" not found
Jul 03 11:45:30.444638 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:45:30.444615    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls podName:2284f0e4-fdd6-4154-8e6c-61e41da86180 nodeName:}" failed. No retries permitted until 2026-07-03 11:45:30.944599224 +0000 UTC m=+1983.421870785 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls") pod "maas-api-e2e-inf-a-017645-77466695c7-5jz4t" (UID: "2284f0e4-fdd6-4154-8e6c-61e41da86180") : secret "maas-api-e2e-inf-a-017645-serving-cert" not found
Jul 03 11:45:30.445045 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.445027    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2284f0e4-fdd6-4154-8e6c-61e41da86180-openshift-service-ca\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.470974 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.470941    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlgx2\" (UniqueName: \"kubernetes.io/projected/2284f0e4-fdd6-4154-8e6c-61e41da86180-kube-api-access-qlgx2\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.712388 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.712351    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:30.949453 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.949422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.951946 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.951915    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls\") pod \"maas-api-e2e-inf-a-017645-77466695c7-5jz4t\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") " pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:30.961915 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:30.961892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:31.059821 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:31.059737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:31.188360 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:31.188330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:31.317170 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:31.317063    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"]
Jul 03 11:45:31.320549 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:45:31.320521    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2284f0e4_fdd6_4154_8e6c_61e41da86180.slice/crio-c55c8b830ed45e705b337ba5bd93fe89ea6185d417ea7edc7c0c80bb0b64060b WatchSource:0}: Error finding container c55c8b830ed45e705b337ba5bd93fe89ea6185d417ea7edc7c0c80bb0b64060b: Status 404 returned error can't find the container with id c55c8b830ed45e705b337ba5bd93fe89ea6185d417ea7edc7c0c80bb0b64060b
Jul 03 11:45:31.321821 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:31.321802    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 11:45:31.798822 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:31.798791    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t" event={"ID":"2284f0e4-fdd6-4154-8e6c-61e41da86180","Type":"ContainerStarted","Data":"c55c8b830ed45e705b337ba5bd93fe89ea6185d417ea7edc7c0c80bb0b64060b"}
Jul 03 11:45:32.804287 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:32.804249    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t" event={"ID":"2284f0e4-fdd6-4154-8e6c-61e41da86180","Type":"ContainerStarted","Data":"c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7"}
Jul 03 11:45:32.804704 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:32.804427    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:32.826092 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:32.826023    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t" podStartSLOduration=2.319998872 podStartE2EDuration="2.82600856s" totalImagesPullingTime="506.009688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:45:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:45:32.825410044 +0000 UTC m=+1985.302681638" watchObservedRunningTime="2026-07-03 11:45:32.82600856 +0000 UTC m=+1985.303280207"
Jul 03 11:45:34.538783 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:34.538750    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:34.867613 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:34.867523    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:35.207884 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:35.207852    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:35.408168 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:35.408130    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:38.138922 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.138892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:38.216556 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.216522    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"]
Jul 03 11:45:38.219986 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.219970    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.222984 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.222954    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-44ab65-serving-cert\""
Jul 03 11:45:38.231530 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.231501    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"]
Jul 03 11:45:38.264832 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.264790    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:38.314177 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.314135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.314371 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.314220    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23e96bd4-2b9c-4743-997a-f2463ea9c30a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.314371 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.314261    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxjsl\" (UniqueName: \"kubernetes.io/projected/23e96bd4-2b9c-4743-997a-f2463ea9c30a-kube-api-access-zxjsl\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.403711 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.403672    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:38.415092 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.415034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23e96bd4-2b9c-4743-997a-f2463ea9c30a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.415239 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.415096    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxjsl\" (UniqueName: \"kubernetes.io/projected/23e96bd4-2b9c-4743-997a-f2463ea9c30a-kube-api-access-zxjsl\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.415239 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.415157    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.415348 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:45:38.415314    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-44ab65-serving-cert: secret "maas-api-e2e-inf-b-44ab65-serving-cert" not found
Jul 03 11:45:38.415414 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:45:38.415400    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls podName:23e96bd4-2b9c-4743-997a-f2463ea9c30a nodeName:}" failed. No retries permitted until 2026-07-03 11:45:38.915377333 +0000 UTC m=+1991.392648908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls") pod "maas-api-e2e-inf-b-44ab65-9bb658949-49kmz" (UID: "23e96bd4-2b9c-4743-997a-f2463ea9c30a") : secret "maas-api-e2e-inf-b-44ab65-serving-cert" not found
Jul 03 11:45:38.415711 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.415690    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23e96bd4-2b9c-4743-997a-f2463ea9c30a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.439394 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.439361    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxjsl\" (UniqueName: \"kubernetes.io/projected/23e96bd4-2b9c-4743-997a-f2463ea9c30a-kube-api-access-zxjsl\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.768849 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.768754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:38.814871 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.814840    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:45:38.919122 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.919061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.921527 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.921495    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls\") pod \"maas-api-e2e-inf-b-44ab65-9bb658949-49kmz\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") " pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:38.976644 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:38.976611    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:39.085584 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:39.085497    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:39.120410 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:39.120379    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:45:39.131899 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:39.131873    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:39.276000 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:39.272420    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"]
Jul 03 11:45:39.279140 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:45:39.279095    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23e96bd4_2b9c_4743_997a_f2463ea9c30a.slice/crio-7835c0639f8a131ada618fa763d0167dbbac2c71d3703f51e011e60a7522acbf WatchSource:0}: Error finding container 7835c0639f8a131ada618fa763d0167dbbac2c71d3703f51e011e60a7522acbf: Status 404 returned error can't find the container with id 7835c0639f8a131ada618fa763d0167dbbac2c71d3703f51e011e60a7522acbf
Jul 03 11:45:39.836750 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:39.836707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz" event={"ID":"23e96bd4-2b9c-4743-997a-f2463ea9c30a","Type":"ContainerStarted","Data":"2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7"}
Jul 03 11:45:39.836921 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:39.836762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz" event={"ID":"23e96bd4-2b9c-4743-997a-f2463ea9c30a","Type":"ContainerStarted","Data":"7835c0639f8a131ada618fa763d0167dbbac2c71d3703f51e011e60a7522acbf"}
Jul 03 11:45:39.836921 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:39.836812    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:39.881815 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:39.881762    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz" podStartSLOduration=1.41052403 podStartE2EDuration="1.881745783s" totalImagesPullingTime="471.221753ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:45:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:45:39.880161917 +0000 UTC m=+1992.357433500" watchObservedRunningTime="2026-07-03 11:45:39.881745783 +0000 UTC m=+1992.359017365"
Jul 03 11:45:42.616998 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:42.616967    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:45.846867 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:45.846836    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:45:51.771177 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:51.771127    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:51.918911 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:51.918882    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:53.804028 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.803994    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:45:53.902444 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.902408    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"]
Jul 03 11:45:53.906901 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.906882    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:53.909696 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.909671    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-017645\"/\"default-dockercfg-cclxb\""
Jul 03 11:45:53.910883 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.910861    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-017645\"/\"openshift-service-ca.crt\""
Jul 03 11:45:53.910969 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.910879    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-017645\"/\"test-model-017645-kserve-self-signed-certs\""
Jul 03 11:45:53.910969 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.910906    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-017645\"/\"kube-root-ca.crt\""
Jul 03 11:45:53.923518 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.923496    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"]
Jul 03 11:45:53.956760 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:53.956733    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:54.044648 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.044613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-home\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.044648 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.044649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-model-cache\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.044851 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.044691    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-dshm\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.044851 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.044757    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tmp-dir\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.044851 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.044809    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6s75\" (UniqueName: \"kubernetes.io/projected/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-kube-api-access-r6s75\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.044851 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.044848    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tls-certs\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146266 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-dshm\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146266 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tmp-dir\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146266 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6s75\" (UniqueName: \"kubernetes.io/projected/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-kube-api-access-r6s75\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146539 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146306    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tls-certs\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146539 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146349    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-home\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146539 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146376    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-model-cache\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146713 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146693    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tmp-dir\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146761 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146732    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-model-cache\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.146822 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.146803    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-home\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.148690 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.148668    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-dshm\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.148939 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.148919    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tls-certs\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.160961 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.160935    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6s75\" (UniqueName: \"kubernetes.io/projected/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-kube-api-access-r6s75\") pod \"test-model-017645-kserve-7fc46dff55-nw2qp\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") " pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.215474 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.215439    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:45:54.355897 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.355869    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"]
Jul 03 11:45:54.357353 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:45:54.357324    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe8d7c94_cdbf_45a7_b3c0_8731d0bd3e5d.slice/crio-f967982df919ab262d5e43969813e08b052af412d47a412d9abd0de040decb9c WatchSource:0}: Error finding container f967982df919ab262d5e43969813e08b052af412d47a412d9abd0de040decb9c: Status 404 returned error can't find the container with id f967982df919ab262d5e43969813e08b052af412d47a412d9abd0de040decb9c
Jul 03 11:45:54.903608 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.903577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp" event={"ID":"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d","Type":"ContainerStarted","Data":"3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5"}
Jul 03 11:45:54.903994 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.903618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp" event={"ID":"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d","Type":"ContainerStarted","Data":"f967982df919ab262d5e43969813e08b052af412d47a412d9abd0de040decb9c"}
Jul 03 11:45:54.923297 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:54.923243    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp" podStartSLOduration=1.923223565 podStartE2EDuration="1.923223565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:45:54.922468289 +0000 UTC m=+2007.399739871" watchObservedRunningTime="2026-07-03 11:45:54.923223565 +0000 UTC m=+2007.400495147"
Jul 03 11:45:59.803386 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:59.803338    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:45:59.937793 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:45:59.937758    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:04.216055 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:04.216022    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:46:04.216488 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:04.216088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:46:04.228400 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:04.228373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:46:04.955031 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:04.954998    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:46:06.028506 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:06.028465    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:46:26.317214 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:26.317173    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:30.333174 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:30.333137    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:46:44.408570 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:44.408534    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:46:46.511260 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:46.511229    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"]
Jul 03 11:46:46.548641 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:46.548606    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:47.555013 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:47.554975    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:47.705007 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:47.704968    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:48.075337 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.075246    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:48.182053 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.182022    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:48.279550 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.279501    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:48.421485 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.421453    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"]
Jul 03 11:46:48.421713 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.421676    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t" podUID="2284f0e4-fdd6-4154-8e6c-61e41da86180" containerName="maas-api" containerID="cri-o://c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7" gracePeriod=30
Jul 03 11:46:48.482512 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.482478    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:48.665256 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.665233    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:46:48.793117 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.793011    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2284f0e4-fdd6-4154-8e6c-61e41da86180-openshift-service-ca\") pod \"2284f0e4-fdd6-4154-8e6c-61e41da86180\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") "
Jul 03 11:46:48.793117 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.793054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlgx2\" (UniqueName: \"kubernetes.io/projected/2284f0e4-fdd6-4154-8e6c-61e41da86180-kube-api-access-qlgx2\") pod \"2284f0e4-fdd6-4154-8e6c-61e41da86180\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") "
Jul 03 11:46:48.793330 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.793123    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls\") pod \"2284f0e4-fdd6-4154-8e6c-61e41da86180\" (UID: \"2284f0e4-fdd6-4154-8e6c-61e41da86180\") "
Jul 03 11:46:48.793412 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.793389    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2284f0e4-fdd6-4154-8e6c-61e41da86180-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2284f0e4-fdd6-4154-8e6c-61e41da86180" (UID: "2284f0e4-fdd6-4154-8e6c-61e41da86180"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:46:48.795428 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.795397    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2284f0e4-fdd6-4154-8e6c-61e41da86180" (UID: "2284f0e4-fdd6-4154-8e6c-61e41da86180"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:46:48.795428 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.795405    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2284f0e4-fdd6-4154-8e6c-61e41da86180-kube-api-access-qlgx2" (OuterVolumeSpecName: "kube-api-access-qlgx2") pod "2284f0e4-fdd6-4154-8e6c-61e41da86180" (UID: "2284f0e4-fdd6-4154-8e6c-61e41da86180"). InnerVolumeSpecName "kube-api-access-qlgx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:46:48.894274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.894233    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2284f0e4-fdd6-4154-8e6c-61e41da86180-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:46:48.894274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.894264    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlgx2\" (UniqueName: \"kubernetes.io/projected/2284f0e4-fdd6-4154-8e6c-61e41da86180-kube-api-access-qlgx2\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:46:48.894274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:48.894275    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2284f0e4-fdd6-4154-8e6c-61e41da86180-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:46:49.126896 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.126799    2582 generic.go:356] "Generic (PLEG): container finished" podID="2284f0e4-fdd6-4154-8e6c-61e41da86180" containerID="c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7" exitCode=0
Jul 03 11:46:49.126896 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.126847    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"
Jul 03 11:46:49.127169 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.126890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t" event={"ID":"2284f0e4-fdd6-4154-8e6c-61e41da86180","Type":"ContainerDied","Data":"c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7"}
Jul 03 11:46:49.127169 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.126954    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t" event={"ID":"2284f0e4-fdd6-4154-8e6c-61e41da86180","Type":"ContainerDied","Data":"c55c8b830ed45e705b337ba5bd93fe89ea6185d417ea7edc7c0c80bb0b64060b"}
Jul 03 11:46:49.127169 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.126983    2582 scope.go:117] "RemoveContainer" containerID="c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7"
Jul 03 11:46:49.136222 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.136202    2582 scope.go:117] "RemoveContainer" containerID="c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7"
Jul 03 11:46:49.136508 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:46:49.136488    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7\": container with ID starting with c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7 not found: ID does not exist" containerID="c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7"
Jul 03 11:46:49.136581 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.136516    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7"} err="failed to get container status \"c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7\": rpc error: code = NotFound desc = could not find container \"c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7\": container with ID starting with c882b638973d6d44e8905307d0cf1662b8a697ac97adf21c907331224fdb2cb7 not found: ID does not exist"
Jul 03 11:46:49.152109 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.152066    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"]
Jul 03 11:46:49.156952 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:49.156931    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-017645-77466695c7-5jz4t"]
Jul 03 11:46:50.102497 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:50.102462    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2284f0e4-fdd6-4154-8e6c-61e41da86180" path="/var/lib/kubelet/pods/2284f0e4-fdd6-4154-8e6c-61e41da86180/volumes"
Jul 03 11:46:53.149545 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:53.149513    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:46:59.609439 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:46:59.609404    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:47:01.531327 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.531264    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp" podUID="fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" containerName="main" containerID="cri-o://3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5" gracePeriod=45
Jul 03 11:47:01.784173 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.784109    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:47:01.905330 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905300    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-dshm\") pod \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") "
Jul 03 11:47:01.905330 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905333    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tmp-dir\") pod \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") "
Jul 03 11:47:01.905611 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905354    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r6s75\" (UniqueName: \"kubernetes.io/projected/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-kube-api-access-r6s75\") pod \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") "
Jul 03 11:47:01.905611 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905385    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-model-cache\") pod \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") "
Jul 03 11:47:01.905611 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905430    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-home\") pod \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") "
Jul 03 11:47:01.905611 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905477    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tls-certs\") pod \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\" (UID: \"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d\") "
Jul 03 11:47:01.905815 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905632    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" (UID: "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:47:01.905815 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905660    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-model-cache" (OuterVolumeSpecName: "model-cache") pod "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" (UID: "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:47:01.905815 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905738    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-home" (OuterVolumeSpecName: "home") pod "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" (UID: "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:47:01.905934 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905817    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-home\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:01.905934 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905834    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tmp-dir\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:01.905934 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.905852    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-model-cache\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:01.907734 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.907713    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-dshm" (OuterVolumeSpecName: "dshm") pod "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" (UID: "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:47:01.907822 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.907748    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" (UID: "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:47:01.907822 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:01.907793    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-kube-api-access-r6s75" (OuterVolumeSpecName: "kube-api-access-r6s75") pod "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" (UID: "fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d"). InnerVolumeSpecName "kube-api-access-r6s75". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:47:02.007094 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.007049    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-tls-certs\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:02.007094 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.007095    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-dshm\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:02.007094 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.007104    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r6s75\" (UniqueName: \"kubernetes.io/projected/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d-kube-api-access-r6s75\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:02.182485 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.182452    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" containerID="3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5" exitCode=0
Jul 03 11:47:02.182653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.182496    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"
Jul 03 11:47:02.182653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.182532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp" event={"ID":"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d","Type":"ContainerDied","Data":"3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5"}
Jul 03 11:47:02.182653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.182576    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp" event={"ID":"fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d","Type":"ContainerDied","Data":"f967982df919ab262d5e43969813e08b052af412d47a412d9abd0de040decb9c"}
Jul 03 11:47:02.182653 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.182592    2582 scope.go:117] "RemoveContainer" containerID="3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5"
Jul 03 11:47:02.191101 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.191061    2582 scope.go:117] "RemoveContainer" containerID="3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5"
Jul 03 11:47:02.191379 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:47:02.191359    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5\": container with ID starting with 3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5 not found: ID does not exist" containerID="3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5"
Jul 03 11:47:02.191455 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.191387    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5"} err="failed to get container status \"3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5\": rpc error: code = NotFound desc = could not find container \"3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5\": container with ID starting with 3a2eeb496cb3fac90485cc5dd20ea949a887f2bf25f0bbc1289a8d96126ea2e5 not found: ID does not exist"
Jul 03 11:47:02.210944 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.210913    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"]
Jul 03 11:47:02.217660 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:02.217591    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-017645/test-model-017645-kserve-7fc46dff55-nw2qp"]
Jul 03 11:47:04.099198 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:04.099159    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" path="/var/lib/kubelet/pods/fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d/volumes"
Jul 03 11:47:25.903563 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:25.903526    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:26.210442 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:26.210363    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:28.086929 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:28.086897    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:47:28.090113 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:28.090093    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:47:31.608754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:31.608718    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:31.965130 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:31.965095    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:32.174701 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:32.174666    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:32.428439 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:32.428406    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:32.875574 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:32.875489    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:33.144118 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.144007    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:33.288295 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.288250    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:33.492827 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.492782    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"]
Jul 03 11:47:33.493021 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.492994    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz" podUID="23e96bd4-2b9c-4743-997a-f2463ea9c30a" containerName="maas-api" containerID="cri-o://2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7" gracePeriod=30
Jul 03 11:47:33.567189 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.567156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:33.740375 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.740348    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:47:33.759189 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.759119    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxjsl\" (UniqueName: \"kubernetes.io/projected/23e96bd4-2b9c-4743-997a-f2463ea9c30a-kube-api-access-zxjsl\") pod \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") "
Jul 03 11:47:33.759189 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.759174    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls\") pod \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") "
Jul 03 11:47:33.759359 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.759199    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23e96bd4-2b9c-4743-997a-f2463ea9c30a-openshift-service-ca\") pod \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\" (UID: \"23e96bd4-2b9c-4743-997a-f2463ea9c30a\") "
Jul 03 11:47:33.759609 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.759585    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23e96bd4-2b9c-4743-997a-f2463ea9c30a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "23e96bd4-2b9c-4743-997a-f2463ea9c30a" (UID: "23e96bd4-2b9c-4743-997a-f2463ea9c30a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:47:33.761338 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.761314    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23e96bd4-2b9c-4743-997a-f2463ea9c30a-kube-api-access-zxjsl" (OuterVolumeSpecName: "kube-api-access-zxjsl") pod "23e96bd4-2b9c-4743-997a-f2463ea9c30a" (UID: "23e96bd4-2b9c-4743-997a-f2463ea9c30a"). InnerVolumeSpecName "kube-api-access-zxjsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:47:33.761418 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.761340    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "23e96bd4-2b9c-4743-997a-f2463ea9c30a" (UID: "23e96bd4-2b9c-4743-997a-f2463ea9c30a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:47:33.860568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.860527    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/23e96bd4-2b9c-4743-997a-f2463ea9c30a-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:33.860568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.860560    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/23e96bd4-2b9c-4743-997a-f2463ea9c30a-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:33.860568 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:33.860569    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxjsl\" (UniqueName: \"kubernetes.io/projected/23e96bd4-2b9c-4743-997a-f2463ea9c30a-kube-api-access-zxjsl\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:47:34.315728 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.315695    2582 generic.go:356] "Generic (PLEG): container finished" podID="23e96bd4-2b9c-4743-997a-f2463ea9c30a" containerID="2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7" exitCode=0
Jul 03 11:47:34.316193 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.315742    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"
Jul 03 11:47:34.316193 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.315792    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz" event={"ID":"23e96bd4-2b9c-4743-997a-f2463ea9c30a","Type":"ContainerDied","Data":"2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7"}
Jul 03 11:47:34.316193 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.315841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz" event={"ID":"23e96bd4-2b9c-4743-997a-f2463ea9c30a","Type":"ContainerDied","Data":"7835c0639f8a131ada618fa763d0167dbbac2c71d3703f51e011e60a7522acbf"}
Jul 03 11:47:34.316193 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.315862    2582 scope.go:117] "RemoveContainer" containerID="2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7"
Jul 03 11:47:34.324270 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.324250    2582 scope.go:117] "RemoveContainer" containerID="2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7"
Jul 03 11:47:34.324576 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:47:34.324555    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7\": container with ID starting with 2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7 not found: ID does not exist" containerID="2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7"
Jul 03 11:47:34.324628 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.324594    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7"} err="failed to get container status \"2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7\": rpc error: code = NotFound desc = could not find container \"2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7\": container with ID starting with 2de020a77041e5923ae250885c00fe1ef3c2b1c8300d0f771311dcc23efeabc7 not found: ID does not exist"
Jul 03 11:47:34.350239 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.350201    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"]
Jul 03 11:47:34.360825 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:34.360750    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-44ab65-9bb658949-49kmz"]
Jul 03 11:47:36.104984 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:36.104949    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23e96bd4-2b9c-4743-997a-f2463ea9c30a" path="/var/lib/kubelet/pods/23e96bd4-2b9c-4743-997a-f2463ea9c30a/volumes"
Jul 03 11:47:36.152852 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:36.152818    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:47:39.591751 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:39.591676    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:39.711238 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:39.711202    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:39.979922 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:39.979888    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:40.231472 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:40.231364    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:40.535043 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:40.534949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:41.176775 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:41.176737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:41.509971 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:41.509876    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:43.989169 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:43.989120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:44.086246 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086214    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"]
Jul 03 11:47:44.086525 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086513    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" containerName="main"
Jul 03 11:47:44.086583 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086526    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" containerName="main"
Jul 03 11:47:44.086583 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086542    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2284f0e4-fdd6-4154-8e6c-61e41da86180" containerName="maas-api"
Jul 03 11:47:44.086583 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086548    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2284f0e4-fdd6-4154-8e6c-61e41da86180" containerName="maas-api"
Jul 03 11:47:44.086583 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086563    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23e96bd4-2b9c-4743-997a-f2463ea9c30a" containerName="maas-api"
Jul 03 11:47:44.086583 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086568    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="23e96bd4-2b9c-4743-997a-f2463ea9c30a" containerName="maas-api"
Jul 03 11:47:44.086761 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086611    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="23e96bd4-2b9c-4743-997a-f2463ea9c30a" containerName="maas-api"
Jul 03 11:47:44.086761 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086619    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2284f0e4-fdd6-4154-8e6c-61e41da86180" containerName="maas-api"
Jul 03 11:47:44.086761 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.086626    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe8d7c94-cdbf-45a7-b3c0-8731d0bd3e5d" containerName="main"
Jul 03 11:47:44.090513 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.090495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.094323 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.094298    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:47:44.094563 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.094541    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-515460-serving-cert\""
Jul 03 11:47:44.112616 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.112587    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"]
Jul 03 11:47:44.141521 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.141494    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk79d\" (UniqueName: \"kubernetes.io/projected/1292404e-d001-4a60-a98a-0d854a7f712f-kube-api-access-fk79d\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.141650 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.141525    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.141650 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.141560    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292404e-d001-4a60-a98a-0d854a7f712f-openshift-service-ca\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.162735 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.162702    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:44.242873 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.242787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292404e-d001-4a60-a98a-0d854a7f712f-openshift-service-ca\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.242873 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.242850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk79d\" (UniqueName: \"kubernetes.io/projected/1292404e-d001-4a60-a98a-0d854a7f712f-kube-api-access-fk79d\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.242873 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.242873    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.243188 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:47:44.242960    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-api-a-515460-serving-cert: secret "maas-api-e2e-api-a-515460-serving-cert" not found
Jul 03 11:47:44.243188 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:47:44.243014    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls podName:1292404e-d001-4a60-a98a-0d854a7f712f nodeName:}" failed. No retries permitted until 2026-07-03 11:47:44.742997845 +0000 UTC m=+2117.220269405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls") pod "maas-api-e2e-api-a-515460-9fdff9cc8-kbf65" (UID: "1292404e-d001-4a60-a98a-0d854a7f712f") : secret "maas-api-e2e-api-a-515460-serving-cert" not found
Jul 03 11:47:44.243570 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.243542    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292404e-d001-4a60-a98a-0d854a7f712f-openshift-service-ca\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.256335 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.256308    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk79d\" (UniqueName: \"kubernetes.io/projected/1292404e-d001-4a60-a98a-0d854a7f712f-kube-api-access-fk79d\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.370353 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.370317    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:44.576831 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.576729    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:44.747469 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.747437    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:44.749937 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:44.749906    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls\") pod \"maas-api-e2e-api-a-515460-9fdff9cc8-kbf65\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") " pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:45.001207 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:45.001160    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:45.164758 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:45.164730    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"]
Jul 03 11:47:45.167703 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:47:45.167677    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1292404e_d001_4a60_a98a_0d854a7f712f.slice/crio-0c20af223af94f832bd1a8544f8a7f772226c2a3481a89ae6227073a3366e2e8 WatchSource:0}: Error finding container 0c20af223af94f832bd1a8544f8a7f772226c2a3481a89ae6227073a3366e2e8: Status 404 returned error can't find the container with id 0c20af223af94f832bd1a8544f8a7f772226c2a3481a89ae6227073a3366e2e8
Jul 03 11:47:45.336865 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:45.336754    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:45.362571 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:45.362542    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65" event={"ID":"1292404e-d001-4a60-a98a-0d854a7f712f","Type":"ContainerStarted","Data":"0c20af223af94f832bd1a8544f8a7f772226c2a3481a89ae6227073a3366e2e8"}
Jul 03 11:47:45.467107 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:45.467055    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:46.369396 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:46.369360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65" event={"ID":"1292404e-d001-4a60-a98a-0d854a7f712f","Type":"ContainerStarted","Data":"f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5"}
Jul 03 11:47:46.369796 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:46.369481    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:46.397690 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:46.397643    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65" podStartSLOduration=1.887638533 podStartE2EDuration="2.397628463s" totalImagesPullingTime="509.98993ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:47:46.395770574 +0000 UTC m=+2118.873042167" watchObservedRunningTime="2026-07-03 11:47:46.397628463 +0000 UTC m=+2118.874900042"
Jul 03 11:47:48.473143 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:48.473109    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:48.578187 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:48.578156    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:48.956746 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:48.956719    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:49.307083 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:49.306994    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:49.429341 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:49.429313    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:49.519163 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:49.519120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:51.737890 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:51.737853    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:47:52.254648 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.254621    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:52.309685 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.309654    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"]
Jul 03 11:47:52.313419 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.313398    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.316367 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.316337    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-8730be-serving-cert\""
Jul 03 11:47:52.363772 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.363743    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"]
Jul 03 11:47:52.379134 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.379111    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:47:52.405508 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.405482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-maas-api-tls\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.405635 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.405543    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-openshift-service-ca\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.405635 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.405573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs6vn\" (UniqueName: \"kubernetes.io/projected/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-kube-api-access-fs6vn\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.426948 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.426858    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:52.506685 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.506651    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-openshift-service-ca\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.506685 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.506682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs6vn\" (UniqueName: \"kubernetes.io/projected/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-kube-api-access-fs6vn\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.506893 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.506828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-maas-api-tls\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.507457 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.507431    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-openshift-service-ca\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.509415 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.509393    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-maas-api-tls\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.542621 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.542588    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs6vn\" (UniqueName: \"kubernetes.io/projected/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-kube-api-access-fs6vn\") pod \"maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") " pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.624795 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.624755    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:52.660861 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.660820    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:52.804255 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:52.804232    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"]
Jul 03 11:47:52.805946 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:47:52.805916    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcba0a8cd_4f17_48af_b1fb_bd84b1aa8dc6.slice/crio-7304b152703af85e6c32aa585c610b76c22a73d99a1477f245e95e914c5a0993 WatchSource:0}: Error finding container 7304b152703af85e6c32aa585c610b76c22a73d99a1477f245e95e914c5a0993: Status 404 returned error can't find the container with id 7304b152703af85e6c32aa585c610b76c22a73d99a1477f245e95e914c5a0993
Jul 03 11:47:53.402262 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:53.402223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm" event={"ID":"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6","Type":"ContainerStarted","Data":"e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385"}
Jul 03 11:47:53.402448 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:53.402274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm" event={"ID":"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6","Type":"ContainerStarted","Data":"7304b152703af85e6c32aa585c610b76c22a73d99a1477f245e95e914c5a0993"}
Jul 03 11:47:53.402448 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:53.402357    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:47:53.436735 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:53.436679    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm" podStartSLOduration=1.046076014 podStartE2EDuration="1.436663481s" totalImagesPullingTime="390.587467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:47:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:47:53.435873391 +0000 UTC m=+2125.913144974" watchObservedRunningTime="2026-07-03 11:47:53.436663481 +0000 UTC m=+2125.913935066"
Jul 03 11:47:53.731190 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:53.731151    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:53.907688 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:53.907654    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:56.545615 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:56.545576    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:47:59.412775 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:47:59.412749    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:48:04.655758 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:04.655729    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:05.048618 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.048541    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:05.227572 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.227538    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:05.350678 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.350591    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:05.595786 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.595758    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"]
Jul 03 11:48:05.595997 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.595972    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65" podUID="1292404e-d001-4a60-a98a-0d854a7f712f" containerName="maas-api" containerID="cri-o://f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5" gracePeriod=30
Jul 03 11:48:05.667787 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.667759    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:05.839798 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.839777    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:48:05.920843 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.920817    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk79d\" (UniqueName: \"kubernetes.io/projected/1292404e-d001-4a60-a98a-0d854a7f712f-kube-api-access-fk79d\") pod \"1292404e-d001-4a60-a98a-0d854a7f712f\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") "
Jul 03 11:48:05.921001 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.920857    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls\") pod \"1292404e-d001-4a60-a98a-0d854a7f712f\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") "
Jul 03 11:48:05.921001 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.920933    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292404e-d001-4a60-a98a-0d854a7f712f-openshift-service-ca\") pod \"1292404e-d001-4a60-a98a-0d854a7f712f\" (UID: \"1292404e-d001-4a60-a98a-0d854a7f712f\") "
Jul 03 11:48:05.921306 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.921280    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1292404e-d001-4a60-a98a-0d854a7f712f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1292404e-d001-4a60-a98a-0d854a7f712f" (UID: "1292404e-d001-4a60-a98a-0d854a7f712f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:48:05.923213 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.923193    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1292404e-d001-4a60-a98a-0d854a7f712f" (UID: "1292404e-d001-4a60-a98a-0d854a7f712f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:48:05.923213 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:05.923202    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1292404e-d001-4a60-a98a-0d854a7f712f-kube-api-access-fk79d" (OuterVolumeSpecName: "kube-api-access-fk79d") pod "1292404e-d001-4a60-a98a-0d854a7f712f" (UID: "1292404e-d001-4a60-a98a-0d854a7f712f"). InnerVolumeSpecName "kube-api-access-fk79d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:48:06.022316 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.022286    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1292404e-d001-4a60-a98a-0d854a7f712f-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:48:06.022316 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.022313    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk79d\" (UniqueName: \"kubernetes.io/projected/1292404e-d001-4a60-a98a-0d854a7f712f-kube-api-access-fk79d\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:48:06.022316 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.022323    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1292404e-d001-4a60-a98a-0d854a7f712f-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:48:06.455776 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.455745    2582 generic.go:356] "Generic (PLEG): container finished" podID="1292404e-d001-4a60-a98a-0d854a7f712f" containerID="f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5" exitCode=0
Jul 03 11:48:06.455944 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.455790    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"
Jul 03 11:48:06.455944 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.455810    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65" event={"ID":"1292404e-d001-4a60-a98a-0d854a7f712f","Type":"ContainerDied","Data":"f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5"}
Jul 03 11:48:06.455944 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.455853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65" event={"ID":"1292404e-d001-4a60-a98a-0d854a7f712f","Type":"ContainerDied","Data":"0c20af223af94f832bd1a8544f8a7f772226c2a3481a89ae6227073a3366e2e8"}
Jul 03 11:48:06.455944 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.455874    2582 scope.go:117] "RemoveContainer" containerID="f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5"
Jul 03 11:48:06.464017 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.463999    2582 scope.go:117] "RemoveContainer" containerID="f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5"
Jul 03 11:48:06.464271 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:48:06.464249    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5\": container with ID starting with f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5 not found: ID does not exist" containerID="f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5"
Jul 03 11:48:06.464328 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.464274    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5"} err="failed to get container status \"f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5\": rpc error: code = NotFound desc = could not find container \"f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5\": container with ID starting with f10415eda45d5109115ea41459153ac2494cff4b7778ba452c38763aba289cd5 not found: ID does not exist"
Jul 03 11:48:06.482601 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.482576    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"]
Jul 03 11:48:06.496408 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.496382    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-515460-9fdff9cc8-kbf65"]
Jul 03 11:48:06.916021 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:06.915989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:48:08.099918 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:08.099885    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1292404e-d001-4a60-a98a-0d854a7f712f" path="/var/lib/kubelet/pods/1292404e-d001-4a60-a98a-0d854a7f712f/volumes"
Jul 03 11:48:11.307486 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:11.307451    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:11.406326 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:11.406294    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:11.607585 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:11.607499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:11.864811 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:11.864726    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:12.056627 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:12.056585    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:12.397359 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:12.397326    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:12.504356 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:12.504319    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:12.606226 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:12.606192    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:12.764004 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:12.763964    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"]
Jul 03 11:48:12.764285 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:12.764257    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm" podUID="cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" containerName="maas-api" containerID="cri-o://e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385" gracePeriod=30
Jul 03 11:48:12.806764 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:12.806737    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:13.003448 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.003423    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:48:13.076991 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.076878    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-openshift-service-ca\") pod \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") "
Jul 03 11:48:13.076991 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.076930    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-maas-api-tls\") pod \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") "
Jul 03 11:48:13.076991 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.076965    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fs6vn\" (UniqueName: \"kubernetes.io/projected/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-kube-api-access-fs6vn\") pod \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\" (UID: \"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6\") "
Jul 03 11:48:13.077375 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.077351    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" (UID: "cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:48:13.079221 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.079201    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-kube-api-access-fs6vn" (OuterVolumeSpecName: "kube-api-access-fs6vn") pod "cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" (UID: "cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6"). InnerVolumeSpecName "kube-api-access-fs6vn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:48:13.079339 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.079324    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" (UID: "cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:48:13.178518 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.178482    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:48:13.178518 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.178517    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:48:13.178733 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.178534    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fs6vn\" (UniqueName: \"kubernetes.io/projected/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6-kube-api-access-fs6vn\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:48:13.486873 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.486834    2582 generic.go:356] "Generic (PLEG): container finished" podID="cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" containerID="e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385" exitCode=0
Jul 03 11:48:13.487329 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.486886    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"
Jul 03 11:48:13.487329 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.486928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm" event={"ID":"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6","Type":"ContainerDied","Data":"e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385"}
Jul 03 11:48:13.487329 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.486995    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm" event={"ID":"cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6","Type":"ContainerDied","Data":"7304b152703af85e6c32aa585c610b76c22a73d99a1477f245e95e914c5a0993"}
Jul 03 11:48:13.487329 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.487028    2582 scope.go:117] "RemoveContainer" containerID="e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385"
Jul 03 11:48:13.495714 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.495696    2582 scope.go:117] "RemoveContainer" containerID="e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385"
Jul 03 11:48:13.495953 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:48:13.495935    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385\": container with ID starting with e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385 not found: ID does not exist" containerID="e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385"
Jul 03 11:48:13.496006 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.495962    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385"} err="failed to get container status \"e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385\": rpc error: code = NotFound desc = could not find container \"e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385\": container with ID starting with e87e9aed0f2d8b85d265c856c3f919d08f3f89a1bb2c64d90f64f4b9e594a385 not found: ID does not exist"
Jul 03 11:48:13.510319 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.510291    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"]
Jul 03 11:48:13.514239 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:13.514213    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-8730be-559dd88bf7-4k8hm"]
Jul 03 11:48:14.099742 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:14.099713    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" path="/var/lib/kubelet/pods/cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6/volumes"
Jul 03 11:48:19.656840 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:19.656744    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:19.774268 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:19.774227    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:19.957611 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:19.957569    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:20.172571 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:20.172469    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:20.496354 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:20.496256    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:20.844820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:20.844722    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:20.964744 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:20.964708    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:22.728972 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:22.728929    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:48:24.289942 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.289892    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:24.410830 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.410795    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:24.492743 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.492709    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"]
Jul 03 11:48:24.493029 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.493016    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" containerName="maas-api"
Jul 03 11:48:24.493029 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.493031    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" containerName="maas-api"
Jul 03 11:48:24.493156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.493047    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1292404e-d001-4a60-a98a-0d854a7f712f" containerName="maas-api"
Jul 03 11:48:24.493156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.493053    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1292404e-d001-4a60-a98a-0d854a7f712f" containerName="maas-api"
Jul 03 11:48:24.493156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.493128    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cba0a8cd-4f17-48af-b1fb-bd84b1aa8dc6" containerName="maas-api"
Jul 03 11:48:24.493156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.493137    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1292404e-d001-4a60-a98a-0d854a7f712f" containerName="maas-api"
Jul 03 11:48:24.497269 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.497252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.501842 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.501820    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-9c2097-serving-cert\""
Jul 03 11:48:24.501966 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.501869    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w4k6\""
Jul 03 11:48:24.513488 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.513455    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"]
Jul 03 11:48:24.534154 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.534120    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:24.672270 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.672229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78af1bed-1e82-46c2-8416-509aa77d830f-maas-api-tls\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.672464 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.672296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d85h9\" (UniqueName: \"kubernetes.io/projected/78af1bed-1e82-46c2-8416-509aa77d830f-kube-api-access-d85h9\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.672464 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.672327    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af1bed-1e82-46c2-8416-509aa77d830f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.773244 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.773207    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78af1bed-1e82-46c2-8416-509aa77d830f-maas-api-tls\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.773464 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.773261    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d85h9\" (UniqueName: \"kubernetes.io/projected/78af1bed-1e82-46c2-8416-509aa77d830f-kube-api-access-d85h9\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.773464 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.773389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af1bed-1e82-46c2-8416-509aa77d830f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.774004 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.773982    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af1bed-1e82-46c2-8416-509aa77d830f-openshift-service-ca\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.775781 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.775758    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78af1bed-1e82-46c2-8416-509aa77d830f-maas-api-tls\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.796545 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.796520    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d85h9\" (UniqueName: \"kubernetes.io/projected/78af1bed-1e82-46c2-8416-509aa77d830f-kube-api-access-d85h9\") pod \"maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") " pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.807432 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.807403    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:24.837721 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.837690    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:24.980266 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:24.980186    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"]
Jul 03 11:48:24.983060 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:48:24.983033    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78af1bed_1e82_46c2_8416_509aa77d830f.slice/crio-9f1af8100fe81d177ea15e658d1dbf9431c564677927b9cdbace180072cf660d WatchSource:0}: Error finding container 9f1af8100fe81d177ea15e658d1dbf9431c564677927b9cdbace180072cf660d: Status 404 returned error can't find the container with id 9f1af8100fe81d177ea15e658d1dbf9431c564677927b9cdbace180072cf660d
Jul 03 11:48:25.529311 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:25.529276    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:25.544218 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:25.544181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp" event={"ID":"78af1bed-1e82-46c2-8416-509aa77d830f","Type":"ContainerStarted","Data":"7df8aacdb180330bf0f2a0dd62ffce3bdfc7618d2f8563551413229b8bf97a5d"}
Jul 03 11:48:25.544363 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:25.544233    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp" event={"ID":"78af1bed-1e82-46c2-8416-509aa77d830f","Type":"ContainerStarted","Data":"9f1af8100fe81d177ea15e658d1dbf9431c564677927b9cdbace180072cf660d"}
Jul 03 11:48:25.544363 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:25.544282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:25.573188 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:25.573061    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp" podStartSLOduration=1.258354981 podStartE2EDuration="1.573045813s" totalImagesPullingTime="314.690832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:48:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:48:25.572218203 +0000 UTC m=+2158.049489784" watchObservedRunningTime="2026-07-03 11:48:25.573045813 +0000 UTC m=+2158.050317421"
Jul 03 11:48:25.854337 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:25.854256    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:28.740642 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:28.740611    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:29.075994 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:29.075901    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:29.468643 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:29.468606    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:29.752818 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:29.752741    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:31.554445 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:31.554415    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:48:32.053698 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.053665    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:32.152527 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.152499    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:32.274527 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.274494    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:32.354567 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.354484    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"]
Jul 03 11:48:32.357501 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.357481    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:32.360111 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.360093    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-f7a699-serving-cert\""
Jul 03 11:48:32.375233 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.375206    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"]
Jul 03 11:48:32.386409 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.386384    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:32.430554 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.430526    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed36638e-26e4-4faa-bfab-633cd02a652a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:32.430741 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.430572    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:32.430741 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.430619    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52jvh\" (UniqueName: \"kubernetes.io/projected/ed36638e-26e4-4faa-bfab-633cd02a652a-kube-api-access-52jvh\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:32.474909 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.474882    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:32.531264 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.531223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52jvh\" (UniqueName: \"kubernetes.io/projected/ed36638e-26e4-4faa-bfab-633cd02a652a-kube-api-access-52jvh\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:32.531264 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.531273    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed36638e-26e4-4faa-bfab-633cd02a652a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:32.531555 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.531323    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:32.531555 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:48:32.531407    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-f7a699-serving-cert: secret "maas-api-e2e-shared-b-f7a699-serving-cert" not found
Jul 03 11:48:32.531555 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:48:32.531464    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls podName:ed36638e-26e4-4faa-bfab-633cd02a652a nodeName:}" failed. No retries permitted until 2026-07-03 11:48:33.031446075 +0000 UTC m=+2165.508717636 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls") pod "maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq" (UID: "ed36638e-26e4-4faa-bfab-633cd02a652a") : secret "maas-api-e2e-shared-b-f7a699-serving-cert" not found
Jul 03 11:48:32.531976 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.531957    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed36638e-26e4-4faa-bfab-633cd02a652a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:32.555846 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:32.555810    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-52jvh\" (UniqueName: \"kubernetes.io/projected/ed36638e-26e4-4faa-bfab-633cd02a652a-kube-api-access-52jvh\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:33.035928 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:33.035884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:33.037982 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:48:33.036030    2582 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-f7a699-serving-cert: secret "maas-api-e2e-shared-b-f7a699-serving-cert" not found
Jul 03 11:48:33.037982 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:48:33.036115    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls podName:ed36638e-26e4-4faa-bfab-633cd02a652a nodeName:}" failed. No retries permitted until 2026-07-03 11:48:34.036097143 +0000 UTC m=+2166.513368702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls") pod "maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq" (UID: "ed36638e-26e4-4faa-bfab-633cd02a652a") : secret "maas-api-e2e-shared-b-f7a699-serving-cert" not found
Jul 03 11:48:33.271947 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:33.271904    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:33.475858 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:33.475824    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:33.582378 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:33.582347    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:33.628950 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:33.628901    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:48:34.043988 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:34.043954    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:34.051660 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:34.046866    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls\") pod \"maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") " pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:34.167852 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:34.167816    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:34.312088 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:34.311988    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"]
Jul 03 11:48:34.314716 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:48:34.314687    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded36638e_26e4_4faa_bfab_633cd02a652a.slice/crio-03f8dc17ae3f9a974d53a9147d1aa3f0d2cb47b5659cc9ff859701a179475d32 WatchSource:0}: Error finding container 03f8dc17ae3f9a974d53a9147d1aa3f0d2cb47b5659cc9ff859701a179475d32: Status 404 returned error can't find the container with id 03f8dc17ae3f9a974d53a9147d1aa3f0d2cb47b5659cc9ff859701a179475d32
Jul 03 11:48:34.582710 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:34.582623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq" event={"ID":"ed36638e-26e4-4faa-bfab-633cd02a652a","Type":"ContainerStarted","Data":"03f8dc17ae3f9a974d53a9147d1aa3f0d2cb47b5659cc9ff859701a179475d32"}
Jul 03 11:48:35.588367 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:35.588337    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq" event={"ID":"ed36638e-26e4-4faa-bfab-633cd02a652a","Type":"ContainerStarted","Data":"2d5645830f5a43dd19ed93834c0bfd550a0225ef6f58ec23a132cb1211f98e7f"}
Jul 03 11:48:35.588826 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:35.588475    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:35.611772 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:35.611721    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq" podStartSLOduration=3.234558583 podStartE2EDuration="3.61170676s" totalImagesPullingTime="377.148177ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:48:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:48:35.610365825 +0000 UTC m=+2168.087637407" watchObservedRunningTime="2026-07-03 11:48:35.61170676 +0000 UTC m=+2168.088978341"
Jul 03 11:48:36.774958 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:36.774922    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:41.598296 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:41.598269    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:48:46.716145 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:46.716106    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:48:47.805529 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:47.805497    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:47.903248 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:47.903212    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:49.932231 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.932198    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"]
Jul 03 11:48:49.935648 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.935631    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:49.939589 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.939570    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9c2097\"/\"auth-test-model-9c2097-kserve-self-signed-certs\""
Jul 03 11:48:49.940606 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.940590    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9c2097\"/\"kube-root-ca.crt\""
Jul 03 11:48:49.940680 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.940634    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-9c2097\"/\"default-dockercfg-8jfcx\""
Jul 03 11:48:49.940680 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.940662    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-9c2097\"/\"openshift-service-ca.crt\""
Jul 03 11:48:49.947772 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.947748    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"]
Jul 03 11:48:49.954509 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.954487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh2fc\" (UniqueName: \"kubernetes.io/projected/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-kube-api-access-jh2fc\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:49.954618 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.954534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tmp-dir\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:49.954618 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.954561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tls-certs\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:49.954704 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.954628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-dshm\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:49.954704 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.954683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-home\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:49.954784 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.954728    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-model-cache\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:49.968168 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:49.968139    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:50.055278 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055239    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh2fc\" (UniqueName: \"kubernetes.io/projected/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-kube-api-access-jh2fc\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.055453 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tmp-dir\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.055453 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tls-certs\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.055571 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055465    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-dshm\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.055571 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055496    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-home\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.055571 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-model-cache\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.055727 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055618    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tmp-dir\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.055800 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055782    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-home\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.055948 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.055930    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-model-cache\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.057873 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.057851    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-dshm\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.058176 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.058155    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tls-certs\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.064910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.064890    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh2fc\" (UniqueName: \"kubernetes.io/projected/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-kube-api-access-jh2fc\") pod \"auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") " pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.244707 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.244612    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:48:50.391042 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.391016    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"]
Jul 03 11:48:50.393270 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:48:50.393241    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36e2d2e0_650e_4a35_82c2_a13f41fafa3a.slice/crio-344f671d82744b42e077b3147ff99c7c394a83fe15058156c02bc00a6f2074ba WatchSource:0}: Error finding container 344f671d82744b42e077b3147ff99c7c394a83fe15058156c02bc00a6f2074ba: Status 404 returned error can't find the container with id 344f671d82744b42e077b3147ff99c7c394a83fe15058156c02bc00a6f2074ba
Jul 03 11:48:50.652320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.652237    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2" event={"ID":"36e2d2e0-650e-4a35-82c2-a13f41fafa3a","Type":"ContainerStarted","Data":"2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862"}
Jul 03 11:48:50.652320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.652278    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2" event={"ID":"36e2d2e0-650e-4a35-82c2-a13f41fafa3a","Type":"ContainerStarted","Data":"344f671d82744b42e077b3147ff99c7c394a83fe15058156c02bc00a6f2074ba"}
Jul 03 11:48:50.677631 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:50.677572    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2" podStartSLOduration=1.677554313 podStartE2EDuration="1.677554313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:48:50.677044649 +0000 UTC m=+2183.154316231" watchObservedRunningTime="2026-07-03 11:48:50.677554313 +0000 UTC m=+2183.154825894"
Jul 03 11:48:55.536575 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:55.536531    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:48:55.637546 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:48:55.637514    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:49:00.245654 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:00.245614    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:49:00.246152 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:00.245688    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:49:00.258225 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:00.258199    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:49:00.705884 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:00.705855    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:49:01.519830 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:01.519798    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:49:09.131477 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:09.131448    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:49:30.591228 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:30.591185    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:49:34.600820 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:34.600778    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:49:49.677747 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:49.677658    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:49:49.779581 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:49.779551    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:49:53.907321 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:49:53.907288    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:50:12.809594 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:50:12.809555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:50:28.134744 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:50:28.134699    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:50:44.837704 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:50:44.837670    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:50:58.815623 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:50:58.815578    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:51:14.322377 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:14.322341    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:51:27.397457 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:27.397376    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"]
Jul 03 11:51:27.462452 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:27.462416    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:51:28.547730 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:28.547700    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:51:32.401541 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:32.401507    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:51:32.646554 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:32.646524    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:51:42.417355 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.417291    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2" podUID="36e2d2e0-650e-4a35-82c2-a13f41fafa3a" containerName="main" containerID="cri-o://2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862" gracePeriod=45
Jul 03 11:51:42.430640 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:51:42.430604    2582 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36e2d2e0_650e_4a35_82c2_a13f41fafa3a.slice/crio-conmon-2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862.scope\": RecentStats: unable to find data in memory cache]"
Jul 03 11:51:42.669620 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.669556    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:51:42.716567 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.716531    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tls-certs\") pod \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") "
Jul 03 11:51:42.716567 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.716573    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh2fc\" (UniqueName: \"kubernetes.io/projected/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-kube-api-access-jh2fc\") pod \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") "
Jul 03 11:51:42.716795 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.716601    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-home\") pod \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") "
Jul 03 11:51:42.716795 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.716660    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-dshm\") pod \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") "
Jul 03 11:51:42.716795 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.716684    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-model-cache\") pod \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") "
Jul 03 11:51:42.716795 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.716736    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tmp-dir\") pod \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\" (UID: \"36e2d2e0-650e-4a35-82c2-a13f41fafa3a\") "
Jul 03 11:51:42.717008 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.716967    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-home" (OuterVolumeSpecName: "home") pod "36e2d2e0-650e-4a35-82c2-a13f41fafa3a" (UID: "36e2d2e0-650e-4a35-82c2-a13f41fafa3a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:51:42.717052 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.716990    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-model-cache" (OuterVolumeSpecName: "model-cache") pod "36e2d2e0-650e-4a35-82c2-a13f41fafa3a" (UID: "36e2d2e0-650e-4a35-82c2-a13f41fafa3a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:51:42.717052 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.717035    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36e2d2e0-650e-4a35-82c2-a13f41fafa3a" (UID: "36e2d2e0-650e-4a35-82c2-a13f41fafa3a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:51:42.718956 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.718933    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36e2d2e0-650e-4a35-82c2-a13f41fafa3a" (UID: "36e2d2e0-650e-4a35-82c2-a13f41fafa3a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:51:42.718956 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.718941    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-dshm" (OuterVolumeSpecName: "dshm") pod "36e2d2e0-650e-4a35-82c2-a13f41fafa3a" (UID: "36e2d2e0-650e-4a35-82c2-a13f41fafa3a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:51:42.719142 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.718977    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-kube-api-access-jh2fc" (OuterVolumeSpecName: "kube-api-access-jh2fc") pod "36e2d2e0-650e-4a35-82c2-a13f41fafa3a" (UID: "36e2d2e0-650e-4a35-82c2-a13f41fafa3a"). InnerVolumeSpecName "kube-api-access-jh2fc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:51:42.818340 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.818303    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-dshm\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:51:42.818340 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.818333    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-model-cache\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:51:42.818340 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.818346    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tmp-dir\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:51:42.818340 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.818354    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-tls-certs\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:51:42.818619 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.818363    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh2fc\" (UniqueName: \"kubernetes.io/projected/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-kube-api-access-jh2fc\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:51:42.818619 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:42.818372    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36e2d2e0-650e-4a35-82c2-a13f41fafa3a-home\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:51:43.380027 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.379987    2582 generic.go:356] "Generic (PLEG): container finished" podID="36e2d2e0-650e-4a35-82c2-a13f41fafa3a" containerID="2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862" exitCode=0
Jul 03 11:51:43.380027 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.380034    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"
Jul 03 11:51:43.380521 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.380066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2" event={"ID":"36e2d2e0-650e-4a35-82c2-a13f41fafa3a","Type":"ContainerDied","Data":"2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862"}
Jul 03 11:51:43.380521 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.380125    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2" event={"ID":"36e2d2e0-650e-4a35-82c2-a13f41fafa3a","Type":"ContainerDied","Data":"344f671d82744b42e077b3147ff99c7c394a83fe15058156c02bc00a6f2074ba"}
Jul 03 11:51:43.380521 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.380144    2582 scope.go:117] "RemoveContainer" containerID="2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862"
Jul 03 11:51:43.389487 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.389465    2582 scope.go:117] "RemoveContainer" containerID="2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862"
Jul 03 11:51:43.389765 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:51:43.389746    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862\": container with ID starting with 2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862 not found: ID does not exist" containerID="2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862"
Jul 03 11:51:43.389815 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.389776    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862"} err="failed to get container status \"2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862\": rpc error: code = NotFound desc = could not find container \"2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862\": container with ID starting with 2d957b083d47b29b7c84888f935a81e77e11319d31ad0c63d1687563b293f862 not found: ID does not exist"
Jul 03 11:51:43.404296 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.404266    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"]
Jul 03 11:51:43.410373 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:43.410351    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-9c2097/auth-test-model-9c2097-kserve-5c6d7cb64c-k26w2"]
Jul 03 11:51:44.100222 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:44.100177    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36e2d2e0-650e-4a35-82c2-a13f41fafa3a" path="/var/lib/kubelet/pods/36e2d2e0-650e-4a35-82c2-a13f41fafa3a/volumes"
Jul 03 11:51:48.103707 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:51:48.103679    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:52:01.133233 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.133200    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"]
Jul 03 11:52:01.133650 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.133514    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36e2d2e0-650e-4a35-82c2-a13f41fafa3a" containerName="main"
Jul 03 11:52:01.133650 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.133526    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="36e2d2e0-650e-4a35-82c2-a13f41fafa3a" containerName="main"
Jul 03 11:52:01.133650 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.133586    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="36e2d2e0-650e-4a35-82c2-a13f41fafa3a" containerName="main"
Jul 03 11:52:01.137754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.137735    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.141447 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.141424    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f7a699\"/\"openshift-service-ca.crt\""
Jul 03 11:52:01.141585 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.141543    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f7a699\"/\"default-dockercfg-m9qk6\""
Jul 03 11:52:01.142780 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.142765    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f7a699\"/\"kube-root-ca.crt\""
Jul 03 11:52:01.142883 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.142794    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f7a699\"/\"sub-test-model-f7a699-kserve-self-signed-certs\""
Jul 03 11:52:01.157562 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.157540    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"]
Jul 03 11:52:01.182987 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.182951    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:52:01.260952 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.260898    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-dshm\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.260952 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.260954    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c971fd8-28df-42ca-877d-971f90820042-tls-certs\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.261194 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.260972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-home\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.261194 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.261051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-tmp-dir\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.261194 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.261108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qvgz\" (UniqueName: \"kubernetes.io/projected/3c971fd8-28df-42ca-877d-971f90820042-kube-api-access-4qvgz\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.261194 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.261133    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-model-cache\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362119 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362061    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qvgz\" (UniqueName: \"kubernetes.io/projected/3c971fd8-28df-42ca-877d-971f90820042-kube-api-access-4qvgz\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-model-cache\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-dshm\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c971fd8-28df-42ca-877d-971f90820042-tls-certs\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362228    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-home\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362320 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362253    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-tmp-dir\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362611 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-model-cache\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362665 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362628    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-tmp-dir\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.362701 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.362680    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-home\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.364481 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.364462    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-dshm\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.364740 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.364721    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c971fd8-28df-42ca-877d-971f90820042-tls-certs\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.371724 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.371697    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qvgz\" (UniqueName: \"kubernetes.io/projected/3c971fd8-28df-42ca-877d-971f90820042-kube-api-access-4qvgz\") pod \"sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") " pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.446933 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.446901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:01.583033 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:01.582880    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"]
Jul 03 11:52:01.585713 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:52:01.585688    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3c971fd8_28df_42ca_877d_971f90820042.slice/crio-552915f64acce193933d2abdd6189a24dcb862ad2f695f3919ab74a960c396dc WatchSource:0}: Error finding container 552915f64acce193933d2abdd6189a24dcb862ad2f695f3919ab74a960c396dc: Status 404 returned error can't find the container with id 552915f64acce193933d2abdd6189a24dcb862ad2f695f3919ab74a960c396dc
Jul 03 11:52:02.462867 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:02.462831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m" event={"ID":"3c971fd8-28df-42ca-877d-971f90820042","Type":"ContainerStarted","Data":"4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b"}
Jul 03 11:52:02.462867 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:02.462868    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m" event={"ID":"3c971fd8-28df-42ca-877d-971f90820042","Type":"ContainerStarted","Data":"552915f64acce193933d2abdd6189a24dcb862ad2f695f3919ab74a960c396dc"}
Jul 03 11:52:05.627053 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:05.626999    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m" podStartSLOduration=4.6269840890000005 podStartE2EDuration="4.626984089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:52:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:52:02.484366414 +0000 UTC m=+2374.961637994" watchObservedRunningTime="2026-07-03 11:52:05.626984089 +0000 UTC m=+2378.104255677"
Jul 03 11:52:05.628111 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:05.628092    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:52:11.447430 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:11.447392    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:11.447430 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:11.447441    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:11.460013 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:11.459986    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:11.510208 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:11.510178    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:25.415585 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:25.415548    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:52:27.199295 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:27.199267    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:52:27.302002 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:27.301977    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:52:28.116378 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:28.116351    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:52:28.118558 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:28.118531    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qfx4_aa7f1f57-32dc-42c8-b9f7-7ddcb03965bd/ovn-acl-logging/0.log"
Jul 03 11:52:42.129738 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:42.129695    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:52:42.989053 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:42.989024    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"]
Jul 03 11:52:43.019230 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:43.019200    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:52:46.411599 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:46.411560    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:52:58.009338 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.009247    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m" podUID="3c971fd8-28df-42ca-877d-971f90820042" containerName="main" containerID="cri-o://4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b" gracePeriod=45
Jul 03 11:52:58.252064 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.252040    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:58.304467 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304381    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qvgz\" (UniqueName: \"kubernetes.io/projected/3c971fd8-28df-42ca-877d-971f90820042-kube-api-access-4qvgz\") pod \"3c971fd8-28df-42ca-877d-971f90820042\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") "
Jul 03 11:52:58.304467 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304437    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c971fd8-28df-42ca-877d-971f90820042-tls-certs\") pod \"3c971fd8-28df-42ca-877d-971f90820042\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") "
Jul 03 11:52:58.304660 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304475    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-model-cache\") pod \"3c971fd8-28df-42ca-877d-971f90820042\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") "
Jul 03 11:52:58.304660 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304492    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-dshm\") pod \"3c971fd8-28df-42ca-877d-971f90820042\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") "
Jul 03 11:52:58.304660 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304528    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-home\") pod \"3c971fd8-28df-42ca-877d-971f90820042\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") "
Jul 03 11:52:58.304660 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304544    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-tmp-dir\") pod \"3c971fd8-28df-42ca-877d-971f90820042\" (UID: \"3c971fd8-28df-42ca-877d-971f90820042\") "
Jul 03 11:52:58.304863 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304734    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-model-cache" (OuterVolumeSpecName: "model-cache") pod "3c971fd8-28df-42ca-877d-971f90820042" (UID: "3c971fd8-28df-42ca-877d-971f90820042"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:52:58.304863 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304831    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-home" (OuterVolumeSpecName: "home") pod "3c971fd8-28df-42ca-877d-971f90820042" (UID: "3c971fd8-28df-42ca-877d-971f90820042"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:52:58.304974 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.304918    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3c971fd8-28df-42ca-877d-971f90820042" (UID: "3c971fd8-28df-42ca-877d-971f90820042"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:52:58.306801 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.306780    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-dshm" (OuterVolumeSpecName: "dshm") pod "3c971fd8-28df-42ca-877d-971f90820042" (UID: "3c971fd8-28df-42ca-877d-971f90820042"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 03 11:52:58.306903 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.306839    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c971fd8-28df-42ca-877d-971f90820042-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3c971fd8-28df-42ca-877d-971f90820042" (UID: "3c971fd8-28df-42ca-877d-971f90820042"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:52:58.306953 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.306919    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c971fd8-28df-42ca-877d-971f90820042-kube-api-access-4qvgz" (OuterVolumeSpecName: "kube-api-access-4qvgz") pod "3c971fd8-28df-42ca-877d-971f90820042" (UID: "3c971fd8-28df-42ca-877d-971f90820042"). InnerVolumeSpecName "kube-api-access-4qvgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:52:58.405531 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.405488    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-model-cache\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:52:58.405531 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.405523    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-dshm\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:52:58.405531 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.405535    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-home\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:52:58.405777 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.405545    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3c971fd8-28df-42ca-877d-971f90820042-tmp-dir\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:52:58.405777 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.405558    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qvgz\" (UniqueName: \"kubernetes.io/projected/3c971fd8-28df-42ca-877d-971f90820042-kube-api-access-4qvgz\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:52:58.405777 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.405569    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c971fd8-28df-42ca-877d-971f90820042-tls-certs\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:52:58.693544 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.693505    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c971fd8-28df-42ca-877d-971f90820042" containerID="4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b" exitCode=0
Jul 03 11:52:58.693715 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.693554    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"
Jul 03 11:52:58.693715 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.693592    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m" event={"ID":"3c971fd8-28df-42ca-877d-971f90820042","Type":"ContainerDied","Data":"4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b"}
Jul 03 11:52:58.693715 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.693638    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m" event={"ID":"3c971fd8-28df-42ca-877d-971f90820042","Type":"ContainerDied","Data":"552915f64acce193933d2abdd6189a24dcb862ad2f695f3919ab74a960c396dc"}
Jul 03 11:52:58.693715 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.693656    2582 scope.go:117] "RemoveContainer" containerID="4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b"
Jul 03 11:52:58.704556 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.704501    2582 scope.go:117] "RemoveContainer" containerID="4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b"
Jul 03 11:52:58.704912 ip-10-0-141-129 kubenswrapper[2582]: E0703 11:52:58.704890    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b\": container with ID starting with 4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b not found: ID does not exist" containerID="4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b"
Jul 03 11:52:58.705025 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.704919    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b"} err="failed to get container status \"4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b\": rpc error: code = NotFound desc = could not find container \"4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b\": container with ID starting with 4fb44d38ba829379c471389ab1b8a733f812adbda2b35a45c090f2dc02a4bd3b not found: ID does not exist"
Jul 03 11:52:58.716446 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.716415    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"]
Jul 03 11:52:58.721190 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:58.721164    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f7a699/sub-test-model-f7a699-kserve-6495c9c9bc-t2p4m"]
Jul 03 11:52:59.550285 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:52:59.550252    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:53:00.100305 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:00.100272    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c971fd8-28df-42ca-877d-971f90820042" path="/var/lib/kubelet/pods/3c971fd8-28df-42ca-877d-971f90820042/volumes"
Jul 03 11:53:04.315698 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:04.315665    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:53:28.360345 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:28.360308    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:53:33.012606 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:33.012572    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:53:48.976150 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:48.976116    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:53:49.115629 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:49.115594    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:53:56.411137 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:56.411094    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:53:56.427531 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:56.427498    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:53:56.528136 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:53:56.528039    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:11.510990 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:11.510947    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:54:17.730592 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:17.730556    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:18.850051 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:18.850001    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:19.915473 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:19.915422    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:20.339190 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:20.339099    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:20.517727 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:20.517678    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:20.661833 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:20.661807    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:20.877842 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:20.877806    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"]
Jul 03 11:54:20.878038 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:20.878015    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp" podUID="78af1bed-1e82-46c2-8416-509aa77d830f" containerName="maas-api" containerID="cri-o://7df8aacdb180330bf0f2a0dd62ffce3bdfc7618d2f8563551413229b8bf97a5d" gracePeriod=30
Jul 03 11:54:20.918264 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:20.918172    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:21.040459 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.040426    2582 generic.go:356] "Generic (PLEG): container finished" podID="78af1bed-1e82-46c2-8416-509aa77d830f" containerID="7df8aacdb180330bf0f2a0dd62ffce3bdfc7618d2f8563551413229b8bf97a5d" exitCode=0
Jul 03 11:54:21.040631 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.040479    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp" event={"ID":"78af1bed-1e82-46c2-8416-509aa77d830f","Type":"ContainerDied","Data":"7df8aacdb180330bf0f2a0dd62ffce3bdfc7618d2f8563551413229b8bf97a5d"}
Jul 03 11:54:21.126286 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.126262    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:54:21.185736 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.185652    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af1bed-1e82-46c2-8416-509aa77d830f-openshift-service-ca\") pod \"78af1bed-1e82-46c2-8416-509aa77d830f\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") "
Jul 03 11:54:21.185736 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.185721    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78af1bed-1e82-46c2-8416-509aa77d830f-maas-api-tls\") pod \"78af1bed-1e82-46c2-8416-509aa77d830f\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") "
Jul 03 11:54:21.185917 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.185785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d85h9\" (UniqueName: \"kubernetes.io/projected/78af1bed-1e82-46c2-8416-509aa77d830f-kube-api-access-d85h9\") pod \"78af1bed-1e82-46c2-8416-509aa77d830f\" (UID: \"78af1bed-1e82-46c2-8416-509aa77d830f\") "
Jul 03 11:54:21.186109 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.186064    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78af1bed-1e82-46c2-8416-509aa77d830f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "78af1bed-1e82-46c2-8416-509aa77d830f" (UID: "78af1bed-1e82-46c2-8416-509aa77d830f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:54:21.187896 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.187867    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78af1bed-1e82-46c2-8416-509aa77d830f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "78af1bed-1e82-46c2-8416-509aa77d830f" (UID: "78af1bed-1e82-46c2-8416-509aa77d830f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:54:21.187974 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.187910    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78af1bed-1e82-46c2-8416-509aa77d830f-kube-api-access-d85h9" (OuterVolumeSpecName: "kube-api-access-d85h9") pod "78af1bed-1e82-46c2-8416-509aa77d830f" (UID: "78af1bed-1e82-46c2-8416-509aa77d830f"). InnerVolumeSpecName "kube-api-access-d85h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:54:21.287093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.287041    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d85h9\" (UniqueName: \"kubernetes.io/projected/78af1bed-1e82-46c2-8416-509aa77d830f-kube-api-access-d85h9\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:54:21.287093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.287091    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78af1bed-1e82-46c2-8416-509aa77d830f-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:54:21.287093 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:21.287101    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78af1bed-1e82-46c2-8416-509aa77d830f-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:54:22.045966 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:22.045936    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"
Jul 03 11:54:22.045966 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:22.045955    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp" event={"ID":"78af1bed-1e82-46c2-8416-509aa77d830f","Type":"ContainerDied","Data":"9f1af8100fe81d177ea15e658d1dbf9431c564677927b9cdbace180072cf660d"}
Jul 03 11:54:22.046504 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:22.046011    2582 scope.go:117] "RemoveContainer" containerID="7df8aacdb180330bf0f2a0dd62ffce3bdfc7618d2f8563551413229b8bf97a5d"
Jul 03 11:54:22.069676 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:22.069651    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"]
Jul 03 11:54:22.075987 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:22.075965    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-9c2097-66f56bcc98-j5vcp"]
Jul 03 11:54:22.099361 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:22.099337    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78af1bed-1e82-46c2-8416-509aa77d830f" path="/var/lib/kubelet/pods/78af1bed-1e82-46c2-8416-509aa77d830f/volumes"
Jul 03 11:54:25.249672 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:25.249634    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:25.350617 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:25.350587    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:27.486886 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:27.486847    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:27.588930 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:27.588895    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:54:29.493853 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:54:29.493820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:55:02.353222 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:02.353189    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:03.773136 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:03.773102    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:03.805027 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:03.804991    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"]
Jul 03 11:55:03.805247 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:03.805223    2582 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq" podUID="ed36638e-26e4-4faa-bfab-633cd02a652a" containerName="maas-api" containerID="cri-o://2d5645830f5a43dd19ed93834c0bfd550a0225ef6f58ec23a132cb1211f98e7f" gracePeriod=30
Jul 03 11:55:03.870567 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:03.870535    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:04.218097 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.218054    2582 generic.go:356] "Generic (PLEG): container finished" podID="ed36638e-26e4-4faa-bfab-633cd02a652a" containerID="2d5645830f5a43dd19ed93834c0bfd550a0225ef6f58ec23a132cb1211f98e7f" exitCode=0
Jul 03 11:55:04.218255 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.218113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq" event={"ID":"ed36638e-26e4-4faa-bfab-633cd02a652a","Type":"ContainerDied","Data":"2d5645830f5a43dd19ed93834c0bfd550a0225ef6f58ec23a132cb1211f98e7f"}
Jul 03 11:55:04.275488 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.275462    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:55:04.345624 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.345543    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed36638e-26e4-4faa-bfab-633cd02a652a-openshift-service-ca\") pod \"ed36638e-26e4-4faa-bfab-633cd02a652a\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") "
Jul 03 11:55:04.345624 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.345604    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls\") pod \"ed36638e-26e4-4faa-bfab-633cd02a652a\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") "
Jul 03 11:55:04.345810 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.345635    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52jvh\" (UniqueName: \"kubernetes.io/projected/ed36638e-26e4-4faa-bfab-633cd02a652a-kube-api-access-52jvh\") pod \"ed36638e-26e4-4faa-bfab-633cd02a652a\" (UID: \"ed36638e-26e4-4faa-bfab-633cd02a652a\") "
Jul 03 11:55:04.345932 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.345900    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed36638e-26e4-4faa-bfab-633cd02a652a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed36638e-26e4-4faa-bfab-633cd02a652a" (UID: "ed36638e-26e4-4faa-bfab-633cd02a652a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 03 11:55:04.347865 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.347834    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed36638e-26e4-4faa-bfab-633cd02a652a" (UID: "ed36638e-26e4-4faa-bfab-633cd02a652a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 03 11:55:04.347955 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.347864    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed36638e-26e4-4faa-bfab-633cd02a652a-kube-api-access-52jvh" (OuterVolumeSpecName: "kube-api-access-52jvh") pod "ed36638e-26e4-4faa-bfab-633cd02a652a" (UID: "ed36638e-26e4-4faa-bfab-633cd02a652a"). InnerVolumeSpecName "kube-api-access-52jvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 03 11:55:04.446754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.446718    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed36638e-26e4-4faa-bfab-633cd02a652a-openshift-service-ca\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:55:04.446754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.446747    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed36638e-26e4-4faa-bfab-633cd02a652a-maas-api-tls\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:55:04.446754 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:04.446756    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52jvh\" (UniqueName: \"kubernetes.io/projected/ed36638e-26e4-4faa-bfab-633cd02a652a-kube-api-access-52jvh\") on node \"ip-10-0-141-129.ec2.internal\" DevicePath \"\""
Jul 03 11:55:05.223401 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:05.223361    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq" event={"ID":"ed36638e-26e4-4faa-bfab-633cd02a652a","Type":"ContainerDied","Data":"03f8dc17ae3f9a974d53a9147d1aa3f0d2cb47b5659cc9ff859701a179475d32"}
Jul 03 11:55:05.223401 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:05.223385    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"
Jul 03 11:55:05.223921 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:05.223429    2582 scope.go:117] "RemoveContainer" containerID="2d5645830f5a43dd19ed93834c0bfd550a0225ef6f58ec23a132cb1211f98e7f"
Jul 03 11:55:05.249057 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:05.249015    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"]
Jul 03 11:55:05.252913 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:05.252879    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-f7a699-55786d6f9f-qdlrq"]
Jul 03 11:55:05.893632 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:05.893600    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-54dmh"]
Jul 03 11:55:06.099718 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:06.099683    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed36638e-26e4-4faa-bfab-633cd02a652a" path="/var/lib/kubelet/pods/ed36638e-26e4-4faa-bfab-633cd02a652a/volumes"
Jul 03 11:55:10.168509 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:10.168467    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:10.248970 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:10.248932    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:10.441441 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:10.441350    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:10.669983 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:10.669949    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:16.073647 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:16.073614    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717970-f87kr_1ecbce33-6033-4ad8-85a2-d2309b498119/cleanup/0.log"
Jul 03 11:55:16.181018 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:16.180988    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717985-fwttv_090562ef-3619-4a77-a5fe-e0f086ecc758/cleanup/0.log"
Jul 03 11:55:16.908971 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:16.908946    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8c56cd69-h8s9p_5f7bd01d-75af-4212-a85b-ffe9855867b9/copy-manifests/0.log"
Jul 03 11:55:16.918916 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:16.918889    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8c56cd69-h8s9p_5f7bd01d-75af-4212-a85b-ffe9855867b9/manager/0.log"
Jul 03 11:55:19.056234 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:19.056194    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-54dmh_21569902-538d-40bf-8623-bb62f9d8bf03/limitador/0.log"
Jul 03 11:55:19.656011 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:19.655966    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c4prh_be4fb84d-39e2-4385-8466-49a64dadddfa/discovery/0.log"
Jul 03 11:55:20.928438 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:20.928407    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7gjrk_9a23a2b0-0f4a-4800-b12d-5bd5b07aad0b/main/0.log"
Jul 03 11:55:25.191960 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.191918    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fgj8l/must-gather-8wdb9"]
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192234    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed36638e-26e4-4faa-bfab-633cd02a652a" containerName="maas-api"
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192247    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed36638e-26e4-4faa-bfab-633cd02a652a" containerName="maas-api"
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192256    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c971fd8-28df-42ca-877d-971f90820042" containerName="main"
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192261    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c971fd8-28df-42ca-877d-971f90820042" containerName="main"
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192276    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78af1bed-1e82-46c2-8416-509aa77d830f" containerName="maas-api"
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192283    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="78af1bed-1e82-46c2-8416-509aa77d830f" containerName="maas-api"
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192327    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed36638e-26e4-4faa-bfab-633cd02a652a" containerName="maas-api"
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192336    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="78af1bed-1e82-46c2-8416-509aa77d830f" containerName="maas-api"
Jul 03 11:55:25.192383 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.192344    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c971fd8-28df-42ca-877d-971f90820042" containerName="main"
Jul 03 11:55:25.196572 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.196555    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fgj8l/must-gather-8wdb9"
Jul 03 11:55:25.198903 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.198872    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fgj8l\"/\"kube-root-ca.crt\""
Jul 03 11:55:25.199967 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.199950    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fgj8l\"/\"openshift-service-ca.crt\""
Jul 03 11:55:25.200056 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.199953    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fgj8l\"/\"default-dockercfg-z5qdj\""
Jul 03 11:55:25.208736 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.208708    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fgj8l/must-gather-8wdb9"]
Jul 03 11:55:25.212333 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.212304    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:25.282064 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.282030    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:25.306593 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.306569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80625ae8-ecf4-4024-b0a8-c898f190ebf5-must-gather-output\") pod \"must-gather-8wdb9\" (UID: \"80625ae8-ecf4-4024-b0a8-c898f190ebf5\") " pod="openshift-must-gather-fgj8l/must-gather-8wdb9"
Jul 03 11:55:25.306747 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.306607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnzqf\" (UniqueName: \"kubernetes.io/projected/80625ae8-ecf4-4024-b0a8-c898f190ebf5-kube-api-access-rnzqf\") pod \"must-gather-8wdb9\" (UID: \"80625ae8-ecf4-4024-b0a8-c898f190ebf5\") " pod="openshift-must-gather-fgj8l/must-gather-8wdb9"
Jul 03 11:55:25.407234 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.407175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnzqf\" (UniqueName: \"kubernetes.io/projected/80625ae8-ecf4-4024-b0a8-c898f190ebf5-kube-api-access-rnzqf\") pod \"must-gather-8wdb9\" (UID: \"80625ae8-ecf4-4024-b0a8-c898f190ebf5\") " pod="openshift-must-gather-fgj8l/must-gather-8wdb9"
Jul 03 11:55:25.407440 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.407303    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80625ae8-ecf4-4024-b0a8-c898f190ebf5-must-gather-output\") pod \"must-gather-8wdb9\" (UID: \"80625ae8-ecf4-4024-b0a8-c898f190ebf5\") " pod="openshift-must-gather-fgj8l/must-gather-8wdb9"
Jul 03 11:55:25.407604 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.407586    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/80625ae8-ecf4-4024-b0a8-c898f190ebf5-must-gather-output\") pod \"must-gather-8wdb9\" (UID: \"80625ae8-ecf4-4024-b0a8-c898f190ebf5\") " pod="openshift-must-gather-fgj8l/must-gather-8wdb9"
Jul 03 11:55:25.416592 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.416563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnzqf\" (UniqueName: \"kubernetes.io/projected/80625ae8-ecf4-4024-b0a8-c898f190ebf5-kube-api-access-rnzqf\") pod \"must-gather-8wdb9\" (UID: \"80625ae8-ecf4-4024-b0a8-c898f190ebf5\") " pod="openshift-must-gather-fgj8l/must-gather-8wdb9"
Jul 03 11:55:25.505829 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.505741    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fgj8l/must-gather-8wdb9"
Jul 03 11:55:25.635851 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.635824    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fgj8l/must-gather-8wdb9"]
Jul 03 11:55:25.637536 ip-10-0-141-129 kubenswrapper[2582]: W0703 11:55:25.637501    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80625ae8_ecf4_4024_b0a8_c898f190ebf5.slice/crio-dc6120341603a3ff19d2c4b07605e28a76c46179f0b0c97fd885475535af0546 WatchSource:0}: Error finding container dc6120341603a3ff19d2c4b07605e28a76c46179f0b0c97fd885475535af0546: Status 404 returned error can't find the container with id dc6120341603a3ff19d2c4b07605e28a76c46179f0b0c97fd885475535af0546
Jul 03 11:55:25.639240 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:25.639224    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 03 11:55:26.313515 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:26.313478    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgj8l/must-gather-8wdb9" event={"ID":"80625ae8-ecf4-4024-b0a8-c898f190ebf5","Type":"ContainerStarted","Data":"dc6120341603a3ff19d2c4b07605e28a76c46179f0b0c97fd885475535af0546"}
Jul 03 11:55:26.457535 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:26.457509    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:27.320977 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:27.320938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgj8l/must-gather-8wdb9" event={"ID":"80625ae8-ecf4-4024-b0a8-c898f190ebf5","Type":"ContainerStarted","Data":"496ce21c5fbf4d56424e64f7e83697e60a411523beaa6f8940133b023a4dd324"}
Jul 03 11:55:27.321419 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:27.320991    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgj8l/must-gather-8wdb9" event={"ID":"80625ae8-ecf4-4024-b0a8-c898f190ebf5","Type":"ContainerStarted","Data":"d930f3eca5b2e5eb7ef18f89bd521405a534c1413ee1a6e862c670d7cbe2692d"}
Jul 03 11:55:27.337221 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:27.337162    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fgj8l/must-gather-8wdb9" podStartSLOduration=1.616780208 podStartE2EDuration="2.337146436s" totalImagesPullingTime="720.366228ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-03 11:55:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:55:27.337064569 +0000 UTC m=+2579.814336152" watchObservedRunningTime="2026-07-03 11:55:27.337146436 +0000 UTC m=+2579.814418018"
Jul 03 11:55:28.080840 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:28.080806    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xnf6q_e83fc8e8-4d70-4183-8d30-b0eaa07e8503/global-pull-secret-syncer/0.log"
Jul 03 11:55:28.144482 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:28.144453    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log"
Jul 03 11:55:28.264238 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:28.264211    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-129.ec2.internal_4a862d27acdd6adcd1a30a65484081bd/haproxy/0.log"
Jul 03 11:55:34.174855 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:34.174826    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-54dmh_21569902-538d-40bf-8623-bb62f9d8bf03/limitador/0.log"
Jul 03 11:55:35.054044 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:35.053996    2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2cpnn_da462a2b-e560-4bf0-820a-e35651982e4d/konnectivity-agent/0.log" limit=1024
Jul 03 11:55:36.294034 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:36.294005    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74g8z_c59d85d4-8375-4b7d-9911-b7dae78b2cc7/node-exporter/0.log"
Jul 03 11:55:36.325812 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:36.325773    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74g8z_c59d85d4-8375-4b7d-9911-b7dae78b2cc7/kube-rbac-proxy/0.log"
Jul 03 11:55:36.355784 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:36.355701    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-74g8z_c59d85d4-8375-4b7d-9911-b7dae78b2cc7/init-textfile/0.log"
Jul 03 11:55:37.080233 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.080201    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-578fc76456-8mfrm_e258051b-f1db-4e54-bd78-28b33ff26636/thanos-query/0.log"
Jul 03 11:55:37.109311 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.109280    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-578fc76456-8mfrm_e258051b-f1db-4e54-bd78-28b33ff26636/kube-rbac-proxy-web/0.log"
Jul 03 11:55:37.137156 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.137122    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-578fc76456-8mfrm_e258051b-f1db-4e54-bd78-28b33ff26636/kube-rbac-proxy/0.log"
Jul 03 11:55:37.162823 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.162791    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-578fc76456-8mfrm_e258051b-f1db-4e54-bd78-28b33ff26636/prom-label-proxy/0.log"
Jul 03 11:55:37.189184 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.189155    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-578fc76456-8mfrm_e258051b-f1db-4e54-bd78-28b33ff26636/kube-rbac-proxy-rules/0.log"
Jul 03 11:55:37.226536 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.226504    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-578fc76456-8mfrm_e258051b-f1db-4e54-bd78-28b33ff26636/kube-rbac-proxy-metrics/0.log"
Jul 03 11:55:37.588727 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.588684    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"]
Jul 03 11:55:37.593722 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.593700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.602667 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.602636    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"]
Jul 03 11:55:37.719693 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.719647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-sys\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.719899 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.719768    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-proc\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.719899 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.719799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-lib-modules\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.719899 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.719834    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-podres\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.719899 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.719860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d6b5\" (UniqueName: \"kubernetes.io/projected/9ea3e516-1339-4098-9394-efbd8764f637-kube-api-access-4d6b5\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.821309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.820984    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-proc\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.821309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.821031    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-lib-modules\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.821309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.821063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-podres\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.821309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.821105    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d6b5\" (UniqueName: \"kubernetes.io/projected/9ea3e516-1339-4098-9394-efbd8764f637-kube-api-access-4d6b5\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.821309 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.821166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-sys\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.824039 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.823966    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-proc\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.824039 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.823984    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-sys\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.824265 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.824048    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-podres\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.830781 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.830753    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ea3e516-1339-4098-9394-efbd8764f637-lib-modules\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.835910 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.835879    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d6b5\" (UniqueName: \"kubernetes.io/projected/9ea3e516-1339-4098-9394-efbd8764f637-kube-api-access-4d6b5\") pod \"perf-node-gather-daemonset-ldchc\" (UID: \"9ea3e516-1339-4098-9394-efbd8764f637\") " pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:37.924615 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:37.924573    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:38.110421 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:38.110342    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"]
Jul 03 11:55:38.393301 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:38.393214    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc" event={"ID":"9ea3e516-1339-4098-9394-efbd8764f637","Type":"ContainerStarted","Data":"eb4eabaddda643a18c22e43460ad0f396ba2fe75d9ff2584226d502ca9414744"}
Jul 03 11:55:38.393301 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:38.393277    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc" event={"ID":"9ea3e516-1339-4098-9394-efbd8764f637","Type":"ContainerStarted","Data":"507ea1a88389ba7f0c66c2ab502d235ed3f4c92819f88f84670f5018081bc88f"}
Jul 03 11:55:38.393479 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:38.393371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:38.413061 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:38.413000    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc" podStartSLOduration=1.412977549 podStartE2EDuration="1.412977549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-03 11:55:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-03 11:55:38.411155514 +0000 UTC m=+2590.888427113" watchObservedRunningTime="2026-07-03 11:55:38.412977549 +0000 UTC m=+2590.890249134"
Jul 03 11:55:41.257264 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:41.257238    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7jgwx_35a03107-6c93-4e42-8f11-5a2cb6889e31/dns/0.log"
Jul 03 11:55:41.289274 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:41.289228    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7jgwx_35a03107-6c93-4e42-8f11-5a2cb6889e31/kube-rbac-proxy/0.log"
Jul 03 11:55:41.485851 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:41.485810    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9kk7g_47131d70-f689-4280-87eb-86dd8236e628/dns-node-resolver/0.log"
Jul 03 11:55:42.171198 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:42.171169    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sfpc6_1fbc07b6-c4eb-4376-b0e8-39ab43b33689/node-ca/0.log"
Jul 03 11:55:43.327246 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:43.327207    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c4prh_be4fb84d-39e2-4385-8466-49a64dadddfa/discovery/0.log"
Jul 03 11:55:44.346777 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:44.346743    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-shr2q_46eb8232-a854-4f61-8313-2663b706525b/serve-healthcheck-canary/0.log"
Jul 03 11:55:44.411530 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:44.411495    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fgj8l/perf-node-gather-daemonset-ldchc"
Jul 03 11:55:45.041111 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:45.041060    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xghh2_d0076409-fb41-4787-b096-31ca8a6516ae/kube-rbac-proxy/0.log"
Jul 03 11:55:45.071386 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:45.071356    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xghh2_d0076409-fb41-4787-b096-31ca8a6516ae/exporter/0.log"
Jul 03 11:55:45.099066 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:45.099010    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xghh2_d0076409-fb41-4787-b096-31ca8a6516ae/extractor/0.log"
Jul 03 11:55:47.750335 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:47.750256    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717970-f87kr_1ecbce33-6033-4ad8-85a2-d2309b498119/cleanup/0.log"
Jul 03 11:55:47.785315 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:47.785286    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717985-fwttv_090562ef-3619-4a77-a5fe-e0f086ecc758/cleanup/0.log"
Jul 03 11:55:48.204964 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:48.204928    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8c56cd69-h8s9p_5f7bd01d-75af-4212-a85b-ffe9855867b9/manager/0.log"
Jul 03 11:55:48.230665 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:48.230628    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b8c56cd69-h8s9p_5f7bd01d-75af-4212-a85b-ffe9855867b9/copy-manifests/0.log"
Jul 03 11:55:48.512145 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:48.512013    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c4prh_be4fb84d-39e2-4385-8466-49a64dadddfa/discovery/0.log"
Jul 03 11:55:49.742161 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:49.742132    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f9f46b759-skd6k_6079c357-7d47-431e-ae35-2f3cf866cc32/manager/0.log"
Jul 03 11:55:50.045993 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:50.045957    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-c4prh_be4fb84d-39e2-4385-8466-49a64dadddfa/discovery/0.log"
Jul 03 11:55:54.817094 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:54.817052    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-9llmg_ab656b74-f87b-464f-a58d-437a39510257/migrator/0.log"
Jul 03 11:55:54.841450 ip-10-0-141-129 kubenswrapper[2582]: I0703 11:55:54.841426    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-9llmg_ab656b74-f87b-464f-a58d-437a39510257/graceful-termination/0.log"