Jul 15 12:21:46.719106 ip-10-0-138-184 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 12:21:46.719117 ip-10-0-138-184 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 12:21:46.719126 ip-10-0-138-184 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 12:21:46.719430 ip-10-0-138-184 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 12:21:56.745267 ip-10-0-138-184 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 12:21:56.745284 ip-10-0-138-184 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6c537fe5770a46f4925b9f2447b472d8 --
Jul 15 12:23:35.166884 ip-10-0-138-184 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.621902    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626930    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626943    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626946    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626950    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626953    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626956    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626959    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:23:35.645217 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626963    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626967    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626970    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626973    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626976    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626978    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626981    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626984    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626986    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626989    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626992    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626994    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.626997    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627006    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627009    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627011    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627014    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627016    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627021    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627023    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:23:35.660155 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627028    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627031    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627034    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627036    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627039    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627042    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627045    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627047    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627053    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627057    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627060    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627063    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627066    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627068    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627071    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627074    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627077    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627080    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627083    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:23:35.675421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627086    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627089    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627091    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627094    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627096    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627100    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627103    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627105    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627108    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627112    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627114    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627117    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627119    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627122    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627125    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627128    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627130    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627133    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627135    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627141    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:23:35.676865 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627144    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627147    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627149    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627152    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627155    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627158    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627162    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627164    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627167    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627170    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627173    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627178    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627181    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627184    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627187    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627189    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627192    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627195    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627198    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:23:35.694584 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627201    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627203    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627206    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627208    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627211    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627214    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627216    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627219    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627221    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627224    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627226    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627229    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627233    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627236    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627949    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627955    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627958    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627961    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627964    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627967    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:23:35.697662 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627971    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627974    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627977    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627980    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627983    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627985    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627988    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627991    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627993    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627996    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.627998    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628001    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628005    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628009    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628012    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628015    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628019    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628022    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628026    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:23:35.712276 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628029    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:23:35.709450 ip-10-0-138-184 systemd[1]: Started Kubernetes Kubelet.
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628031    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628033    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628036    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628039    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628044    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628047    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628049    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628052    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628054    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628057    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628060    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628062    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628065    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628068    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628072    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628074    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628077    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628079    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628081    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:23:35.912324 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628084    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628086    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628089    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628092    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628095    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628098    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628100    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628103    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628105    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628107    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628110    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628112    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628115    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628117    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628120    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628122    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628125    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628129    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628131    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628134    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:23:35.928672 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628136    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628139    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628142    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628145    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628148    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628151    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628154    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628157    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628159    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628162    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628164    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628167    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628169    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628172    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628174    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628179    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628182    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628185    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628187    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628190    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:23:35.934418 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628192    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628195    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628197    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628200    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628202    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628204    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628207    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628210    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628212    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628216    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628218    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628221    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628224    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.628226    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630375    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630383    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630386    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630390    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630393    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630396    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:23:35.935124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630399    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630401    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630404    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630407    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630409    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630412    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630416    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630420    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630423    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630426    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630429    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630431    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630438    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630441    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630445    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630448    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630451    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630454    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630457    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:23:35.935728 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630459    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630462    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630466    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630469    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630472    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630474    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630477    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630480    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630482    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630486    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630488    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630491    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630494    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630496    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630499    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630501    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630504    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630506    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630509    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630511    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:23:35.936321 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630514    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630516    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630519    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630521    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630524    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630528    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630530    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630533    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630535    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630538    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630540    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630543    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630545    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630548    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630552    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630554    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630557    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630559    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630562    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:23:35.936917 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630566    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630569    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630572    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630575    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630577    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630580    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630614    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630617    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630620    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630623    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630625    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630628    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630630    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630634    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630637    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630639    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630642    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630644    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630648    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630651    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:23:35.937496 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630654    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630656    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630659    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630661    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630664    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630667    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630669    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630673    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630676    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630678    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630681    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630683    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630686    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630688    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.630691    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630771    2563 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630781    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630789    2563 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630796    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630802    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630807    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 12:23:35.938113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630814    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630818    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630822    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630825    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630828    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630831    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630834    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630837    2563 flags.go:64] FLAG: --cgroup-root=""
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630840    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630845    2563 flags.go:64] FLAG: --client-ca-file=""
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630848    2563 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630851    2563 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630856    2563 flags.go:64] FLAG: --cluster-domain=""
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630859    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630862    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630865    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630869    2563 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630873    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630877    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630880    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630883    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630887    2563 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630889    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630892    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 12:23:35.938844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630895    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630898    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630902    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630905    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630908    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630911    2563 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630914    2563 flags.go:64] FLAG: --enable-server="true"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630918    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630922    2563 flags.go:64] FLAG: --event-burst="100"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630925    2563 flags.go:64] FLAG: --event-qps="50"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630928    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630931    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630934    2563 flags.go:64] FLAG: --eviction-hard=""
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630938    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630940    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630943    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630946    2563 flags.go:64] FLAG: --eviction-soft=""
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630951    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630954    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630956    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630959    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630963    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630965    2563 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630968    2563 flags.go:64] FLAG: --feature-gates=""
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630972    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 12:23:35.939626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630976    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630981    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630984    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630988    2563 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630991    2563 flags.go:64] FLAG: --help="false"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630994    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-138-184.ec2.internal"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.630997    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631000    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631003    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631006    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631010    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631012    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631015    2563 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631018    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631021    2563 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631024    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631027    2563 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631030    2563 flags.go:64] FLAG: --kube-reserved=""
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631033    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631036    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631039    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631041    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631044    2563 flags.go:64] FLAG: --lock-file=""
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631047    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 12:23:35.940409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631051    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631054    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631059    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631062    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631065    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631068    2563 flags.go:64] FLAG: --logging-format="text"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631070    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631074    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631076    2563 flags.go:64] FLAG: --manifest-url=""
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631080    2563 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631085    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631088    2563 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631092    2563 flags.go:64] FLAG: --max-pods="110"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631095    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631099    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631101    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631104    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631107    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631110    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631113    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631120    2563 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631123    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631126    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 12:23:35.941123 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631129    2563 flags.go:64] FLAG: --pod-cidr=""
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631132    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631138    2563 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631141    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631144    2563 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631147    2563 flags.go:64] FLAG: --port="10250"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631150    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631153    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c1ff4820136b0dcc"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631156    2563 flags.go:64] FLAG: --qos-reserved=""
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631160    2563 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631163    2563 flags.go:64] FLAG: --register-node="true"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631166    2563 flags.go:64] FLAG: --register-with-taints=""
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631169    2563 flags.go:64] FLAG: --registry-burst="10"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631172    2563 flags.go:64] FLAG: --registry-qps="5"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631175    2563 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631178    2563 flags.go:64] FLAG: --reserved-memory=""
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631181    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631185    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631187    2563 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631191    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631194    2563 flags.go:64] FLAG: --runonce="false"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631197    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631200    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631203    2563 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631206    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 12:23:35.941796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631208    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631212    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631215    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631218    2563 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631220    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631223    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631226    2563 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631229    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631232    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631235    2563 flags.go:64] FLAG: --system-cgroups=""
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631238    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631243    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631246    2563 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631249    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631253    2563 flags.go:64] FLAG: --tls-min-version=""
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631256    2563 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631260    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631263    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631265    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631268    2563 flags.go:64] FLAG: --v="2"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631272    2563 flags.go:64] FLAG: --version="false"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631276    2563 flags.go:64] FLAG: --vmodule=""
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631279    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.631283    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631399    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:23:35.942464 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631403    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631408    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631411    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631415    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631419    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631422    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631424    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631427    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631431    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631434    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631437    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631440    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631443    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631446    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631448    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631451    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631453    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631456    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631459    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:23:35.943188 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631461    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631464    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631466    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631469    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631473    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631475    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631478    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631480    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631483    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631485    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631488    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631490    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631493    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631495    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631499    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631502    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631504    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631507    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631511    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:23:35.943721 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631514    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631517    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631520    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631523    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631525    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631528    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631531    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631533    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631536    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631538    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631541    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631543    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631546    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631548    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631551    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631553    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631556    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631559    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631562    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631565    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:23:36.258182 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631567    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631570    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631572    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631575    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631577    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631580    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631582    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631599    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631602    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631604    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631607    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631610    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631613    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631616    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631618    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631621    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631623    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631626    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631629    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631631    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:23:36.259024 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631634    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631636    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631639    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631641    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631644    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631647    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631649    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631652    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631655    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631659    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631661    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631664    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631666    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631669    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631671    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631674    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631676    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631679    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631681    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:23:36.259802 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.631687    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.632418    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.639375    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.639390    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.640254    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.640261    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640315    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640320    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640325    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640329    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640332    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640335    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640337    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640340    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:23:36.260355 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640343    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640345    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640348    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640351    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640353    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640356    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640359    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640362    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640364    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640367    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640370    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640373    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640376    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640378    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640381    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640384    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640386    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640389    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640393    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:23:36.260822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640397    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640400    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640404    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640407    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640410    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640416    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640419    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640422    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640425    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640428    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640431    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640433    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640436    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640439    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640441    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640444    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640447    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640449    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640452    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640455    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:23:36.261647 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640457    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640460    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640463    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640465    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640468    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640471    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640473    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640477    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640481    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640484    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640487    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640490    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640492    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640495    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640498    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640502    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640504    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640508    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640511    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640513    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:23:36.262219 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640516    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640519    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640523    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640526    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640528    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640531    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640533    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640536    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640539    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640541    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640544    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640546    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640549    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640551    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640554    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640556    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640559    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640563    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640566    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640569    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:23:36.548424 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640571    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640574    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640576    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640579    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640582    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640584    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640605    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640608    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640612    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640617    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640620    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640622    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.640628    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640741    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:23:36.549745 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640746    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640751    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640754    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640757    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640760    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640763    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640766    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640770    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640773    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640777    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640780    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640783    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640786    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640788    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640791    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640794    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640796    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640799    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640802    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640804    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:23:36.550166 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640806    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640809    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640812    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640814    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640817    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640819    2563 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640822    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640826    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640828    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640831    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640834    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640836    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640839    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640843    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640846    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640848    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640851    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640853    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640856    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640859    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:23:36.550757 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640861    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640864    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640866    2563 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640869    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640871    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640874    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640877    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640879    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640882    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640884    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640887    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640889    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640893    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640896    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640899    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640902    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640905    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640907    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640910    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:23:36.551290 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640915    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640919    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640923    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640925    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640928    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640930    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640934    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640937    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640939    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640942    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640944    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640947    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640949    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640952    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640954    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640957    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640959    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640962    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640964    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640968    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:23:36.551844 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640970    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640972    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640975    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640977    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640980    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640982    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640985    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640987    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640990    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640992    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640995    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.640997    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.641001    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.641004    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.641007    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.641010    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.641012    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.641014    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:23:36.552372 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:35.641018    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.641023    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.641171    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.644931    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.647128    2563 server.go:1019] "Starting client certificate rotation"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.647229    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.647264    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.649904    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.656336    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.670250    2563 log.go:25] "Validated CRI v1 runtime API"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.675302    2563 log.go:25] "Validated CRI v1 image API"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.676348    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 12:23:36.552902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.680115    2563 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8b9e111c-e083-4e3d-842f-71dd8a3821ed:/dev/nvme0n1p4 a1ffc505-c2e9-4101-8782-94643bcde836:/dev/nvme0n1p3]
Jul 15 12:23:36.553242 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.680135    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 12:23:36.553242 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.683034    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.687490    2563 manager.go:216] Machine: {Timestamp:2026-07-15 12:23:35.685117684 +0000 UTC m=+0.377752592 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096887 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21cb2f796b77cdd1f5c897b7ac58fa SystemUUID:ec21cb2f-796b-77cd-d1f5-c897b7ac58fa BootID:6c537fe5-770a-46f4-925b-9f2447b472d8 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d1:96:8e:f0:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d1:96:8e:f0:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:f6:84:34:80:18 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.687597    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.687674    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.691055    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.691078    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-184.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.691902    2563 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.691912    2563 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.691920    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.691933    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.693256    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.697458    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.697582    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.697618    2563 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.697629    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.697654    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.697664    2563 kubelet.go:398] "Adding apiserver pod source"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.697673    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 12:23:36.553411 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.698000    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.698014    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.701983    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.703790    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.703818    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704610    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704631    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704637    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704643    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704651    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704657    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704665    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704671    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704679    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704685    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704693    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.704699    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.705529    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.705539    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.708613    2563 server.go:1268] "Started kubelet"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.708729    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.708848    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.709648    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.709887    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.709987    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-184.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.710095    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.710472    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.711093    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5hw9b"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.711730    2563 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.716266    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.716651    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.716669    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.716798    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717475    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717490    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717475    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717690    2563 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717701    2563 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717740    2563 factory.go:55] Registering systemd factory
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717755    2563 factory.go:223] Registration of the systemd container factory successfully
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717958    2563 factory.go:153] Registering CRI-O factory
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.717970    2563 factory.go:223] Registration of the crio container factory successfully
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.718008    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.718026    2563 factory.go:103] Registering Raw factory
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.718039    2563 manager.go:1196] Started watching for new ooms in manager
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.718382    2563 manager.go:349] Starting recovery of all containers
Jul 15 12:23:36.553999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.720170    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5hw9b"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.724541    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-184.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.724684    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.724411    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-184.ec2.internal.18c27610849d08cc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-184.ec2.internal,UID:ip-10-0-138-184.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-184.ec2.internal,},FirstTimestamp:2026-07-15 12:23:35.708575948 +0000 UTC m=+0.401210856,LastTimestamp:2026-07-15 12:23:35.708575948 +0000 UTC m=+0.401210856,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-184.ec2.internal,}"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.730610    2563 manager.go:354] Recovery completed
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.734628    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.736273    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.736302    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.736312    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.736847    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.736856    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.736870    2563 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.736918    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.737643    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.737667    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.737677    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.738016    2563 policy_none.go:49] "None policy: Start"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.738028    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.738039    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.739025    2563 policy_none.go:47] "Start"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.779211    2563 manager.go:337] "Starting Device Plugin manager"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.779240    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.779249    2563 server.go:87] "Starting device plugin registration server"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.779539    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.779551    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.779689    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.779768    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.779777    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.780208    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.780253    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.868200    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.869422    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.869466    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.869491    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.869530    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.872681    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.879984    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.880805    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.880830    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.880840    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:23:36.555321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.880862    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.890557    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.890574    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-184.ec2.internal\": node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.908260    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.970173    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal"]
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.970260    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.971162    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.971190    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.971203    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.972398    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.972509    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.972538    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.973050    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.973059    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.973071    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.973079    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.973090    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.973081    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.974394    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.974417    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.974974    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.974993    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:35.975003    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.991190    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-184.ec2.internal\" not found" node="ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:35.992389    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-184.ec2.internal\" not found" node="ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:36.008393    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.018664    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bc6f484d7291ccb2f134583fa25f23a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-184.ec2.internal\" (UID: \"3bc6f484d7291ccb2f134583fa25f23a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.018684    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71c521afa895adfa79ccf68feb05a0f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal\" (UID: \"71c521afa895adfa79ccf68feb05a0f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.018701    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71c521afa895adfa79ccf68feb05a0f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal\" (UID: \"71c521afa895adfa79ccf68feb05a0f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:36.108821    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.556486 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.119149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71c521afa895adfa79ccf68feb05a0f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal\" (UID: \"71c521afa895adfa79ccf68feb05a0f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.119187    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bc6f484d7291ccb2f134583fa25f23a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-184.ec2.internal\" (UID: \"3bc6f484d7291ccb2f134583fa25f23a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.119206    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71c521afa895adfa79ccf68feb05a0f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal\" (UID: \"71c521afa895adfa79ccf68feb05a0f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.119233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71c521afa895adfa79ccf68feb05a0f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal\" (UID: \"71c521afa895adfa79ccf68feb05a0f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.119245    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3bc6f484d7291ccb2f134583fa25f23a-config\") pod \"kube-apiserver-proxy-ip-10-0-138-184.ec2.internal\" (UID: \"3bc6f484d7291ccb2f134583fa25f23a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.119236    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71c521afa895adfa79ccf68feb05a0f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal\" (UID: \"71c521afa895adfa79ccf68feb05a0f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:36.209806    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.296355    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.296369    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:36.310776    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:36.411239    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:36.557468 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:36.511784    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:37.957514 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:36.612267    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:37.957514 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.645814    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 12:23:37.957514 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:36.645976    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 12:23:37.957514 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:37.857129    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-184.ec2.internal\" not found"
Jul 15 12:23:37.957514 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.869673    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 12:18:36 +0000 UTC" deadline="2028-03-18 02:45:18.386923645 +0000 UTC"
Jul 15 12:23:37.957514 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.869741    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14678h21m40.517205945s"
Jul 15 12:23:37.957514 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.871848    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:23:37.957514 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.910984    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.961455    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:37.976963    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c521afa895adfa79ccf68feb05a0f3.slice/crio-0af8abef4cc7fcf24581168af0dc2b4ad8ecde1b016d447ab9c4e40d6a812915 WatchSource:0}: Error finding container 0af8abef4cc7fcf24581168af0dc2b4ad8ecde1b016d447ab9c4e40d6a812915: Status 404 returned error can't find the container with id 0af8abef4cc7fcf24581168af0dc2b4ad8ecde1b016d447ab9c4e40d6a812915
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:37.977239    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc6f484d7291ccb2f134583fa25f23a.slice/crio-6d508ca384087172523c253e7842277b92587f0290ece1037fabf8fc43391820 WatchSource:0}: Error finding container 6d508ca384087172523c253e7842277b92587f0290ece1037fabf8fc43391820: Status 404 returned error can't find the container with id 6d508ca384087172523c253e7842277b92587f0290ece1037fabf8fc43391820
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.977304    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.978160    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal"
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.981540    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:37.986893    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.017123    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal" event={"ID":"3bc6f484d7291ccb2f134583fa25f23a","Type":"ContainerStarted","Data":"6d508ca384087172523c253e7842277b92587f0290ece1037fabf8fc43391820"}
Jul 15 12:23:38.240124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.018051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal" event={"ID":"71c521afa895adfa79ccf68feb05a0f3","Type":"ContainerStarted","Data":"0af8abef4cc7fcf24581168af0dc2b4ad8ecde1b016d447ab9c4e40d6a812915"}
Jul 15 12:23:38.489201 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.475249    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.843027    2563 apiserver.go:52] "Watching apiserver"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.854464    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.854854    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l","openshift-image-registry/node-ca-vs9wc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal","openshift-multus/multus-additional-cni-plugins-2m5sg","openshift-multus/network-metrics-daemon-rf9sm","openshift-ovn-kubernetes/ovnkube-node-g7dvp","kube-system/global-pull-secret-syncer-6lbpz","openshift-cluster-node-tuning-operator/tuned-9sdjs","openshift-dns/node-resolver-ffwwg","openshift-multus/multus-45dq2","openshift-network-diagnostics/network-check-target-rb2j5","openshift-network-operator/iptables-alerter-29lgv","kube-system/konnectivity-agent-54dfv","kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal"]
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.856696    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.858235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.859538    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.860616    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.860880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.860910    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-knk7r\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:38.860961    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.861086    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.861925    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.862430    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.862444    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.863959    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:38.864021    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.865399    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.866547    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.866842    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.866846    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.866861    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.866865    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-q8cjk\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.866910    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.867186    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.867194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.867320    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868004    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868028    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868151    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868311    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868364    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 12:23:38.870313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868429    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 12:23:38.871635 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868463    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-m6j6l\""
Jul 15 12:23:38.871635 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868530    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8f6cc\""
Jul 15 12:23:38.871635 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868569    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 12:23:38.871635 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.868909    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-45dq2"
Jul 15 12:23:38.871635 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.870204    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 12:23:38.871635 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.870673    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vchks\""
Jul 15 12:23:38.871635 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.870829    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:23:38.873113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.872755    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 12:23:38.873113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.872880    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:38.873113 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:38.872972    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:38.873756 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.873338    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 12:23:38.874406 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.874171    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-pgv42\""
Jul 15 12:23:38.874406 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.874313    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:38.875769 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.874918    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 12:23:38.875769 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.875325    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.877634    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-ssjzw\""
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.877665    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.878382    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.878420    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.878785    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.879028    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.879077    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z4tt6\""
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.879154    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bbq2d\""
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.886165    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.901952    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.901985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-serviceca\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902006    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-os-release\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902039    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-systemd\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902053    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-etc-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902067    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-host\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902082    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902101    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902118    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902138    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-systemd-units\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.945313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-env-overrides\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brhbs\" (UniqueName: \"kubernetes.io/projected/fb454696-c296-4b29-93f6-6f4fb01e9b49-kube-api-access-brhbs\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902287    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902314    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-system-cni-dir\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-run-netns\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902371    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-var-lib-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902394    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-ovn\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902449    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-node-log\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-log-socket\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-socket-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902526    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-device-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvhpj\" (UniqueName: \"kubernetes.io/projected/f0dc592e-48df-4b09-833b-a67f2aba01df-kube-api-access-jvhpj\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-kubelet\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902592    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-slash\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.947223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovnkube-config\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gnns\" (UniqueName: \"kubernetes.io/projected/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-kube-api-access-7gnns\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl45h\" (UniqueName: \"kubernetes.io/projected/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-kube-api-access-zl45h\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-cni-bin\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902783    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-registration-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902805    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-sys-fs\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902872    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-cni-netd\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovnkube-script-lib\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902924    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cnibin\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902948    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovn-node-metrics-cert\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.902972    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m9j9\" (UniqueName: \"kubernetes.io/projected/7334ff04-8513-4f0f-bf18-563e82fd9b4e-kube-api-access-6m9j9\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.908341    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mxmhp"
Jul 15 12:23:38.948309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.924382    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mxmhp"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:38.962898    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.003867    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-registration-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.003907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-sys-fs\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.003936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-cni-netd\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.003962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cace9f68-833a-4129-ab4e-ba5f8fba5f14-tmp\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.003991    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/874942df-dcc0-4613-bdb1-b21b5c23ed48-hosts-file\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004015    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovn-node-metrics-cert\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004037    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysctl-d\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-etc-kubernetes\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004120    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-registration-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-sys-fs\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004171    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-cni-netd\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb2429fe-8255-40e5-bf70-4e007c4858b6-cni-binary-copy\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004334    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-serviceca\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004350    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.043162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004386    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004411    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-systemd\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b46x8\" (UniqueName: \"kubernetes.io/projected/cace9f68-833a-4129-ab4e-ba5f8fba5f14-kube-api-access-b46x8\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004464    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd5cd303-19ae-4714-99cd-cc9c52d28904-kubelet-config\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004490    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004477    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-env-overrides\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brhbs\" (UniqueName: \"kubernetes.io/projected/fb454696-c296-4b29-93f6-6f4fb01e9b49-kube-api-access-brhbs\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-socket-dir-parent\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004587    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-cni-bin\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.004623    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovnkube-script-lib\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/017343cd-b0fe-489b-b66e-26f8fec3806d-konnectivity-ca\") pod \"konnectivity-agent-54dfv\" (UID: \"017343cd-b0fe-489b-b66e-26f8fec3806d\") " pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.004698    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs podName:f0dc592e-48df-4b09-833b-a67f2aba01df nodeName:}" failed. No retries permitted until 2026-07-15 12:23:39.504669831 +0000 UTC m=+3.053170093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs") pod "network-metrics-daemon-rf9sm" (UID: "f0dc592e-48df-4b09-833b-a67f2aba01df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004822    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-serviceca\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004918    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.044345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.004937    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005087    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-etc-selinux\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005145    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-env-overrides\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovnkube-script-lib\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005540    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-var-lib-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-node-log\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005596    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-log-socket\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysctl-conf\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-socket-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005666    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvhpj\" (UniqueName: \"kubernetes.io/projected/f0dc592e-48df-4b09-833b-a67f2aba01df-kube-api-access-jvhpj\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-kubelet\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005715    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-lib-modules\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005750    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-tuned\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-cnibin\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005797    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-netns\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005817    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-cni-multus\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005840    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gnns\" (UniqueName: \"kubernetes.io/projected/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-kube-api-access-7gnns\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.045197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-cni-bin\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-run\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005904    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-sys\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005923    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-host\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-hostroot\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.005998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-iptables-alerter-script\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-var-lib-kubelet\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-var-lib-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-node-log\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006038    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-k8s-cni-cncf-io\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-socket-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006249    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-cni-bin\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006293    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006331    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-log-socket\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-multus-certs\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cnibin\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.045985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006444    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-daemon-config\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m9j9\" (UniqueName: \"kubernetes.io/projected/7334ff04-8513-4f0f-bf18-563e82fd9b4e-kube-api-access-6m9j9\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006495    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/017343cd-b0fe-489b-b66e-26f8fec3806d-agent-certs\") pod \"konnectivity-agent-54dfv\" (UID: \"017343cd-b0fe-489b-b66e-26f8fec3806d\") " pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006539    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-system-cni-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006557    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd5cd303-19ae-4714-99cd-cc9c52d28904-dbus\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006567    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-kubelet\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006581    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-modprobe-d\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006623    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cnibin\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysconfig\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006689    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-kubernetes\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-os-release\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-systemd\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006796    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-etc-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxvbb\" (UniqueName: \"kubernetes.io/projected/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-kube-api-access-wxvbb\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006870    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-host\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006896    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.047020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006921    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-systemd-units\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006974    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.006998    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874942df-dcc0-4613-bdb1-b21b5c23ed48-tmp-dir\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007071    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js6n9\" (UniqueName: \"kubernetes.io/projected/874942df-dcc0-4613-bdb1-b21b5c23ed48-kube-api-access-js6n9\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007098    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-system-cni-dir\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007122    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-systemd\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007122    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-run-netns\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007164    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-run-netns\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-ovn\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-host\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007205    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-cni-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-os-release\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007256    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-kubelet\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007308    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-etc-openvswitch\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007328    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.047586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007345    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpbf7\" (UniqueName: \"kubernetes.io/projected/fb2429fe-8255-40e5-bf70-4e007c4858b6-kube-api-access-xpbf7\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007355    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-os-release\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007386    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-device-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7334ff04-8513-4f0f-bf18-563e82fd9b4e-system-cni-dir\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007386    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-systemd-units\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-run-ovn\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007450    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-slash\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-device-dir\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-slash\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovnkube-config\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007569    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb454696-c296-4b29-93f6-6f4fb01e9b49-host-run-ovn-kubernetes\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007607    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-conf-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007681    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl45h\" (UniqueName: \"kubernetes.io/projected/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-kube-api-access-zl45h\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007734    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-host-slash\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.007775    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.048420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.008210    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7334ff04-8513-4f0f-bf18-563e82fd9b4e-cni-binary-copy\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.049344 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.008692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovnkube-config\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.049344 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.008861    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb454696-c296-4b29-93f6-6f4fb01e9b49-ovn-node-metrics-cert\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.049344 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.021451    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brhbs\" (UniqueName: \"kubernetes.io/projected/fb454696-c296-4b29-93f6-6f4fb01e9b49-kube-api-access-brhbs\") pod \"ovnkube-node-g7dvp\" (UID: \"fb454696-c296-4b29-93f6-6f4fb01e9b49\") " pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.049344 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.026265    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m9j9\" (UniqueName: \"kubernetes.io/projected/7334ff04-8513-4f0f-bf18-563e82fd9b4e-kube-api-access-6m9j9\") pod \"multus-additional-cni-plugins-2m5sg\" (UID: \"7334ff04-8513-4f0f-bf18-563e82fd9b4e\") " pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.049344 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.029216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl45h\" (UniqueName: \"kubernetes.io/projected/d91864b8-a5c8-4296-9c56-1fe1ef8333a4-kube-api-access-zl45h\") pod \"node-ca-vs9wc\" (UID: \"d91864b8-a5c8-4296-9c56-1fe1ef8333a4\") " pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:39.049344 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.030230    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvhpj\" (UniqueName: \"kubernetes.io/projected/f0dc592e-48df-4b09-833b-a67f2aba01df-kube-api-access-jvhpj\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.053435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gnns\" (UniqueName: \"kubernetes.io/projected/d95bd0e0-97e1-4833-a2df-2c1d6162f5e4-kube-api-access-7gnns\") pod \"aws-ebs-csi-driver-node-qzh2l\" (UID: \"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/017343cd-b0fe-489b-b66e-26f8fec3806d-agent-certs\") pod \"konnectivity-agent-54dfv\" (UID: \"017343cd-b0fe-489b-b66e-26f8fec3806d\") " pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108268    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108405    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-system-cni-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd5cd303-19ae-4714-99cd-cc9c52d28904-dbus\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108455    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-modprobe-d\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108477    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysconfig\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108499    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-kubernetes\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxvbb\" (UniqueName: \"kubernetes.io/projected/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-kube-api-access-wxvbb\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874942df-dcc0-4613-bdb1-b21b5c23ed48-tmp-dir\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js6n9\" (UniqueName: \"kubernetes.io/projected/874942df-dcc0-4613-bdb1-b21b5c23ed48-kube-api-access-js6n9\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-system-cni-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108623    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-cni-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.108647    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-os-release\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108655    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cd5cd303-19ae-4714-99cd-cc9c52d28904-dbus\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.119303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108676    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-kubelet\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.108706    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret podName:cd5cd303-19ae-4714-99cd-cc9c52d28904 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:39.608687068 +0000 UTC m=+3.157187336 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret") pod "global-pull-secret-syncer-6lbpz" (UID: "cd5cd303-19ae-4714-99cd-cc9c52d28904") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108740    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpbf7\" (UniqueName: \"kubernetes.io/projected/fb2429fe-8255-40e5-bf70-4e007c4858b6-kube-api-access-xpbf7\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108763    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-os-release\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108771    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-conf-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108778    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-modprobe-d\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108807    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-host-slash\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-kubernetes\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cace9f68-833a-4129-ab4e-ba5f8fba5f14-tmp\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysconfig\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-host-slash\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-kubelet\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108869    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/874942df-dcc0-4613-bdb1-b21b5c23ed48-hosts-file\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108910    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/874942df-dcc0-4613-bdb1-b21b5c23ed48-hosts-file\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108929    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-conf-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.108808    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-cni-dir\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109051    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysctl-d\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.120365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-etc-kubernetes\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109102    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb2429fe-8255-40e5-bf70-4e007c4858b6-cni-binary-copy\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109152    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-systemd\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109165    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysctl-d\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109176    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b46x8\" (UniqueName: \"kubernetes.io/projected/cace9f68-833a-4129-ab4e-ba5f8fba5f14-kube-api-access-b46x8\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109196    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/874942df-dcc0-4613-bdb1-b21b5c23ed48-tmp-dir\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109240    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-etc-kubernetes\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109267    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd5cd303-19ae-4714-99cd-cc9c52d28904-kubelet-config\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-systemd\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cd5cd303-19ae-4714-99cd-cc9c52d28904-kubelet-config\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-socket-dir-parent\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-cni-bin\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109454    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/017343cd-b0fe-489b-b66e-26f8fec3806d-konnectivity-ca\") pod \"konnectivity-agent-54dfv\" (UID: \"017343cd-b0fe-489b-b66e-26f8fec3806d\") " pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109484    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysctl-conf\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109500    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-lib-modules\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109515    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-tuned\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109529    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-cnibin\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.121687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-netns\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109568    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-cni-multus\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109584    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-run\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-sys\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109610    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-host\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-hostroot\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109639    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-iptables-alerter-script\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-var-lib-kubelet\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-k8s-cni-cncf-io\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109687    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-multus-certs\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fb2429fe-8255-40e5-bf70-4e007c4858b6-cni-binary-copy\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109711    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-daemon-config\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109787    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-cni-multus\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-cnibin\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-multus-certs\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-socket-dir-parent\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109868    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-run\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109926    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-lib-modules\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.122527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.109973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-sysctl-conf\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110029    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/017343cd-b0fe-489b-b66e-26f8fec3806d-konnectivity-ca\") pod \"konnectivity-agent-54dfv\" (UID: \"017343cd-b0fe-489b-b66e-26f8fec3806d\") " pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110036    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-hostroot\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-k8s-cni-cncf-io\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110076    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-sys\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-var-lib-kubelet\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110123    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cace9f68-833a-4129-ab4e-ba5f8fba5f14-host\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110124    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-run-netns\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fb2429fe-8255-40e5-bf70-4e007c4858b6-multus-daemon-config\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110526    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-iptables-alerter-script\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.110789    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb2429fe-8255-40e5-bf70-4e007c4858b6-host-var-lib-cni-bin\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.112739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cace9f68-833a-4129-ab4e-ba5f8fba5f14-etc-tuned\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.112881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/017343cd-b0fe-489b-b66e-26f8fec3806d-agent-certs\") pod \"konnectivity-agent-54dfv\" (UID: \"017343cd-b0fe-489b-b66e-26f8fec3806d\") " pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:23:39.124261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.114037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cace9f68-833a-4129-ab4e-ba5f8fba5f14-tmp\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.131996 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.130709    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxvbb\" (UniqueName: \"kubernetes.io/projected/80a821d3-236e-41d2-bc61-ba3f9eb67ef9-kube-api-access-wxvbb\") pod \"iptables-alerter-29lgv\" (UID: \"80a821d3-236e-41d2-bc61-ba3f9eb67ef9\") " pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.131996 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.130806    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:23:39.131996 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.130827    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:23:39.131996 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.130839    2563 projected.go:196] Error preparing data for projected volume kube-api-access-qtslz for pod openshift-network-diagnostics/network-check-target-rb2j5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:39.131996 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.130906    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz podName:aed94bd9-1d76-428b-9210-d2af97432b38 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:39.630889742 +0000 UTC m=+3.179390018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qtslz" (UniqueName: "kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz") pod "network-check-target-rb2j5" (UID: "aed94bd9-1d76-428b-9210-d2af97432b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:39.133314 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.132907    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b46x8\" (UniqueName: \"kubernetes.io/projected/cace9f68-833a-4129-ab4e-ba5f8fba5f14-kube-api-access-b46x8\") pod \"tuned-9sdjs\" (UID: \"cace9f68-833a-4129-ab4e-ba5f8fba5f14\") " pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.216563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.134368    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js6n9\" (UniqueName: \"kubernetes.io/projected/874942df-dcc0-4613-bdb1-b21b5c23ed48-kube-api-access-js6n9\") pod \"node-resolver-ffwwg\" (UID: \"874942df-dcc0-4613-bdb1-b21b5c23ed48\") " pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.216563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.134975    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpbf7\" (UniqueName: \"kubernetes.io/projected/fb2429fe-8255-40e5-bf70-4e007c4858b6-kube-api-access-xpbf7\") pod \"multus-45dq2\" (UID: \"fb2429fe-8255-40e5-bf70-4e007c4858b6\") " pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.216563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.179611    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l"
Jul 15 12:23:39.216563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.186854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vs9wc"
Jul 15 12:23:39.216563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.200712    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2m5sg"
Jul 15 12:23:39.216563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.204421    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:23:39.216563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.212006    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sdjs"
Jul 15 12:23:39.220831 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.218800    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ffwwg"
Jul 15 12:23:39.228219 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.227826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-45dq2"
Jul 15 12:23:39.431263 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.233376    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:23:39.431263 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.235473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29lgv"
Jul 15 12:23:39.431263 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.260110    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:23:39.672841 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.512204    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:39.672841 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.512331    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:39.672841 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.512406    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs podName:f0dc592e-48df-4b09-833b-a67f2aba01df nodeName:}" failed. No retries permitted until 2026-07-15 12:23:40.512376829 +0000 UTC m=+4.060877077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs") pod "network-metrics-daemon-rf9sm" (UID: "f0dc592e-48df-4b09-833b-a67f2aba01df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:39.672841 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.612906    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:39.672841 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.613064    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:39.672841 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.613139    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret podName:cd5cd303-19ae-4714-99cd-cc9c52d28904 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:40.613123272 +0000 UTC m=+4.161623518 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret") pod "global-pull-secret-syncer-6lbpz" (UID: "cd5cd303-19ae-4714-99cd-cc9c52d28904") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:39.912213 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.713602    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:39.912213 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.713803    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:23:39.912213 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.713826    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:23:39.912213 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.713836    2563 projected.go:196] Error preparing data for projected volume kube-api-access-qtslz for pod openshift-network-diagnostics/network-check-target-rb2j5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:39.912213 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:39.713901    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz podName:aed94bd9-1d76-428b-9210-d2af97432b38 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:40.71388309 +0000 UTC m=+4.262383358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtslz" (UniqueName: "kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz") pod "network-check-target-rb2j5" (UID: "aed94bd9-1d76-428b-9210-d2af97432b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.927254    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:18:38 +0000 UTC" deadline="2028-03-21 15:42:55.414729991 +0000 UTC"
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:39.927278    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14763h19m15.487455073s"
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:40.014668    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.014806    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:40.125063    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017343cd_b0fe_489b_b66e_26f8fec3806d.slice/crio-8515d23555277a6a58fd154896325ab49a30bfc898a491874299f12bc172fb10 WatchSource:0}: Error finding container 8515d23555277a6a58fd154896325ab49a30bfc898a491874299f12bc172fb10: Status 404 returned error can't find the container with id 8515d23555277a6a58fd154896325ab49a30bfc898a491874299f12bc172fb10
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:40.125855    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd91864b8_a5c8_4296_9c56_1fe1ef8333a4.slice/crio-0e6c4c852dd1f84ddb12d62492abd73a3f59bd4f28ad4d36ad6e2077355b2b33 WatchSource:0}: Error finding container 0e6c4c852dd1f84ddb12d62492abd73a3f59bd4f28ad4d36ad6e2077355b2b33: Status 404 returned error can't find the container with id 0e6c4c852dd1f84ddb12d62492abd73a3f59bd4f28ad4d36ad6e2077355b2b33
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:40.127511    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb2429fe_8255_40e5_bf70_4e007c4858b6.slice/crio-1ac96bc0c575fcce2ae96309e26bc33d4e4282909882790cfd62d01ce4364667 WatchSource:0}: Error finding container 1ac96bc0c575fcce2ae96309e26bc33d4e4282909882790cfd62d01ce4364667: Status 404 returned error can't find the container with id 1ac96bc0c575fcce2ae96309e26bc33d4e4282909882790cfd62d01ce4364667
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:40.129036    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd95bd0e0_97e1_4833_a2df_2c1d6162f5e4.slice/crio-5f3ab138e82b46071d27fe40d1ed7e682b0eeb2f14725736152706c8369ee32c WatchSource:0}: Error finding container 5f3ab138e82b46071d27fe40d1ed7e682b0eeb2f14725736152706c8369ee32c: Status 404 returned error can't find the container with id 5f3ab138e82b46071d27fe40d1ed7e682b0eeb2f14725736152706c8369ee32c
Jul 15 12:23:40.143111 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:23:40.129270    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a821d3_236e_41d2_bc61_ba3f9eb67ef9.slice/crio-0e20670bed91052c3661dd24d64b6f39e06537d5118b66d7e51664e83df5e423 WatchSource:0}: Error finding container 0e20670bed91052c3661dd24d64b6f39e06537d5118b66d7e51664e83df5e423: Status 404 returned error can't find the container with id 0e20670bed91052c3661dd24d64b6f39e06537d5118b66d7e51664e83df5e423
Jul 15 12:23:40.584482 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:40.521199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:40.584482 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.521352    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:40.584482 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.521482    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs podName:f0dc592e-48df-4b09-833b-a67f2aba01df nodeName:}" failed. No retries permitted until 2026-07-15 12:23:42.521463158 +0000 UTC m=+6.069963403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs") pod "network-metrics-daemon-rf9sm" (UID: "f0dc592e-48df-4b09-833b-a67f2aba01df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:40.622280 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:40.622246    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:40.622470 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.622453    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:40.622559 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.622520    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret podName:cd5cd303-19ae-4714-99cd-cc9c52d28904 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:42.622501325 +0000 UTC m=+6.171001577 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret") pod "global-pull-secret-syncer-6lbpz" (UID: "cd5cd303-19ae-4714-99cd-cc9c52d28904") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:40.723615 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:40.723538    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:40.723797 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.723773    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:23:40.723852 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.723803    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:23:40.723852 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.723816    2563 projected.go:196] Error preparing data for projected volume kube-api-access-qtslz for pod openshift-network-diagnostics/network-check-target-rb2j5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:40.723946 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:40.723876    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz podName:aed94bd9-1d76-428b-9210-d2af97432b38 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:42.723857591 +0000 UTC m=+6.272357856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtslz" (UniqueName: "kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz") pod "network-check-target-rb2j5" (UID: "aed94bd9-1d76-428b-9210-d2af97432b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:40.927460 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:40.927395    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:18:38 +0000 UTC" deadline="2028-03-24 01:02:49.427108862 +0000 UTC"
Jul 15 12:23:40.927460 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:40.927458    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14820h39m8.499654808s"
Jul 15 12:23:41.025661 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.024686    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:41.025661 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:41.024827    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:41.025661 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.025481    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:41.025661 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:41.025577    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:41.053766 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.053711    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal" event={"ID":"3bc6f484d7291ccb2f134583fa25f23a","Type":"ContainerStarted","Data":"8ae79f12e0f5e39e0da6546ba1af6ee87572a747847a11ab1ae0fd5eb6c72d75"}
Jul 15 12:23:41.080735 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.080683    2563 generic.go:356] "Generic (PLEG): container finished" podID="71c521afa895adfa79ccf68feb05a0f3" containerID="bcd880c51d1a4da42988bed807b5826b6edf158a11acc1ca68d6af818bf49c67" exitCode=0
Jul 15 12:23:41.080904 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.080865    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal" event={"ID":"71c521afa895adfa79ccf68feb05a0f3","Type":"ContainerDied","Data":"bcd880c51d1a4da42988bed807b5826b6edf158a11acc1ca68d6af818bf49c67"}
Jul 15 12:23:41.096069 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.095989    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vs9wc" event={"ID":"d91864b8-a5c8-4296-9c56-1fe1ef8333a4","Type":"ContainerStarted","Data":"0e6c4c852dd1f84ddb12d62492abd73a3f59bd4f28ad4d36ad6e2077355b2b33"}
Jul 15 12:23:41.100549 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.100522    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-45dq2" event={"ID":"fb2429fe-8255-40e5-bf70-4e007c4858b6","Type":"ContainerStarted","Data":"1ac96bc0c575fcce2ae96309e26bc33d4e4282909882790cfd62d01ce4364667"}
Jul 15 12:23:41.115308 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.115279    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"cc3b0ec799e2451b48cada24d9bb4f15cc40ffcefc14e0ffe1d98b458e83e5bd"}
Jul 15 12:23:41.127534 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.127050    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-184.ec2.internal" podStartSLOduration=4.1270297750000005 podStartE2EDuration="4.127029775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:23:41.090245455 +0000 UTC m=+4.638745727" watchObservedRunningTime="2026-07-15 12:23:41.127029775 +0000 UTC m=+4.675530044"
Jul 15 12:23:41.132667 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.132637    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29lgv" event={"ID":"80a821d3-236e-41d2-bc61-ba3f9eb67ef9","Type":"ContainerStarted","Data":"0e20670bed91052c3661dd24d64b6f39e06537d5118b66d7e51664e83df5e423"}
Jul 15 12:23:41.136750 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.136425    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l" event={"ID":"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4","Type":"ContainerStarted","Data":"5f3ab138e82b46071d27fe40d1ed7e682b0eeb2f14725736152706c8369ee32c"}
Jul 15 12:23:41.144976 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.144900    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-54dfv" event={"ID":"017343cd-b0fe-489b-b66e-26f8fec3806d","Type":"ContainerStarted","Data":"8515d23555277a6a58fd154896325ab49a30bfc898a491874299f12bc172fb10"}
Jul 15 12:23:41.153050 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.153022    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ffwwg" event={"ID":"874942df-dcc0-4613-bdb1-b21b5c23ed48","Type":"ContainerStarted","Data":"63df37fb4d4dddbb082476ab21916e581cbf65a42e13315c8a0b1096b9ed6ce1"}
Jul 15 12:23:41.157970 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.157926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sdjs" event={"ID":"cace9f68-833a-4129-ab4e-ba5f8fba5f14","Type":"ContainerStarted","Data":"032ae859a798306889c186d9501a15bc837ad154cc92f4226679f73744b833d1"}
Jul 15 12:23:41.168244 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:41.168216    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" event={"ID":"7334ff04-8513-4f0f-bf18-563e82fd9b4e","Type":"ContainerStarted","Data":"8972cc7ee6351962d81c246af9ed5664d734f0c512161d46fc3630ad795eb44a"}
Jul 15 12:23:42.014465 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:42.014385    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:42.014629 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.014566    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:42.191466 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:42.191376    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal" event={"ID":"71c521afa895adfa79ccf68feb05a0f3","Type":"ContainerStarted","Data":"db88fff193ca59d6a7e00a7b56852b73aa15c4d60dc9c130b8de9c79b84d6ab7"}
Jul 15 12:23:42.215182 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:42.214154    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-184.ec2.internal" podStartSLOduration=5.214133913 podStartE2EDuration="5.214133913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:23:42.213776314 +0000 UTC m=+5.762276584" watchObservedRunningTime="2026-07-15 12:23:42.214133913 +0000 UTC m=+5.762634185"
Jul 15 12:23:42.538778 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:42.538742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:42.538938 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.538889    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:42.539022 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.538952    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs podName:f0dc592e-48df-4b09-833b-a67f2aba01df nodeName:}" failed. No retries permitted until 2026-07-15 12:23:46.538933943 +0000 UTC m=+10.087434203 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs") pod "network-metrics-daemon-rf9sm" (UID: "f0dc592e-48df-4b09-833b-a67f2aba01df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:42.641033 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:42.640994    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:42.641195 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.641183    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:42.641264 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.641243    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret podName:cd5cd303-19ae-4714-99cd-cc9c52d28904 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:46.641227102 +0000 UTC m=+10.189727348 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret") pod "global-pull-secret-syncer-6lbpz" (UID: "cd5cd303-19ae-4714-99cd-cc9c52d28904") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:42.741773 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:42.741733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:42.741985 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.741901    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:23:42.741985 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.741928    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:23:42.741985 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.741943    2563 projected.go:196] Error preparing data for projected volume kube-api-access-qtslz for pod openshift-network-diagnostics/network-check-target-rb2j5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:42.742140 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:42.742006    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz podName:aed94bd9-1d76-428b-9210-d2af97432b38 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:46.741987407 +0000 UTC m=+10.290487675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtslz" (UniqueName: "kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz") pod "network-check-target-rb2j5" (UID: "aed94bd9-1d76-428b-9210-d2af97432b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:43.016405 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:43.016317    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:43.016572 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:43.016450    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:43.016844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:43.016826    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:43.016936 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:43.016917    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:44.014960 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:44.014928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:44.015406 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:44.015063    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:45.014913 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:45.014879    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:45.015087 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:45.015007    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:45.015391 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:45.015360    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:45.015509 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:45.015472    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:46.014651 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:46.014567    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:46.014830 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.014713    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:46.577102 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:46.576969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:46.577549 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.577114    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:46.577549 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.577188    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs podName:f0dc592e-48df-4b09-833b-a67f2aba01df nodeName:}" failed. No retries permitted until 2026-07-15 12:23:54.577169623 +0000 UTC m=+18.125669877 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs") pod "network-metrics-daemon-rf9sm" (UID: "f0dc592e-48df-4b09-833b-a67f2aba01df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:46.677781 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:46.677744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:46.677961 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.677891    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:46.677961 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.677955    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret podName:cd5cd303-19ae-4714-99cd-cc9c52d28904 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:54.677936142 +0000 UTC m=+18.226436397 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret") pod "global-pull-secret-syncer-6lbpz" (UID: "cd5cd303-19ae-4714-99cd-cc9c52d28904") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:46.778392 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:46.778261    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:46.778585 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.778425    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:23:46.778585 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.778451    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:23:46.778585 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.778463    2563 projected.go:196] Error preparing data for projected volume kube-api-access-qtslz for pod openshift-network-diagnostics/network-check-target-rb2j5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:46.778585 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:46.778530    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz podName:aed94bd9-1d76-428b-9210-d2af97432b38 nodeName:}" failed. No retries permitted until 2026-07-15 12:23:54.778511481 +0000 UTC m=+18.327011750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtslz" (UniqueName: "kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz") pod "network-check-target-rb2j5" (UID: "aed94bd9-1d76-428b-9210-d2af97432b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:47.021924 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:47.019515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:47.021924 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:47.019646    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:47.021924 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:47.020065    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:47.021924 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:47.020186    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:48.014191 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:48.014158    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:48.014650 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:48.014295    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:49.016220 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:49.015546    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:49.016220 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:49.015674    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:49.016220 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:49.015550    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:49.016220 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:49.016112    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:50.014029 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:50.013996    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:50.014209 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:50.014131    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:51.014194 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:51.014162    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:51.014524 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:51.014269    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:51.014524 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:51.014307    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:51.014524 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:51.014354    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:52.014450 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:52.014408    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:52.014930 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:52.014532    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:53.014699 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:53.014660    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:53.015132 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:53.014660    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:53.015132 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:53.014802    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:53.015132 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:53.014930    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:54.014422 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:54.014392    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:54.014619 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.014513    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:54.635205 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:54.635174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:54.635681 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.635311    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:54.635681 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.635361    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs podName:f0dc592e-48df-4b09-833b-a67f2aba01df nodeName:}" failed. No retries permitted until 2026-07-15 12:24:10.635346597 +0000 UTC m=+34.183846842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs") pod "network-metrics-daemon-rf9sm" (UID: "f0dc592e-48df-4b09-833b-a67f2aba01df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:23:54.736268 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:54.736234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:54.736419 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.736389    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:54.736473 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.736459    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret podName:cd5cd303-19ae-4714-99cd-cc9c52d28904 nodeName:}" failed. No retries permitted until 2026-07-15 12:24:10.736439773 +0000 UTC m=+34.284940037 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret") pod "global-pull-secret-syncer-6lbpz" (UID: "cd5cd303-19ae-4714-99cd-cc9c52d28904") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:23:54.836653 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:54.836617    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:54.836828 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.836803    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:23:54.836828 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.836825    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:23:54.836901 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.836838    2563 projected.go:196] Error preparing data for projected volume kube-api-access-qtslz for pod openshift-network-diagnostics/network-check-target-rb2j5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:54.836901 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:54.836888    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz podName:aed94bd9-1d76-428b-9210-d2af97432b38 nodeName:}" failed. No retries permitted until 2026-07-15 12:24:10.836873511 +0000 UTC m=+34.385373757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtslz" (UniqueName: "kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz") pod "network-check-target-rb2j5" (UID: "aed94bd9-1d76-428b-9210-d2af97432b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:23:55.014019 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:55.013923    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:55.014186 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:55.013933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:55.014186 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:55.014058    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:55.014186 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:55.014114    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:56.014739 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:56.014693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:56.015132 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:56.014835    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:57.015387 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:57.015350    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:57.015837 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:57.015469    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:23:57.015837 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:57.015528    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:57.015837 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:57.015636    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:58.014315 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:58.014282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:23:58.014483 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:58.014414    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:23:59.014828 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:59.014797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:23:59.015204 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:23:59.014797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:23:59.015204 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:59.014922    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:23:59.015204 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:23:59.014965    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:24:00.014361 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.014066    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:00.014527 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:00.014440    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:24:00.230687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.230647    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vs9wc" event={"ID":"d91864b8-a5c8-4296-9c56-1fe1ef8333a4","Type":"ContainerStarted","Data":"a6af7ef488105460400691c9b4675e2acedca6bffc7e566fc0fa4665cec5054f"}
Jul 15 12:24:00.232440 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.232407    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-45dq2" event={"ID":"fb2429fe-8255-40e5-bf70-4e007c4858b6","Type":"ContainerStarted","Data":"ca9436134111ca28ef096c16390622ad1ab7e55965689eb05adcb6c5444915f3"}
Jul 15 12:24:00.235539 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.235521    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:24:00.235885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.235858    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb454696-c296-4b29-93f6-6f4fb01e9b49" containerID="8ae0cde01af47065f0aa187ee9f145398608e583879f9b7dc31ddb7eadb83991" exitCode=1
Jul 15 12:24:00.236001 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.235929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"4b81d1a9c9dc0fa3568e1229e82be507508868d89bb000e721e31dff2b10fb54"}
Jul 15 12:24:00.236001 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.235986    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"606689deade08e0e92376e4327a80d2dd049e9b39dc08ea811af68f24462011c"}
Jul 15 12:24:00.236093 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.236032    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"804608a3a27ed7818e1cf546baf0fbb6eb359886f7f19e09829fecfd289cb24e"}
Jul 15 12:24:00.236093 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.236081    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"289fa2666adf92dc4d4f03afaadc3cf0f6ba1c589795cf82571fec704886191f"}
Jul 15 12:24:00.236179 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.236127    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerDied","Data":"8ae0cde01af47065f0aa187ee9f145398608e583879f9b7dc31ddb7eadb83991"}
Jul 15 12:24:00.236225 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.236175    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"d7254e8e6ab61c2ecd241f2aee5c25f3a417bdb9f78da8d65fad6d8aa6fe2dc9"}
Jul 15 12:24:00.237601 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.237583    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l" event={"ID":"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4","Type":"ContainerStarted","Data":"0025ae93cd3a4efb1f9ae2701f9b28672fc3df1eb742ba4eb8bd098b136ee053"}
Jul 15 12:24:00.239034 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.239014    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-54dfv" event={"ID":"017343cd-b0fe-489b-b66e-26f8fec3806d","Type":"ContainerStarted","Data":"c13aa0e0243c2f5a3aea43ea492b014ad01c28d2da68de84dc7d44b9a8cb04f7"}
Jul 15 12:24:00.240579 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.240558    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ffwwg" event={"ID":"874942df-dcc0-4613-bdb1-b21b5c23ed48","Type":"ContainerStarted","Data":"fc2e388093325e689b3dc0bd8deb24c4572283e93ff28aaefb55aeb9a996400e"}
Jul 15 12:24:00.242080 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.242058    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sdjs" event={"ID":"cace9f68-833a-4129-ab4e-ba5f8fba5f14","Type":"ContainerStarted","Data":"66e43d189b2e2c028e685de575b7cb40589333cf456e2e9c632faf4b13c93234"}
Jul 15 12:24:00.243666 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.243644    2563 generic.go:356] "Generic (PLEG): container finished" podID="7334ff04-8513-4f0f-bf18-563e82fd9b4e" containerID="8ea9047ff5fc751a044484c1cd50dfbc0e8e796204a885934a9cfc61e9fed692" exitCode=0
Jul 15 12:24:00.243786 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.243672    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" event={"ID":"7334ff04-8513-4f0f-bf18-563e82fd9b4e","Type":"ContainerDied","Data":"8ea9047ff5fc751a044484c1cd50dfbc0e8e796204a885934a9cfc61e9fed692"}
Jul 15 12:24:00.250775 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.250714    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vs9wc" podStartSLOduration=4.079767287 podStartE2EDuration="23.250698216s" totalImagesPullingTime="19.170930929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:00.250284032 +0000 UTC m=+23.798784296" watchObservedRunningTime="2026-07-15 12:24:00.250698216 +0000 UTC m=+23.799198485"
Jul 15 12:24:00.307144 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.307040    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9sdjs" podStartSLOduration=4.129465562 podStartE2EDuration="23.307021787s" totalImagesPullingTime="19.177556225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:00.280533257 +0000 UTC m=+23.829033526" watchObservedRunningTime="2026-07-15 12:24:00.307021787 +0000 UTC m=+23.855522056"
Jul 15 12:24:00.307315 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.307180    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ffwwg" podStartSLOduration=4.132331634 podStartE2EDuration="23.307171705s" totalImagesPullingTime="19.174840071s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:00.306449175 +0000 UTC m=+23.854949446" watchObservedRunningTime="2026-07-15 12:24:00.307171705 +0000 UTC m=+23.855671977"
Jul 15 12:24:00.384496 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.384304    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-45dq2" podStartSLOduration=4.204503881 podStartE2EDuration="23.384231122s" totalImagesPullingTime="19.179727241s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:00.335806178 +0000 UTC m=+23.884306446" watchObservedRunningTime="2026-07-15 12:24:00.384231122 +0000 UTC m=+23.932731453"
Jul 15 12:24:00.412313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.412271    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-54dfv" podStartSLOduration=12.437456141 podStartE2EDuration="23.412255694s" totalImagesPullingTime="10.974799553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:00.411873529 +0000 UTC m=+23.960373797" watchObservedRunningTime="2026-07-15 12:24:00.412255694 +0000 UTC m=+23.960755961"
Jul 15 12:24:00.510501 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.510467    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:00.584968 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:00.584871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:01.010650 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.010624    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 12:24:01.014224 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.013973    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:01.014224 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.013986    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:01.014224 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:01.014100    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:24:01.014224 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:01.014193    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:24:01.170860 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.170772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:01.247144 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.247110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29lgv" event={"ID":"80a821d3-236e-41d2-bc61-ba3f9eb67ef9","Type":"ContainerStarted","Data":"8a98bd07a1660f885bccd3300cc0acef78df12c5afa10e36122bd64f885b3903"}
Jul 15 12:24:01.249082 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.249051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l" event={"ID":"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4","Type":"ContainerStarted","Data":"61ccd5448eb92da55e204d9541351e3ba0aafcc4dee6ccf86aae3e82d7481fb0"}
Jul 15 12:24:01.273925 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.273896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:01.293432 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.293385    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-29lgv" podStartSLOduration=5.125770054 podStartE2EDuration="24.293369383s" totalImagesPullingTime="19.167599329s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:01.292893278 +0000 UTC m=+24.841393546" watchObservedRunningTime="2026-07-15 12:24:01.293369383 +0000 UTC m=+24.841869651"
Jul 15 12:24:01.507222 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.507141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:01.658367 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.658332    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:01.834620 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.834589    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:01.941011 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.940889    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T12:24:01.010644524Z","UUID":"610ed1d6-cceb-49d2-9588-f403a3f8da57","Handler":null,"Name":"","Endpoint":""}
Jul 15 12:24:01.942096 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.942009    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:01.942685 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.942661    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 12:24:01.942809 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:01.942706    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 12:24:02.014204 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:02.014178    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:02.014363 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:02.014313    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:24:02.033124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:02.033086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:02.139370 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:02.139338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:02.833761 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:02.833507    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:02.931506 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:02.931475    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:03.014269 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:03.014235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:03.014442 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:03.014235    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:03.014442 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:03.014362    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:24:03.014544 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:03.014470    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:24:03.231417 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:03.231325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:03.256159 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:03.256125    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l" event={"ID":"d95bd0e0-97e1-4833-a2df-2c1d6162f5e4","Type":"ContainerStarted","Data":"0a8b09ba93dfb2f9ba14e27a46bf96290c0f502b7f4066e78a94d013ec7e8c65"}
Jul 15 12:24:03.259457 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:03.259437    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:24:03.259802 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:03.259781    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"3f01e0b2597226364abc986b19c24c598da152f1e8f7167602ab9bb701deb4ad"}
Jul 15 12:24:03.283739 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:03.283676    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qzh2l" podStartSLOduration=4.497978346 podStartE2EDuration="26.283661081s" totalImagesPullingTime="21.785682735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:03.283561122 +0000 UTC m=+26.832061435" watchObservedRunningTime="2026-07-15 12:24:03.283661081 +0000 UTC m=+26.832161351"
Jul 15 12:24:03.314600 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:03.314566    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:04.013850 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:04.013819    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:04.014327 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:04.013950    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:24:04.049867 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:04.049819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:04.149908 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:04.149880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:04.429862 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:04.429835    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:04.527464 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:04.527437    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:04.537551 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:04.537346    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:24:04.538557 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:04.538437    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:24:05.014120 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:05.013911    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:05.014742 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:05.013972    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:05.014742 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:05.014160    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:24:05.014742 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:05.014241    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:24:05.265271 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:05.265199    2563 generic.go:356] "Generic (PLEG): container finished" podID="7334ff04-8513-4f0f-bf18-563e82fd9b4e" containerID="3847db2db279d0874a8f7ca1a740a93a022b0a5300d78f0b7665c211704aec1d" exitCode=0
Jul 15 12:24:05.265425 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:05.265277    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" event={"ID":"7334ff04-8513-4f0f-bf18-563e82fd9b4e","Type":"ContainerDied","Data":"3847db2db279d0874a8f7ca1a740a93a022b0a5300d78f0b7665c211704aec1d"}
Jul 15 12:24:05.268619 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:05.268608    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:24:05.268976 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:05.268949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"d9972bf4e0f0d9545ff008d86d9a6188e4f12efaf4959ae41be12797ce626000"}
Jul 15 12:24:05.269362 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:05.269349    2563 scope.go:117] "RemoveContainer" containerID="8ae0cde01af47065f0aa187ee9f145398608e583879f9b7dc31ddb7eadb83991"
Jul 15 12:24:06.014688 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.014627    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:06.015188 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:06.014748    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:24:06.275306 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.275241    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:24:06.275718 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.275690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" event={"ID":"fb454696-c296-4b29-93f6-6f4fb01e9b49","Type":"ContainerStarted","Data":"0f8bdc1913471dacb30feb150f779ff82d58f5db42979b1db5d669646906a93c"}
Jul 15 12:24:06.276010 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.275985    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:24:06.276121 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.276075    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:24:06.276121 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.276128    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:24:06.290788 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.290759    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:24:06.291846 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.291827    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:24:06.365373 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.365208    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp" podStartSLOduration=10.122989434 podStartE2EDuration="29.365186453s" totalImagesPullingTime="19.242197019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:06.319039883 +0000 UTC m=+29.867540150" watchObservedRunningTime="2026-07-15 12:24:06.365186453 +0000 UTC m=+29.913686721"
Jul 15 12:24:06.715863 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.715672    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rb2j5"]
Jul 15 12:24:06.716017 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.715965    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:06.716062 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:06.716042    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:24:06.720556 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.720522    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6lbpz"]
Jul 15 12:24:06.720701 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.720630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:06.720789 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:06.720715    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:24:06.721162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.721139    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rf9sm"]
Jul 15 12:24:06.721286 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:06.721273    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:06.721397 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:06.721377    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:24:07.280010 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:07.279976    2563 generic.go:356] "Generic (PLEG): container finished" podID="7334ff04-8513-4f0f-bf18-563e82fd9b4e" containerID="6778dd16dadfa41d46904302893372c99544b0699c42cb6c254e5d7f68674696" exitCode=0
Jul 15 12:24:07.280476 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:07.280056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" event={"ID":"7334ff04-8513-4f0f-bf18-563e82fd9b4e","Type":"ContainerDied","Data":"6778dd16dadfa41d46904302893372c99544b0699c42cb6c254e5d7f68674696"}
Jul 15 12:24:07.583203 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:07.583164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:08.014874 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:08.014797    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:08.015006 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:08.014921    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:24:08.243031 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:08.242995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:08.319513 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:08.319481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:08.677886 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:08.677794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:08.778833 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:08.778795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:08.985643 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:08.985569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:09.014626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.014599    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:09.014803 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:09.014743    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:24:09.014803 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.014777    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:09.014917 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:09.014877    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:24:09.074032 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.074001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:09.172736 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.172692    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:24:09.172889 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.172853    2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 15 12:24:09.173506 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.173477    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-54dfv"
Jul 15 12:24:09.174871 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.174840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:09.210912 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.210887    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffwwg_874942df-dcc0-4613-bdb1-b21b5c23ed48/dns-node-resolver/0.log"
Jul 15 12:24:09.280020 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.279956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:09.285565 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.285539    2563 generic.go:356] "Generic (PLEG): container finished" podID="7334ff04-8513-4f0f-bf18-563e82fd9b4e" containerID="90dc2710a93f1baf36ce9958e26b8116834076bfa987d94187b2e2868d750e7d" exitCode=0
Jul 15 12:24:09.285681 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.285613    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" event={"ID":"7334ff04-8513-4f0f-bf18-563e82fd9b4e","Type":"ContainerDied","Data":"90dc2710a93f1baf36ce9958e26b8116834076bfa987d94187b2e2868d750e7d"}
Jul 15 12:24:09.446954 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.446918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:09.765986 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.765955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:09.868269 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:09.868238    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:10.014852 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:10.014824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:10.015027 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.014933    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:24:10.409623 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:10.409596    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vs9wc_d91864b8-a5c8-4296-9c56-1fe1ef8333a4/node-ca/0.log"
Jul 15 12:24:10.649061 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:10.649033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:10.649522 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.649163    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:24:10.649522 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.649237    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs podName:f0dc592e-48df-4b09-833b-a67f2aba01df nodeName:}" failed. No retries permitted until 2026-07-15 12:24:42.649214769 +0000 UTC m=+66.197715030 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs") pod "network-metrics-daemon-rf9sm" (UID: "f0dc592e-48df-4b09-833b-a67f2aba01df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:24:10.749448 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:10.749361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:10.749610 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.749499    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:24:10.749610 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.749564    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret podName:cd5cd303-19ae-4714-99cd-cc9c52d28904 nodeName:}" failed. No retries permitted until 2026-07-15 12:24:42.749544855 +0000 UTC m=+66.298045114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret") pod "global-pull-secret-syncer-6lbpz" (UID: "cd5cd303-19ae-4714-99cd-cc9c52d28904") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:24:10.850008 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:10.849975    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:10.850184 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.850164    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:24:10.850241 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.850189    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:24:10.850241 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.850199    2563 projected.go:196] Error preparing data for projected volume kube-api-access-qtslz for pod openshift-network-diagnostics/network-check-target-rb2j5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:24:10.850326 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:10.850263    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz podName:aed94bd9-1d76-428b-9210-d2af97432b38 nodeName:}" failed. No retries permitted until 2026-07-15 12:24:42.850242069 +0000 UTC m=+66.398742314 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qtslz" (UniqueName: "kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz") pod "network-check-target-rb2j5" (UID: "aed94bd9-1d76-428b-9210-d2af97432b38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:24:10.932479 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:10.932442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:11.014691 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:11.014603    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:11.014861 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:11.014746    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:24:11.014861 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:11.014837    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:11.014964 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:11.014945    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:24:11.478599 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:11.478563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:11.554256 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:11.554222    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:12.014196 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:12.014157    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:12.014631 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:12.014303    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rf9sm" podUID="f0dc592e-48df-4b09-833b-a67f2aba01df"
Jul 15 12:24:12.351504 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:12.351468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:13.014454 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.014228    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:13.014833 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.014282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:13.014833 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:13.014565    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6lbpz" podUID="cd5cd303-19ae-4714-99cd-cc9c52d28904"
Jul 15 12:24:13.014833 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:24:13.014616    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rb2j5" podUID="aed94bd9-1d76-428b-9210-d2af97432b38"
Jul 15 12:24:13.101601 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.101498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:13.202591 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.202559    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-184.ec2.internal" event="NodeReady"
Jul 15 12:24:13.202761 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.202713    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 12:24:13.205500 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.205474    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:13.307324 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.307291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:13.418377 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.418353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:13.575141 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.575114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:13.788124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:13.788042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:14.013815 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:14.013767    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:14.017028 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:14.017010    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 12:24:14.017354 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:14.017044    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2twz\""
Jul 15 12:24:14.298622 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:14.298589    2563 generic.go:356] "Generic (PLEG): container finished" podID="7334ff04-8513-4f0f-bf18-563e82fd9b4e" containerID="24b08ea79ef0adcc52e22e6cf0932d2d91b5f37de6061c4a65fd1eb18cf30ec0" exitCode=0
Jul 15 12:24:14.298774 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:14.298633    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" event={"ID":"7334ff04-8513-4f0f-bf18-563e82fd9b4e","Type":"ContainerDied","Data":"24b08ea79ef0adcc52e22e6cf0932d2d91b5f37de6061c4a65fd1eb18cf30ec0"}
Jul 15 12:24:14.437818 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:14.437787    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:14.979288 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:14.979250    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:15.014644 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.014609    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:15.014843 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.014658    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:15.018152 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.018128    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 12:24:15.018492 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.018149    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 12:24:15.019045 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.019031    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qvxmk\""
Jul 15 12:24:15.019225 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.019214    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 12:24:15.304148 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.304116    2563 generic.go:356] "Generic (PLEG): container finished" podID="7334ff04-8513-4f0f-bf18-563e82fd9b4e" containerID="143fcb4b1095754e9b46ba3f0e1ec644b6f70259e7b9213619a2d5b057ed2fb6" exitCode=0
Jul 15 12:24:15.304316 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.304176    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" event={"ID":"7334ff04-8513-4f0f-bf18-563e82fd9b4e","Type":"ContainerDied","Data":"143fcb4b1095754e9b46ba3f0e1ec644b6f70259e7b9213619a2d5b057ed2fb6"}
Jul 15 12:24:15.574808 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.574704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:15.769449 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.769419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:15.847179 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:15.847117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:16.169277 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:16.169196    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:16.309319 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:16.309282    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" event={"ID":"7334ff04-8513-4f0f-bf18-563e82fd9b4e","Type":"ContainerStarted","Data":"837ad0788eeb5444f42f201635ebf6cb5ec2fc7106515baf776b1d1a42a61e4f"}
Jul 15 12:24:16.337657 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:16.337610    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2m5sg" podStartSLOduration=9.805780329 podStartE2EDuration="39.337595744s" totalImagesPullingTime="29.531815415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:16.337371261 +0000 UTC m=+39.885871538" watchObservedRunningTime="2026-07-15 12:24:16.337595744 +0000 UTC m=+39.886096010"
Jul 15 12:24:16.377092 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:16.377062    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:16.772893 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:16.772848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:16.845741 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:16.845687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:17.140005 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:17.139974    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:17.226940 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:17.226908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:17.336929 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:17.336894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:17.432907 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:17.432836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:17.762657 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:17.762581    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:17.843711 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:17.843683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:17.985620 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:17.985585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:18.365862 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:18.365823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:18.976701 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:18.976670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:19.252780 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:19.252670    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:19.374851 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:19.374813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:19.793676 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:19.793627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:20.176393 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:20.176356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:20.574074 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:20.574042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:20.963197 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:20.963117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:21.393955 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:21.393920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:21.773190 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:21.773115    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:21.877493 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:21.877452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:21.979260 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:21.979224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:22.185453 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:22.185421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:22.411933 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:22.411899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:22.803768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:22.803737    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:23.381235 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:23.381197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:23.597777 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:23.597705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:23.781039 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:23.780958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:23.896700 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:23.896668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:30.685065 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:30.685031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:30.782472 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:30.782432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:30.882718 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:30.882677    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:30.986848 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:30.986764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:31.153406 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:31.153350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:31.219896 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:31.219867    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:31.412303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:31.412272    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:31.511872 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:31.511838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:31.594835 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:31.594800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:31.660510 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:31.660468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:32.174852 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:32.174816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:32.568976 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:32.568946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:32.763648 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:32.763615    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:32.870031 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:32.869941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:32.972887 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:32.972841    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74547b979d-m69f7"]
Jul 15 12:24:32.993325 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:32.993306    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.004960 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.004944    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 12:24:33.005041 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.005024    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 12:24:33.005120 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.005106    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 12:24:33.007246 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007225    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4zvck\""
Jul 15 12:24:33.007402 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007381    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-certificates\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.007515 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007491    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-trusted-ca\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.007575 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007542    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-ca-trust-extracted\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.007575 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007569    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-bound-sa-token\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.007672 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007594    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-tls\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.007672 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007618    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-blxd8\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-kube-api-access-blxd8\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.007672 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007645    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-installation-pull-secrets\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.007838 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.007762    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-image-registry-private-configuration\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.012051 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.012028    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 12:24:33.012352 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.012337    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74547b979d-m69f7"]
Jul 15 12:24:33.108319 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108288    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-certificates\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.108319 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-trusted-ca\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.108520 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-ca-trust-extracted\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.108520 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108472    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-bound-sa-token\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.108588 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108526    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-tls\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.108588 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108559    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-blxd8\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-kube-api-access-blxd8\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.108673 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108597    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-installation-pull-secrets\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.108891 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108862    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-ca-trust-extracted\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.109026 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.108907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-image-registry-private-configuration\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.109330 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.109309    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-certificates\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.109694 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.109661    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-trusted-ca\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.112489 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.112469    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-image-registry-private-configuration\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.112570 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.112470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-installation-pull-secrets\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.112670 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.112649    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-tls\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.128139 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.128078    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"]
Jul 15 12:24:33.154503 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.154475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-bound-sa-token\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.155818 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.155798    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"]
Jul 15 12:24:33.155922 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.155906    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"
Jul 15 12:24:33.164379 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.164361    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-blxd8\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-kube-api-access-blxd8\") pod \"image-registry-74547b979d-m69f7\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") " pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.167617 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.167589    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 12:24:33.167712 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.167589    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 12:24:33.167946 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.167930    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 12:24:33.168547 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.168532    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-s652q\""
Jul 15 12:24:33.169651 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.169636    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 12:24:33.173462 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.173449    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"]
Jul 15 12:24:33.173515 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.173500    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.191147 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.191127    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"]
Jul 15 12:24:33.191427 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.191229    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.194878 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.194861    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 15 12:24:33.203276 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.203257    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"]
Jul 15 12:24:33.204043 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.204026    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74547b979d-m69f7"]
Jul 15 12:24:33.204226 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.204213    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:33.209525 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209507    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e43da9f-dc1c-4178-a56c-117a8aa3fea1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-789f564c94-nsn7r\" (UID: \"4e43da9f-dc1c-4178-a56c-117a8aa3fea1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"
Jul 15 12:24:33.209599 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shhzl\" (UniqueName: \"kubernetes.io/projected/42931105-92dc-4a1e-9d53-032ca7cf4dbb-kube-api-access-shhzl\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.209599 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209563    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njgzh\" (UniqueName: \"kubernetes.io/projected/429bb970-2599-429e-b85b-3f0c1430ee6d-kube-api-access-njgzh\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.209684 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209619    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/429bb970-2599-429e-b85b-3f0c1430ee6d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.209684 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.209790 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209673    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42931105-92dc-4a1e-9d53-032ca7cf4dbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.209790 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209708    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42931105-92dc-4a1e-9d53-032ca7cf4dbb-tmp\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.209790 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l4pp\" (UniqueName: \"kubernetes.io/projected/4e43da9f-dc1c-4178-a56c-117a8aa3fea1-kube-api-access-2l4pp\") pod \"managed-serviceaccount-addon-agent-789f564c94-nsn7r\" (UID: \"4e43da9f-dc1c-4178-a56c-117a8aa3fea1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"
Jul 15 12:24:33.209930 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-ca\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.209930 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209871    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.209930 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.209899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-hub\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.213137 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.213120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"]
Jul 15 12:24:33.216140 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.216125    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 15 12:24:33.216351 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.216332    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 15 12:24:33.216409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.216397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 15 12:24:33.224054 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.224036    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 15 12:24:33.224609 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.224594    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-27bdz"]
Jul 15 12:24:33.241393 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.241359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.245810 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.245787    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 12:24:33.245914 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.245798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 12:24:33.245973 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.245928    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-x7vt8\""
Jul 15 12:24:33.246087 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.246072    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 12:24:33.246174 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.246162    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 12:24:33.247364 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.247217    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27bdz"]
Jul 15 12:24:33.310670 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e43da9f-dc1c-4178-a56c-117a8aa3fea1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-789f564c94-nsn7r\" (UID: \"4e43da9f-dc1c-4178-a56c-117a8aa3fea1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"
Jul 15 12:24:33.310849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310709    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shhzl\" (UniqueName: \"kubernetes.io/projected/42931105-92dc-4a1e-9d53-032ca7cf4dbb-kube-api-access-shhzl\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.310849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njgzh\" (UniqueName: \"kubernetes.io/projected/429bb970-2599-429e-b85b-3f0c1430ee6d-kube-api-access-njgzh\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.310849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/429bb970-2599-429e-b85b-3f0c1430ee6d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.310849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310806    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.310849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310834    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c3eea0b-2153-47de-820d-8df00a08fda9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310864    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42931105-92dc-4a1e-9d53-032ca7cf4dbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42931105-92dc-4a1e-9d53-032ca7cf4dbb-tmp\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310928    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l4pp\" (UniqueName: \"kubernetes.io/projected/4e43da9f-dc1c-4178-a56c-117a8aa3fea1-kube-api-access-2l4pp\") pod \"managed-serviceaccount-addon-agent-789f564c94-nsn7r\" (UID: \"4e43da9f-dc1c-4178-a56c-117a8aa3fea1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.310969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-ca\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.311004    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c3eea0b-2153-47de-820d-8df00a08fda9-data-volume\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.311030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c3eea0b-2153-47de-820d-8df00a08fda9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.311059    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.311081    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c3eea0b-2153-47de-820d-8df00a08fda9-crio-socket\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.311117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.311106    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-hub\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.311553 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.311127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tst97\" (UniqueName: \"kubernetes.io/projected/0c3eea0b-2153-47de-820d-8df00a08fda9-kube-api-access-tst97\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.311553 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.311525    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42931105-92dc-4a1e-9d53-032ca7cf4dbb-tmp\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.312215 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.312037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/429bb970-2599-429e-b85b-3f0c1430ee6d-additional-service-ca\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.314316 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.314278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.314578 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.314557    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e43da9f-dc1c-4178-a56c-117a8aa3fea1-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-789f564c94-nsn7r\" (UID: \"4e43da9f-dc1c-4178-a56c-117a8aa3fea1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"
Jul 15 12:24:33.314631 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.314576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/42931105-92dc-4a1e-9d53-032ca7cf4dbb-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.314731 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.314705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-ca\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.315116 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.315101    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.315152 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.315115    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/429bb970-2599-429e-b85b-3f0c1430ee6d-hub\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.356841 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.356809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l4pp\" (UniqueName: \"kubernetes.io/projected/4e43da9f-dc1c-4178-a56c-117a8aa3fea1-kube-api-access-2l4pp\") pod \"managed-serviceaccount-addon-agent-789f564c94-nsn7r\" (UID: \"4e43da9f-dc1c-4178-a56c-117a8aa3fea1\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"
Jul 15 12:24:33.390885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.390825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njgzh\" (UniqueName: \"kubernetes.io/projected/429bb970-2599-429e-b85b-3f0c1430ee6d-kube-api-access-njgzh\") pod \"cluster-proxy-proxy-agent-bdc97c65f-8k4vh\" (UID: \"429bb970-2599-429e-b85b-3f0c1430ee6d\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.397235 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.397211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shhzl\" (UniqueName: \"kubernetes.io/projected/42931105-92dc-4a1e-9d53-032ca7cf4dbb-kube-api-access-shhzl\") pod \"klusterlet-addon-workmgr-6f4dd47486-szmsq\" (UID: \"42931105-92dc-4a1e-9d53-032ca7cf4dbb\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.408296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.408266    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:33.412253 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.412232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c3eea0b-2153-47de-820d-8df00a08fda9-data-volume\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.412358 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.412264    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c3eea0b-2153-47de-820d-8df00a08fda9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.412358 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.412291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c3eea0b-2153-47de-820d-8df00a08fda9-crio-socket\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.412358 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.412317    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tst97\" (UniqueName: \"kubernetes.io/projected/0c3eea0b-2153-47de-820d-8df00a08fda9-kube-api-access-tst97\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.412503 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.412407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c3eea0b-2153-47de-820d-8df00a08fda9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.412503 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.412441    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0c3eea0b-2153-47de-820d-8df00a08fda9-crio-socket\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.412590 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.412570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0c3eea0b-2153-47de-820d-8df00a08fda9-data-volume\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.412796 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.412781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0c3eea0b-2153-47de-820d-8df00a08fda9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.414321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.414303    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0c3eea0b-2153-47de-820d-8df00a08fda9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.439289 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.439266    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74547b979d-m69f7"]
Jul 15 12:24:33.441918 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:33.441889    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf9c5a6_0300_401f_b3a1_c25ffbfb054e.slice/crio-2db493bd8a352993762ba0ab0c9f4e359b4750dc3050d0f41313d7c1e3b60f39 WatchSource:0}: Error finding container 2db493bd8a352993762ba0ab0c9f4e359b4750dc3050d0f41313d7c1e3b60f39: Status 404 returned error can't find the container with id 2db493bd8a352993762ba0ab0c9f4e359b4750dc3050d0f41313d7c1e3b60f39
Jul 15 12:24:33.448387 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.448368    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-l859h"]
Jul 15 12:24:33.454848 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.454827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tst97\" (UniqueName: \"kubernetes.io/projected/0c3eea0b-2153-47de-820d-8df00a08fda9-kube-api-access-tst97\") pod \"insights-runtime-extractor-27bdz\" (UID: \"0c3eea0b-2153-47de-820d-8df00a08fda9\") " pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.469206 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.469189    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.474312 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.474296    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ggrzt\""
Jul 15 12:24:33.484100 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.484083    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h4cwj"]
Jul 15 12:24:33.484379 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.484363    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 12:24:33.484927 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.484907    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 12:24:33.487058 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.487039    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"
Jul 15 12:24:33.493827 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.493807    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:33.499207 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.499160    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"
Jul 15 12:24:33.504307 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.504178    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l859h"]
Jul 15 12:24:33.504307 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.504215    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-587665fbc5-9qpxs"]
Jul 15 12:24:33.504530 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.504511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h4cwj"
Jul 15 12:24:33.511148 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.511127    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gd95d\""
Jul 15 12:24:33.511423 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.511392    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 12:24:33.511423 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.511412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 12:24:33.512793 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.512782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjdfz\" (UniqueName: \"kubernetes.io/projected/3212bd1a-0f38-44b5-8386-78980c558ae8-kube-api-access-jjdfz\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.512849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.512806    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3212bd1a-0f38-44b5-8386-78980c558ae8-metrics-tls\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.512849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.512834    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 12:24:33.512849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.512846    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3212bd1a-0f38-44b5-8386-78980c558ae8-tmp-dir\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.512993 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.512906    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3212bd1a-0f38-44b5-8386-78980c558ae8-config-volume\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.520413 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.520393    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h4cwj"]
Jul 15 12:24:33.520525 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.520507    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.548021 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.547958    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-587665fbc5-9qpxs"]
Jul 15 12:24:33.556756 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.556547    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27bdz"
Jul 15 12:24:33.583743 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.583359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:33.613959 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.613921    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/867d262e-e8f6-4362-9f18-a2f9596f7068-trusted-ca\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.614096 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.613992    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/867d262e-e8f6-4362-9f18-a2f9596f7068-installation-pull-secrets\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.614096 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614038    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjdfz\" (UniqueName: \"kubernetes.io/projected/3212bd1a-0f38-44b5-8386-78980c558ae8-kube-api-access-jjdfz\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.614096 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t6p4\" (UniqueName: \"kubernetes.io/projected/acbe397a-608d-479c-8ccb-d115d7761632-kube-api-access-2t6p4\") pod \"ingress-canary-h4cwj\" (UID: \"acbe397a-608d-479c-8ccb-d115d7761632\") " pod="openshift-ingress-canary/ingress-canary-h4cwj"
Jul 15 12:24:33.614096 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614089    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3212bd1a-0f38-44b5-8386-78980c558ae8-metrics-tls\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.614296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614121    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/867d262e-e8f6-4362-9f18-a2f9596f7068-image-registry-private-configuration\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.614296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/867d262e-e8f6-4362-9f18-a2f9596f7068-ca-trust-extracted\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.614296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614175    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-registry-tls\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.614296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-bound-sa-token\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.614296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614227    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3212bd1a-0f38-44b5-8386-78980c558ae8-tmp-dir\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.614296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614252    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/867d262e-e8f6-4362-9f18-a2f9596f7068-registry-certificates\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.614296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3212bd1a-0f38-44b5-8386-78980c558ae8-config-volume\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.614596 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614343    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j24sq\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-kube-api-access-j24sq\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.614596 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614384    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acbe397a-608d-479c-8ccb-d115d7761632-cert\") pod \"ingress-canary-h4cwj\" (UID: \"acbe397a-608d-479c-8ccb-d115d7761632\") " pod="openshift-ingress-canary/ingress-canary-h4cwj"
Jul 15 12:24:33.615007 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.614962    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3212bd1a-0f38-44b5-8386-78980c558ae8-tmp-dir\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.615950 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.615223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3212bd1a-0f38-44b5-8386-78980c558ae8-config-volume\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.617295 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.617140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3212bd1a-0f38-44b5-8386-78980c558ae8-metrics-tls\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.626394 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.626341    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjdfz\" (UniqueName: \"kubernetes.io/projected/3212bd1a-0f38-44b5-8386-78980c558ae8-kube-api-access-jjdfz\") pod \"dns-default-l859h\" (UID: \"3212bd1a-0f38-44b5-8386-78980c558ae8\") " pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.671344 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.670683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:33.687859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.687828    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r"]
Jul 15 12:24:33.691078 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:33.691042    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e43da9f_dc1c_4178_a56c_117a8aa3fea1.slice/crio-ccd66e7f9701748630ec6bc4b90c213637db062b92dd2f6db64b6426dce6cd03 WatchSource:0}: Error finding container ccd66e7f9701748630ec6bc4b90c213637db062b92dd2f6db64b6426dce6cd03: Status 404 returned error can't find the container with id ccd66e7f9701748630ec6bc4b90c213637db062b92dd2f6db64b6426dce6cd03
Jul 15 12:24:33.710664 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.710640    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"]
Jul 15 12:24:33.714129 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:33.714105    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42931105_92dc_4a1e_9d53_032ca7cf4dbb.slice/crio-6d04d0407dd4e35e91a4519fdd3d59b7a1c08706926d06b1a33742347c47bb3a WatchSource:0}: Error finding container 6d04d0407dd4e35e91a4519fdd3d59b7a1c08706926d06b1a33742347c47bb3a: Status 404 returned error can't find the container with id 6d04d0407dd4e35e91a4519fdd3d59b7a1c08706926d06b1a33742347c47bb3a
Jul 15 12:24:33.715138 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j24sq\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-kube-api-access-j24sq\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.715244 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715174    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acbe397a-608d-479c-8ccb-d115d7761632-cert\") pod \"ingress-canary-h4cwj\" (UID: \"acbe397a-608d-479c-8ccb-d115d7761632\") " pod="openshift-ingress-canary/ingress-canary-h4cwj"
Jul 15 12:24:33.715244 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715213    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/867d262e-e8f6-4362-9f18-a2f9596f7068-trusted-ca\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.715351 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/867d262e-e8f6-4362-9f18-a2f9596f7068-installation-pull-secrets\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.715351 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t6p4\" (UniqueName: \"kubernetes.io/projected/acbe397a-608d-479c-8ccb-d115d7761632-kube-api-access-2t6p4\") pod \"ingress-canary-h4cwj\" (UID: \"acbe397a-608d-479c-8ccb-d115d7761632\") " pod="openshift-ingress-canary/ingress-canary-h4cwj"
Jul 15 12:24:33.715351 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715335    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/867d262e-e8f6-4362-9f18-a2f9596f7068-image-registry-private-configuration\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.715487 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715362    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/867d262e-e8f6-4362-9f18-a2f9596f7068-ca-trust-extracted\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.715487 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715411    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-registry-tls\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.715487 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715439    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-bound-sa-token\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.715487 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715467    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/867d262e-e8f6-4362-9f18-a2f9596f7068-registry-certificates\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.716311 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.715942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/867d262e-e8f6-4362-9f18-a2f9596f7068-ca-trust-extracted\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.716962 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.716378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/867d262e-e8f6-4362-9f18-a2f9596f7068-registry-certificates\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.716962 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.716902    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/867d262e-e8f6-4362-9f18-a2f9596f7068-trusted-ca\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.718240 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.718203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/867d262e-e8f6-4362-9f18-a2f9596f7068-image-registry-private-configuration\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.718527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.718491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/867d262e-e8f6-4362-9f18-a2f9596f7068-installation-pull-secrets\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.718991 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.718970    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-registry-tls\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.719566 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.719549    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/acbe397a-608d-479c-8ccb-d115d7761632-cert\") pod \"ingress-canary-h4cwj\" (UID: \"acbe397a-608d-479c-8ccb-d115d7761632\") " pod="openshift-ingress-canary/ingress-canary-h4cwj"
Jul 15 12:24:33.726820 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.726713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh"]
Jul 15 12:24:33.727632 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:33.727613    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod429bb970_2599_429e_b85b_3f0c1430ee6d.slice/crio-02d952bdde6c1d6fad4fc6df64670f5a6d8ef82334156361a1bdf6fb8d974117 WatchSource:0}: Error finding container 02d952bdde6c1d6fad4fc6df64670f5a6d8ef82334156361a1bdf6fb8d974117: Status 404 returned error can't find the container with id 02d952bdde6c1d6fad4fc6df64670f5a6d8ef82334156361a1bdf6fb8d974117
Jul 15 12:24:33.730877 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.730860    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t6p4\" (UniqueName: \"kubernetes.io/projected/acbe397a-608d-479c-8ccb-d115d7761632-kube-api-access-2t6p4\") pod \"ingress-canary-h4cwj\" (UID: \"acbe397a-608d-479c-8ccb-d115d7761632\") " pod="openshift-ingress-canary/ingress-canary-h4cwj"
Jul 15 12:24:33.732847 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.732825    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-bound-sa-token\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.732931 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.732916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j24sq\" (UniqueName: \"kubernetes.io/projected/867d262e-e8f6-4362-9f18-a2f9596f7068-kube-api-access-j24sq\") pod \"image-registry-587665fbc5-9qpxs\" (UID: \"867d262e-e8f6-4362-9f18-a2f9596f7068\") " pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.756587 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.756562    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27bdz"]
Jul 15 12:24:33.759740 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:33.759688    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3eea0b_2153_47de_820d_8df00a08fda9.slice/crio-559e7982711a2e85b89a8cd6865415b1daf8247a8bfb0b3827e39c2d9912cbb6 WatchSource:0}: Error finding container 559e7982711a2e85b89a8cd6865415b1daf8247a8bfb0b3827e39c2d9912cbb6: Status 404 returned error can't find the container with id 559e7982711a2e85b89a8cd6865415b1daf8247a8bfb0b3827e39c2d9912cbb6
Jul 15 12:24:33.760701 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.760662    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:33.778697 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.778680    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:33.813120 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.813090    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h4cwj"
Jul 15 12:24:33.829809 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.829585    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:33.863031 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.862866    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:33.937859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.937833    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-l859h"]
Jul 15 12:24:33.949956 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:33.949928    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3212bd1a_0f38_44b5_8386_78980c558ae8.slice/crio-8408d82f1fb93a650ffc27b3168c733a80ab49032d27f367293373d1e3c832f7 WatchSource:0}: Error finding container 8408d82f1fb93a650ffc27b3168c733a80ab49032d27f367293373d1e3c832f7: Status 404 returned error can't find the container with id 8408d82f1fb93a650ffc27b3168c733a80ab49032d27f367293373d1e3c832f7
Jul 15 12:24:33.962749 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.962708    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h4cwj"]
Jul 15 12:24:33.965042 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.964998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:33.966037 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:33.966020    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacbe397a_608d_479c_8ccb_d115d7761632.slice/crio-4b331aac9b3ef6622b73b649d08874ebcd19a442e06c0ceabdf81be3db6bbf23 WatchSource:0}: Error finding container 4b331aac9b3ef6622b73b649d08874ebcd19a442e06c0ceabdf81be3db6bbf23: Status 404 returned error can't find the container with id 4b331aac9b3ef6622b73b649d08874ebcd19a442e06c0ceabdf81be3db6bbf23
Jul 15 12:24:33.991897 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:33.991864    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-587665fbc5-9qpxs"]
Jul 15 12:24:33.995031 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:33.995010    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod867d262e_e8f6_4362_9f18_a2f9596f7068.slice/crio-3565fa92b62155823d675e40c11fffc7872932c9201a3bdae0da7d6bed62b3ac WatchSource:0}: Error finding container 3565fa92b62155823d675e40c11fffc7872932c9201a3bdae0da7d6bed62b3ac: Status 404 returned error can't find the container with id 3565fa92b62155823d675e40c11fffc7872932c9201a3bdae0da7d6bed62b3ac
Jul 15 12:24:34.120848 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.120815    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:34.352212 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.352180    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h4cwj" event={"ID":"acbe397a-608d-479c-8ccb-d115d7761632","Type":"ContainerStarted","Data":"4b331aac9b3ef6622b73b649d08874ebcd19a442e06c0ceabdf81be3db6bbf23"}
Jul 15 12:24:34.354202 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.354173    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-587665fbc5-9qpxs" event={"ID":"867d262e-e8f6-4362-9f18-a2f9596f7068","Type":"ContainerStarted","Data":"9a38abd902f0623292e286c7f03a4b0df5ba8e5283b5ee9ef0cbc77a931a7c8a"}
Jul 15 12:24:34.354327 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.354220    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-587665fbc5-9qpxs" event={"ID":"867d262e-e8f6-4362-9f18-a2f9596f7068","Type":"ContainerStarted","Data":"3565fa92b62155823d675e40c11fffc7872932c9201a3bdae0da7d6bed62b3ac"}
Jul 15 12:24:34.354327 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.354274    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:34.355355 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.355337    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq" event={"ID":"42931105-92dc-4a1e-9d53-032ca7cf4dbb","Type":"ContainerStarted","Data":"6d04d0407dd4e35e91a4519fdd3d59b7a1c08706926d06b1a33742347c47bb3a"}
Jul 15 12:24:34.356370 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.356348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l859h" event={"ID":"3212bd1a-0f38-44b5-8386-78980c558ae8","Type":"ContainerStarted","Data":"8408d82f1fb93a650ffc27b3168c733a80ab49032d27f367293373d1e3c832f7"}
Jul 15 12:24:34.357293 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.357272    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27bdz" event={"ID":"0c3eea0b-2153-47de-820d-8df00a08fda9","Type":"ContainerStarted","Data":"559e7982711a2e85b89a8cd6865415b1daf8247a8bfb0b3827e39c2d9912cbb6"}
Jul 15 12:24:34.358436 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.358409    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh" event={"ID":"429bb970-2599-429e-b85b-3f0c1430ee6d","Type":"ContainerStarted","Data":"02d952bdde6c1d6fad4fc6df64670f5a6d8ef82334156361a1bdf6fb8d974117"}
Jul 15 12:24:34.359914 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.359894    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74547b979d-m69f7" event={"ID":"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e","Type":"ContainerStarted","Data":"f5a49cf0ed42fa8c5867a8394df8c8d7b12633b99ce8364c294fc48b94e633b5"}
Jul 15 12:24:34.360015 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.359930    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74547b979d-m69f7" event={"ID":"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e","Type":"ContainerStarted","Data":"2db493bd8a352993762ba0ab0c9f4e359b4750dc3050d0f41313d7c1e3b60f39"}
Jul 15 12:24:34.360015 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.359983    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:34.360936 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.360916    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r" event={"ID":"4e43da9f-dc1c-4178-a56c-117a8aa3fea1","Type":"ContainerStarted","Data":"ccd66e7f9701748630ec6bc4b90c213637db062b92dd2f6db64b6426dce6cd03"}
Jul 15 12:24:34.379695 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.379655    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-587665fbc5-9qpxs" podStartSLOduration=1.379640819 podStartE2EDuration="1.379640819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:34.378567739 +0000 UTC m=+57.927068005" watchObservedRunningTime="2026-07-15 12:24:34.379640819 +0000 UTC m=+57.928141077"
Jul 15 12:24:34.408773 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:34.408704    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74547b979d-m69f7" podStartSLOduration=34.408691706 podStartE2EDuration="34.408691706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:34.407894843 +0000 UTC m=+57.956395121" watchObservedRunningTime="2026-07-15 12:24:34.408691706 +0000 UTC m=+57.957191973"
Jul 15 12:24:38.304107 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:38.304072    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g7dvp"
Jul 15 12:24:38.469844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:38.469674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:38.567977 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:38.567895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:38.673234 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:38.673201    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:38.769562 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:38.769532    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:39.351526 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:39.351497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:39.414448 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:39.414408    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:40.750928 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:40.750895    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:40.817300 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:40.817261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:41.524579 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:41.524488    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:41.622807 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:41.622701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:41.773135 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:41.773097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:41.876270 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:41.876235    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:42.703285 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.703244    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:42.706448 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.706423    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 12:24:42.716005 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.715984    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f0dc592e-48df-4b09-833b-a67f2aba01df-metrics-certs\") pod \"network-metrics-daemon-rf9sm\" (UID: \"f0dc592e-48df-4b09-833b-a67f2aba01df\") " pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:42.804709 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.804667    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:42.807854 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.807831    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 12:24:42.817565 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.817539    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cd5cd303-19ae-4714-99cd-cc9c52d28904-original-pull-secret\") pod \"global-pull-secret-syncer-6lbpz\" (UID: \"cd5cd303-19ae-4714-99cd-cc9c52d28904\") " pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:42.825898 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.825879    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2twz\""
Jul 15 12:24:42.833537 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.833519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rf9sm"
Jul 15 12:24:42.906086 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.906042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:42.909246 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.909226    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 12:24:42.919451 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.919423    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 12:24:42.929917 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.929887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtslz\" (UniqueName: \"kubernetes.io/projected/aed94bd9-1d76-428b-9210-d2af97432b38-kube-api-access-qtslz\") pod \"network-check-target-rb2j5\" (UID: \"aed94bd9-1d76-428b-9210-d2af97432b38\") " pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:42.930018 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:42.929995    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6lbpz"
Jul 15 12:24:43.227929 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:43.227896    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qvxmk\""
Jul 15 12:24:43.235295 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:43.235267    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:44.406944 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:44.406873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh" event={"ID":"429bb970-2599-429e-b85b-3f0c1430ee6d","Type":"ContainerStarted","Data":"e2be788bc86fc025484187a6320211cc215f0a6ca22385127dcdec64c189216e"}
Jul 15 12:24:44.449055 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:44.449028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rb2j5"]
Jul 15 12:24:44.470421 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:44.470386    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed94bd9_1d76_428b_9210_d2af97432b38.slice/crio-0006a866ca06fe56583e71f2f41b2bbb30d3e27276c25888e79ddb44ee3adbc6 WatchSource:0}: Error finding container 0006a866ca06fe56583e71f2f41b2bbb30d3e27276c25888e79ddb44ee3adbc6: Status 404 returned error can't find the container with id 0006a866ca06fe56583e71f2f41b2bbb30d3e27276c25888e79ddb44ee3adbc6
Jul 15 12:24:44.480926 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:44.479970    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rf9sm"]
Jul 15 12:24:44.512712 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:44.511934    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6lbpz"]
Jul 15 12:24:45.421537 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.421495    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq" event={"ID":"42931105-92dc-4a1e-9d53-032ca7cf4dbb","Type":"ContainerStarted","Data":"c24bcef23b7235c2cd7cae7cad175f9cfc2e42bd9eb90089112e45540b49b9e3"}
Jul 15 12:24:45.422013 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.421796    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:45.426137 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.425998    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq"
Jul 15 12:24:45.426844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.426742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l859h" event={"ID":"3212bd1a-0f38-44b5-8386-78980c558ae8","Type":"ContainerStarted","Data":"5eba683fe863155ffc42373d9fabcf75763211daa3ebc1c0d7f58c0daf0ba5f8"}
Jul 15 12:24:45.426844 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.426790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-l859h" event={"ID":"3212bd1a-0f38-44b5-8386-78980c558ae8","Type":"ContainerStarted","Data":"f0e3e60f217b88f1e547620efb617c229d11d6da466e53fc9ac95d1c63aacf91"}
Jul 15 12:24:45.427313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.427219    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:45.429521 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.429497    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27bdz" event={"ID":"0c3eea0b-2153-47de-820d-8df00a08fda9","Type":"ContainerStarted","Data":"b7fd5a010539c54ca6fe9e01416b2f69aa10fcbb232a69fa292aea011d9f0da6"}
Jul 15 12:24:45.436236 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.436208    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh" event={"ID":"429bb970-2599-429e-b85b-3f0c1430ee6d","Type":"ContainerStarted","Data":"f46ba6b1172f93df7f2f1237714c24b0d0ba3134fefbeeca6d98ada794130f89"}
Jul 15 12:24:45.436338 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.436251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh" event={"ID":"429bb970-2599-429e-b85b-3f0c1430ee6d","Type":"ContainerStarted","Data":"8e04399906a20b2aaedc0c5385fe6bd8ad6acd0ede9b33ad4dd1afcd9506cb49"}
Jul 15 12:24:45.439269 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.439219    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6lbpz" event={"ID":"cd5cd303-19ae-4714-99cd-cc9c52d28904","Type":"ContainerStarted","Data":"89315889ad15568b772ee8b1215bde3eee011fd71cdab55183af7a4cf7b9c6ff"}
Jul 15 12:24:45.441877 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.441449    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r" event={"ID":"4e43da9f-dc1c-4178-a56c-117a8aa3fea1","Type":"ContainerStarted","Data":"c3981e6f018879804a398cac082a3a052b93ae4393a14d18bbbfb1e37f31796c"}
Jul 15 12:24:45.443834 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.443763    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rb2j5" event={"ID":"aed94bd9-1d76-428b-9210-d2af97432b38","Type":"ContainerStarted","Data":"0006a866ca06fe56583e71f2f41b2bbb30d3e27276c25888e79ddb44ee3adbc6"}
Jul 15 12:24:45.446924 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.445806    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f4dd47486-szmsq" podStartSLOduration=2.230819249 podStartE2EDuration="12.445788865s" totalImagesPullingTime="10.214969616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:45.444699495 +0000 UTC m=+68.993199762" watchObservedRunningTime="2026-07-15 12:24:45.445788865 +0000 UTC m=+68.994289112"
Jul 15 12:24:45.449739 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.448671    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h4cwj" event={"ID":"acbe397a-608d-479c-8ccb-d115d7761632","Type":"ContainerStarted","Data":"95d8e9b47ae76ce4bd86ccc61a75a08ed4f66811d6268e6d55229fbd2be13a44"}
Jul 15 12:24:45.452053 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.452028    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rf9sm" event={"ID":"f0dc592e-48df-4b09-833b-a67f2aba01df","Type":"ContainerStarted","Data":"654e1d5cb4540e92d0b072e8a65a3f68444bede3bae30ffee4dbedfb3971e091"}
Jul 15 12:24:45.467093 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.466941    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-789f564c94-nsn7r" podStartSLOduration=1.910900844 podStartE2EDuration="12.466924981s" totalImagesPullingTime="10.556024137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:45.465889308 +0000 UTC m=+69.014389575" watchObservedRunningTime="2026-07-15 12:24:45.466924981 +0000 UTC m=+69.015425253"
Jul 15 12:24:45.518159 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.517825    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-bdc97c65f-8k4vh" podStartSLOduration=2.317871721 podStartE2EDuration="12.517805625s" totalImagesPullingTime="10.199933904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:45.5165943 +0000 UTC m=+69.065094562" watchObservedRunningTime="2026-07-15 12:24:45.517805625 +0000 UTC m=+69.066305906"
Jul 15 12:24:45.543480 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.542284    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-l859h" podStartSLOduration=2.569668416 podStartE2EDuration="12.54226433s" totalImagesPullingTime="9.972595914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:45.541626651 +0000 UTC m=+69.090126918" watchObservedRunningTime="2026-07-15 12:24:45.54226433 +0000 UTC m=+69.090764579"
Jul 15 12:24:45.572289 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.572131    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h4cwj" podStartSLOduration=2.61490462 podStartE2EDuration="12.57211132s" totalImagesPullingTime="9.9572067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:45.569952893 +0000 UTC m=+69.118453165" watchObservedRunningTime="2026-07-15 12:24:45.57211132 +0000 UTC m=+69.120611587"
Jul 15 12:24:45.623917 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.623837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:45.720736 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:45.720691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:46.458804 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:46.458428    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rf9sm" event={"ID":"f0dc592e-48df-4b09-833b-a67f2aba01df","Type":"ContainerStarted","Data":"0c64b31b484da27faaa836999d107438913b51f21a3d43d0c47afc8803f5c82e"}
Jul 15 12:24:46.458804 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:46.458487    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rf9sm" event={"ID":"f0dc592e-48df-4b09-833b-a67f2aba01df","Type":"ContainerStarted","Data":"4cfae0306a465a6c0b9c8108a1122553dc9d719a6aac038c4fa044a84bd4291e"}
Jul 15 12:24:46.489066 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:46.489019    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rf9sm" podStartSLOduration=68.285740021 podStartE2EDuration="1m9.489000212s" totalImagesPullingTime="1.203260191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:46.487932978 +0000 UTC m=+70.036433239" watchObservedRunningTime="2026-07-15 12:24:46.489000212 +0000 UTC m=+70.037500481"
Jul 15 12:24:46.626317 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:46.626104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:46.724134 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:46.724047    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:48.403970 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:48.403931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:48.465044 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:48.465008    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:49.807512 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:49.807478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:50.827105 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:50.827066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:50.940348 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:50.940321    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:51.480147 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:51.480106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6lbpz" event={"ID":"cd5cd303-19ae-4714-99cd-cc9c52d28904","Type":"ContainerStarted","Data":"a653b15222b637c9d563788406e4af21c873d1a85a4cdb5f2084bd4ec4bd1ca4"}
Jul 15 12:24:51.481741 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:51.481690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rb2j5" event={"ID":"aed94bd9-1d76-428b-9210-d2af97432b38","Type":"ContainerStarted","Data":"e9ee08978201d83bb6f108c8ae900bcb1f27449f85a8825674cc4fcd47d5dfee"}
Jul 15 12:24:51.481849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:51.481765    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:24:51.483759 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:51.483684    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27bdz" event={"ID":"0c3eea0b-2153-47de-820d-8df00a08fda9","Type":"ContainerStarted","Data":"fe8a58e8ab91b7da8cadc1d009ef50302af64254a89545074519e8ad56a8c1bb"}
Jul 15 12:24:51.498188 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:51.498146    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6lbpz" podStartSLOduration=68.094569386 podStartE2EDuration="1m14.498132213s" totalImagesPullingTime="6.403562827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:51.497205212 +0000 UTC m=+75.045705490" watchObservedRunningTime="2026-07-15 12:24:51.498132213 +0000 UTC m=+75.046632479"
Jul 15 12:24:51.515056 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:51.515015    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rb2j5" podStartSLOduration=68.096980226 podStartE2EDuration="1m14.515001292s" totalImagesPullingTime="6.418021066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:51.514878642 +0000 UTC m=+75.063378911" watchObservedRunningTime="2026-07-15 12:24:51.515001292 +0000 UTC m=+75.063501560"
Jul 15 12:24:52.723266 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:52.723236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:52.783179 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:52.783141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:53.677905 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:53.677870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:53.779821 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:53.779786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:53.834253 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:53.834215    2563 patch_prober.go:28] interesting pod/image-registry-587665fbc5-9qpxs container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 15 12:24:53.834408 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:53.834281    2563 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-587665fbc5-9qpxs" podUID="867d262e-e8f6-4362-9f18-a2f9596f7068" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:24:53.882554 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:53.882521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:53.983121 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:53.983042    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:54.366452 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:54.366434    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:54.496800 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:54.496766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27bdz" event={"ID":"0c3eea0b-2153-47de-820d-8df00a08fda9","Type":"ContainerStarted","Data":"32561df80e11e24719d6d44d91acb3a795226e86b6743374d746a81a79ab02c8"}
Jul 15 12:24:54.523707 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:54.523652    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-27bdz" podStartSLOduration=1.183641229 podStartE2EDuration="21.523634743s" totalImagesPullingTime="20.339993514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:24:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:24:54.522553278 +0000 UTC m=+78.071053545" watchObservedRunningTime="2026-07-15 12:24:54.523634743 +0000 UTC m=+78.072135009"
Jul 15 12:24:55.373017 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:55.372990    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-587665fbc5-9qpxs"
Jul 15 12:24:55.461048 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:55.461015    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-l859h"
Jul 15 12:24:55.601970 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:55.601939    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:55.690170 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:55.690093    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:55.790288 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:55.790248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:57.359069 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:57.359016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.014811 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.014768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.148488 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.148456    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.378494 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.378379    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74547b979d-m69f7" podUID="6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" containerName="registry" containerID="cri-o://f5a49cf0ed42fa8c5867a8394df8c8d7b12633b99ce8364c294fc48b94e633b5" gracePeriod=30
Jul 15 12:24:59.400444 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.400415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.514879 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.514849    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.517992 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.517971    2563 generic.go:356] "Generic (PLEG): container finished" podID="6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" containerID="f5a49cf0ed42fa8c5867a8394df8c8d7b12633b99ce8364c294fc48b94e633b5" exitCode=0
Jul 15 12:24:59.518099 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.518023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74547b979d-m69f7" event={"ID":"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e","Type":"ContainerDied","Data":"f5a49cf0ed42fa8c5867a8394df8c8d7b12633b99ce8364c294fc48b94e633b5"}
Jul 15 12:24:59.546492 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.546471    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vqgf2"]
Jul 15 12:24:59.549308 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.549282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.553183 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.553161    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 12:24:59.553291 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.553161    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 12:24:59.553883 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.553867    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 12:24:59.554362 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.554347    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 12:24:59.554434 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.554374    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 12:24:59.554434 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.554374    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2f47l\""
Jul 15 12:24:59.554564 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.554353    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 12:24:59.621261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.621238    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:24:59.639621 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.639621 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639597    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-tls\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.639621 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-wtmp\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.639808 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639638    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-root\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.639808 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639653    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpq86\" (UniqueName: \"kubernetes.io/projected/3d99201d-9084-4959-81e1-99d9b468c588-kube-api-access-rpq86\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.639808 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639702    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.639808 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-textfile\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.639808 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-sys\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.639957 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.639844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d99201d-9084-4959-81e1-99d9b468c588-metrics-client-ca\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.712749 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.712695    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.740230 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740207    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-image-registry-private-configuration\") pod \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") "
Jul 15 12:24:59.740400 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740239    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-blxd8\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-kube-api-access-blxd8\") pod \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") "
Jul 15 12:24:59.740400 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740267    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-tls\") pod \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") "
Jul 15 12:24:59.740400 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740297    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-ca-trust-extracted\") pod \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") "
Jul 15 12:24:59.740400 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740329    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-certificates\") pod \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") "
Jul 15 12:24:59.740400 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740353    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-installation-pull-secrets\") pod \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") "
Jul 15 12:24:59.740400 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740392    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-trusted-ca\") pod \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") "
Jul 15 12:24:59.740768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740421    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-bound-sa-token\") pod \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\" (UID: \"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e\") "
Jul 15 12:24:59.740768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740578    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d99201d-9084-4959-81e1-99d9b468c588-metrics-client-ca\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.740768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.740768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740659    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-tls\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.740768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-wtmp\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.740768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740741    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-root\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.740768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740765    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpq86\" (UniqueName: \"kubernetes.io/projected/3d99201d-9084-4959-81e1-99d9b468c588-kube-api-access-rpq86\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.741099 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740801    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.741099 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740827    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-textfile\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.741099 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740860    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-sys\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.741099 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740941    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-sys\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.741099 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.740995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" (UID: "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:24:59.741099 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.741060    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-wtmp\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.741375 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.741104    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/3d99201d-9084-4959-81e1-99d9b468c588-root\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.741432 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.741376    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" (UID: "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:24:59.741738 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.741692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-textfile\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.742964 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.742466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d99201d-9084-4959-81e1-99d9b468c588-metrics-client-ca\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.742964 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.742930    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-accelerators-collector-config\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.744668 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.743827    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" (UID: "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:24:59.744668 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.744089    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" (UID: "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:24:59.744668 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.744237    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" (UID: "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:24:59.744959 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.744782    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.744959 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.744912    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/3d99201d-9084-4959-81e1-99d9b468c588-node-exporter-tls\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.745068 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.745022    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-kube-api-access-blxd8" (OuterVolumeSpecName: "kube-api-access-blxd8") pod "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" (UID: "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e"). InnerVolumeSpecName "kube-api-access-blxd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:24:59.746586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.746563    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" (UID: "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:24:59.751913 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.751889    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" (UID: "6bf9c5a6-0300-401f-b3a1-c25ffbfb054e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:24:59.759874 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.759855    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpq86\" (UniqueName: \"kubernetes.io/projected/3d99201d-9084-4959-81e1-99d9b468c588-kube-api-access-rpq86\") pod \"node-exporter-vqgf2\" (UID: \"3d99201d-9084-4959-81e1-99d9b468c588\") " pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.802860 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.802830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.841669 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.841645    2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-image-registry-private-configuration\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:24:59.841669 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.841668    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-blxd8\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-kube-api-access-blxd8\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:24:59.841814 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.841677    2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:24:59.841814 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.841687    2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-ca-trust-extracted\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:24:59.841814 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.841695    2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-registry-certificates\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:24:59.841814 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.841703    2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-installation-pull-secrets\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:24:59.841814 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.841719    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-trusted-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:24:59.841814 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.841746    2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e-bound-sa-token\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:24:59.858736 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.858693    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vqgf2"
Jul 15 12:24:59.869970 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:24:59.869944    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d99201d_9084_4959_81e1_99d9b468c588.slice/crio-0be4c948c00843d6bb2b02ff09d65f82c411002bea84db444a8ea62623ef2334 WatchSource:0}: Error finding container 0be4c948c00843d6bb2b02ff09d65f82c411002bea84db444a8ea62623ef2334: Status 404 returned error can't find the container with id 0be4c948c00843d6bb2b02ff09d65f82c411002bea84db444a8ea62623ef2334
Jul 15 12:24:59.909487 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:24:59.909419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:00.249918 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.249840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:00.396961 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.396929    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:00.495180 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.495150    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:00.523245 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.523172    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74547b979d-m69f7"
Jul 15 12:25:00.523245 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.523177    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74547b979d-m69f7" event={"ID":"6bf9c5a6-0300-401f-b3a1-c25ffbfb054e","Type":"ContainerDied","Data":"2db493bd8a352993762ba0ab0c9f4e359b4750dc3050d0f41313d7c1e3b60f39"}
Jul 15 12:25:00.523245 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.523231    2563 scope.go:117] "RemoveContainer" containerID="f5a49cf0ed42fa8c5867a8394df8c8d7b12633b99ce8364c294fc48b94e633b5"
Jul 15 12:25:00.524821 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.524381    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqgf2" event={"ID":"3d99201d-9084-4959-81e1-99d9b468c588","Type":"ContainerStarted","Data":"0be4c948c00843d6bb2b02ff09d65f82c411002bea84db444a8ea62623ef2334"}
Jul 15 12:25:00.558523 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.558488    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74547b979d-m69f7"]
Jul 15 12:25:00.565955 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.565931    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74547b979d-m69f7"]
Jul 15 12:25:00.627804 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.627761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:00.764808 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:00.764776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:01.018512 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:01.018482    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" path="/var/lib/kubelet/pods/6bf9c5a6-0300-401f-b3a1-c25ffbfb054e/volumes"
Jul 15 12:25:01.533298 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:01.533264    2563 generic.go:356] "Generic (PLEG): container finished" podID="3d99201d-9084-4959-81e1-99d9b468c588" containerID="670cb3a4a4700bff36e2485e995776e195656b39a45c8e9ec8cbfd9de51eff8a" exitCode=0
Jul 15 12:25:01.533656 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:01.533334    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqgf2" event={"ID":"3d99201d-9084-4959-81e1-99d9b468c588","Type":"ContainerDied","Data":"670cb3a4a4700bff36e2485e995776e195656b39a45c8e9ec8cbfd9de51eff8a"}
Jul 15 12:25:02.408246 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.408215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:02.513373 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.513340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:02.539338 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.539310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqgf2" event={"ID":"3d99201d-9084-4959-81e1-99d9b468c588","Type":"ContainerStarted","Data":"7ddf5bd16f8a71b702dfafb5909f222eef6567107ed3517554f4a35da951fd64"}
Jul 15 12:25:02.539672 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.539359    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vqgf2" event={"ID":"3d99201d-9084-4959-81e1-99d9b468c588","Type":"ContainerStarted","Data":"50af414128ea7a39341ca2b42418e6a6ca755008463cb2fc782635143a622b70"}
Jul 15 12:25:02.572135 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.572087    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vqgf2" podStartSLOduration=2.57720815 podStartE2EDuration="3.572072547s" totalImagesPullingTime="934.978222ms" totalInitContainerRuntime="59.886175ms" isStatefulPod=true podCreationTimestamp="2026-07-15 12:24:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:25:02.57120805 +0000 UTC m=+86.119708329" watchObservedRunningTime="2026-07-15 12:25:02.572072547 +0000 UTC m=+86.120572813"
Jul 15 12:25:02.606627 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.606596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:02.721154 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.721078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:02.812890 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.812857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:02.909859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:02.909826    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:03.132649 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:03.132619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:03.227873 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:03.227837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:04.037750 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:04.037690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:04.175492 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:04.175457    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:04.277552 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:04.277518    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:04.766086 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:04.766052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:04.829891 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:04.829865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:05.759339 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:05.759302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:07.313322 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:07.313286    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:07.413790 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:07.413754    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:08.677633 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:08.677597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:08.779674 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:08.779618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:09.943056 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:09.943022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:10.043614 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:10.043575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:12.216684 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:12.216628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:12.278301 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:12.278274    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:13.871851 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:13.871799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:13.965392 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:13.965349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:15.044770 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:15.044736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:15.148906 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:15.148872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:15.228828 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:15.228796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:15.795947 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:15.795909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:15.896910 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:15.896877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:15.998772 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:15.998718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:22.489170 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:22.489140    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rb2j5"
Jul 15 12:25:23.669561 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:23.669514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:23.773285 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:23.773248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:38.673151 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:38.673111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:38.778892 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:38.778857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:46.959952 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:46.959915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:47.040694 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:25:47.040661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:19.055034 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:19.055001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:19.176121 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:19.176087    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:27.987800 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:27.987765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:28.051202 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:28.051167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:28.112091 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:28.112050    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:28.712215 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:28.712179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:28.796014 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:28.795985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:34.352436 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:34.352353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:34.421998 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:34.421961    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:45.282828 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:45.282789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:45.382840 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:45.382812    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:45.457150 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:45.457107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:46.293788 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:46.293749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:46.383059 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:46.383016    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:51.504101 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:51.504066    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:53.684757 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:53.684699    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:53.790985 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:53.790946    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:53.878706 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:53.878671    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:58.843632 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:58.843596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:58.985759 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:26:58.985694    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:22.266554 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:27:22.266515    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:30.431217 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:27:30.431180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:30.554430 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:27:30.554387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:57.350898 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:27:57.350860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:58.462779 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:27:58.462740    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:01.403000 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:01.402969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:01.528418 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:01.528388    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:03.989242 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:03.989198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:04.158984 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:04.158945    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:04.322874 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:04.322840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:04.490013 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:04.489979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:06.333403 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:06.333365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:06.981139 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:06.981091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:14.890779 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:14.890683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:14.981768 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:14.981707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:15.281202 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:15.281113    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:20.443668 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:20.443626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:20.580772 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:20.580716    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:22.522859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:22.522824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:34.033175 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:34.033141    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:34.133272 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:34.133232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:34.649030 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:34.648995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:35.053574 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.053527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:35.157825 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.157785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:35.211048 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.211017    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"]
Jul 15 12:28:35.211355 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.211336    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" containerName="registry"
Jul 15 12:28:35.211407 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.211359    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" containerName="registry"
Jul 15 12:28:35.211447 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.211436    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bf9c5a6-0300-401f-b3a1-c25ffbfb054e" containerName="registry"
Jul 15 12:28:35.213311 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.213289    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.220400 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.220379    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 12:28:35.220649 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.220615    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 12:28:35.220758 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.220692    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 12:28:35.220817 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.220758    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vq7wd\""
Jul 15 12:28:35.221242 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.221228    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 12:28:35.238296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.238269    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"]
Jul 15 12:28:35.335108 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.335027    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3420c80d-0029-4625-89e8-8dadaf615d69-tmp\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.335108 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.335065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3420c80d-0029-4625-89e8-8dadaf615d69-manifests\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.335108 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.335106    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3420c80d-0029-4625-89e8-8dadaf615d69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.335307 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.335123    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3420c80d-0029-4625-89e8-8dadaf615d69-webhook-cert\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.335307 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.335151    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf8q8\" (UniqueName: \"kubernetes.io/projected/3420c80d-0029-4625-89e8-8dadaf615d69-kube-api-access-jf8q8\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.377261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.377224    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:35.436233 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.436207    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3420c80d-0029-4625-89e8-8dadaf615d69-tmp\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.436368 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.436241    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3420c80d-0029-4625-89e8-8dadaf615d69-manifests\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.436368 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.436287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3420c80d-0029-4625-89e8-8dadaf615d69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.436368 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.436309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3420c80d-0029-4625-89e8-8dadaf615d69-webhook-cert\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.436368 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.436353    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf8q8\" (UniqueName: \"kubernetes.io/projected/3420c80d-0029-4625-89e8-8dadaf615d69-kube-api-access-jf8q8\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.436685 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.436665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3420c80d-0029-4625-89e8-8dadaf615d69-manifests\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.438515 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.438473    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3420c80d-0029-4625-89e8-8dadaf615d69-tmp\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.438621 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.438560    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3420c80d-0029-4625-89e8-8dadaf615d69-webhook-cert\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.438621 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.438571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3420c80d-0029-4625-89e8-8dadaf615d69-apiservice-cert\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.457543 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.457522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf8q8\" (UniqueName: \"kubernetes.io/projected/3420c80d-0029-4625-89e8-8dadaf615d69-kube-api-access-jf8q8\") pod \"opendatahub-operator-controller-manager-654f68fd79-xdtsd\" (UID: \"3420c80d-0029-4625-89e8-8dadaf615d69\") " pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.477435 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.477403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:35.523272 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.523247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:35.577956 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.577904    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:35.709917 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.709884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:35.785666 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.785627    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"]
Jul 15 12:28:35.791067 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:28:35.791043    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3420c80d_0029_4625_89e8_8dadaf615d69.slice/crio-4e44e64ac5d77c8bf528b3335ef21bc4b6c8405a4992bb4783f2a0a961f0c0e4 WatchSource:0}: Error finding container 4e44e64ac5d77c8bf528b3335ef21bc4b6c8405a4992bb4783f2a0a961f0c0e4: Status 404 returned error can't find the container with id 4e44e64ac5d77c8bf528b3335ef21bc4b6c8405a4992bb4783f2a0a961f0c0e4
Jul 15 12:28:35.844399 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.844368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:35.933258 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:35.933163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:36.218794 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:36.218700    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd" event={"ID":"3420c80d-0029-4625-89e8-8dadaf615d69","Type":"ContainerStarted","Data":"4e44e64ac5d77c8bf528b3335ef21bc4b6c8405a4992bb4783f2a0a961f0c0e4"}
Jul 15 12:28:36.882258 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:36.882161    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:28:36.884679 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:36.884589    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:28:36.889809 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:36.889790    2563 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 12:28:38.888227 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:38.888125    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:39.231996 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:39.231909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd" event={"ID":"3420c80d-0029-4625-89e8-8dadaf615d69","Type":"ContainerStarted","Data":"1d2b6aa1fc00612155729d0bac3ecf469532822fd105cd29ba54b1085feb5dd2"}
Jul 15 12:28:40.236477 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:40.236444    2563 generic.go:356] "Generic (PLEG): container finished" podID="3420c80d-0029-4625-89e8-8dadaf615d69" containerID="1d2b6aa1fc00612155729d0bac3ecf469532822fd105cd29ba54b1085feb5dd2" exitCode=0
Jul 15 12:28:40.236477 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:40.236481    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd" event={"ID":"3420c80d-0029-4625-89e8-8dadaf615d69","Type":"ContainerDied","Data":"1d2b6aa1fc00612155729d0bac3ecf469532822fd105cd29ba54b1085feb5dd2"}
Jul 15 12:28:40.237108 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:40.237089    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:28:40.957294 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:40.957257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:41.019916 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:41.019870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:43.247650 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:43.247610    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd" event={"ID":"3420c80d-0029-4625-89e8-8dadaf615d69","Type":"ContainerStarted","Data":"adc2db98710c18521f09bc5ebc7817e4dbaafc9a3aa9ea74c306e512b0d1e609"}
Jul 15 12:28:43.248055 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:43.247764    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:43.289926 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:43.289880    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd" podStartSLOduration=1.588208618 podStartE2EDuration="8.289867058s" totalImagesPullingTime="5.619597553s" totalInitContainerRuntime="1.082060887s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:28:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:28:43.288933629 +0000 UTC m=+306.837433920" watchObservedRunningTime="2026-07-15 12:28:43.289867058 +0000 UTC m=+306.838367326"
Jul 15 12:28:54.252621 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:54.252585    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-654f68fd79-xdtsd"
Jul 15 12:28:55.411158 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.411083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:55.518456 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.518419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:55.609627 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.609596    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"]
Jul 15 12:28:55.623661 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.623637    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.630478 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.630452    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 12:28:55.631506 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.631476    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:28:55.631506 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.631501    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 12:28:55.631655 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.631537    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 12:28:55.631655 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.631580    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bc66d\""
Jul 15 12:28:55.631813 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.631800    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 12:28:55.673558 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.673493    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"]
Jul 15 12:28:55.695879 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.695853    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa63c347-d082-41bd-bab7-13b864ff331a-metrics-cert\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.695992 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.695890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa63c347-d082-41bd-bab7-13b864ff331a-manager-config\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.695992 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.695913    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa63c347-d082-41bd-bab7-13b864ff331a-cert\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.696078 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.695985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsxx9\" (UniqueName: \"kubernetes.io/projected/fa63c347-d082-41bd-bab7-13b864ff331a-kube-api-access-xsxx9\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.797261 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.797217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa63c347-d082-41bd-bab7-13b864ff331a-metrics-cert\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.797456 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.797274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa63c347-d082-41bd-bab7-13b864ff331a-manager-config\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.797456 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.797307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa63c347-d082-41bd-bab7-13b864ff331a-cert\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.797456 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.797344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xsxx9\" (UniqueName: \"kubernetes.io/projected/fa63c347-d082-41bd-bab7-13b864ff331a-kube-api-access-xsxx9\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.798075 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.798053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fa63c347-d082-41bd-bab7-13b864ff331a-manager-config\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.799596 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.799576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fa63c347-d082-41bd-bab7-13b864ff331a-metrics-cert\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.799739 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.799708    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa63c347-d082-41bd-bab7-13b864ff331a-cert\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.832457 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.832436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:55.833962 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.833942    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsxx9\" (UniqueName: \"kubernetes.io/projected/fa63c347-d082-41bd-bab7-13b864ff331a-kube-api-access-xsxx9\") pod \"lws-controller-manager-849c5974c6-m5ttm\" (UID: \"fa63c347-d082-41bd-bab7-13b864ff331a\") " pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.932177 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.932107    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:55.942188 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:55.942156    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:56.121326 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:28:56.121298    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa63c347_d082_41bd_bab7_13b864ff331a.slice/crio-c38fa4f8f06e46bef0f6cd4b4a5dcbacfbcbd177242918f11569e004a71b9766 WatchSource:0}: Error finding container c38fa4f8f06e46bef0f6cd4b4a5dcbacfbcbd177242918f11569e004a71b9766: Status 404 returned error can't find the container with id c38fa4f8f06e46bef0f6cd4b4a5dcbacfbcbd177242918f11569e004a71b9766
Jul 15 12:28:56.122387 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:56.122347    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"]
Jul 15 12:28:56.289108 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:56.289037    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm" event={"ID":"fa63c347-d082-41bd-bab7-13b864ff331a","Type":"ContainerStarted","Data":"c38fa4f8f06e46bef0f6cd4b4a5dcbacfbcbd177242918f11569e004a71b9766"}
Jul 15 12:28:56.620858 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:56.620825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:56.736436 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:56.736393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:57.492696 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:57.492657    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:57.816326 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:57.816281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:58.664098 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:58.664061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:59.074187 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:59.074152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:59.293604 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:59.293565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:59.301551 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:59.301519    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm" event={"ID":"fa63c347-d082-41bd-bab7-13b864ff331a","Type":"ContainerStarted","Data":"4f26c3d04b429a4cfbeaa133987c15405155ef21527079c75405aecd6a5c6a08"}
Jul 15 12:28:59.301673 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:59.301640    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:28:59.340423 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:28:59.340344    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm" podStartSLOduration=1.927159905 podStartE2EDuration="4.340331704s" totalImagesPullingTime="2.413171799s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:28:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:28:59.339468747 +0000 UTC m=+322.887969015" watchObservedRunningTime="2026-07-15 12:28:59.340331704 +0000 UTC m=+322.888831971"
Jul 15 12:29:00.268420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:00.268383    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:00.575568 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:00.575540    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:00.662427 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:00.662389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:01.166934 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:01.166900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:02.384466 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:02.384435    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:05.968462 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.968425    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"]
Jul 15 12:29:05.971515 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.971484    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:05.979019 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.978996    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 15 12:29:05.979019 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.979009    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 12:29:05.979164 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.978998    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 15 12:29:05.979164 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.979012    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 15 12:29:05.979432 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.979419    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-68vdk\""
Jul 15 12:29:05.979645 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.979629    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 15 12:29:05.979857 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:05.979842    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 12:29:06.015519 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.015491    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"]
Jul 15 12:29:06.073482 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.073454    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.073627 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.073499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.073627 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.073534    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.073627 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.073595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.073627 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.073627    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4d5e62e-7344-4f06-acd8-f24543f7de82-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.073822 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.073647    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.073822 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.073707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgnxx\" (UniqueName: \"kubernetes.io/projected/e4d5e62e-7344-4f06-acd8-f24543f7de82-kube-api-access-vgnxx\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.174690 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.174654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgnxx\" (UniqueName: \"kubernetes.io/projected/e4d5e62e-7344-4f06-acd8-f24543f7de82-kube-api-access-vgnxx\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.174690 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.174696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.174919 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.174745    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.174919 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.174768    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.174919 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.174797    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.174919 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.174816    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4d5e62e-7344-4f06-acd8-f24543f7de82-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.174919 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.174836    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.175568 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.175543    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.177196 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.177173    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.177335 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.177314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.177432 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.177414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4d5e62e-7344-4f06-acd8-f24543f7de82-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.177622 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.177602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.189217 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.189195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4d5e62e-7344-4f06-acd8-f24543f7de82-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.190798 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.190781    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgnxx\" (UniqueName: \"kubernetes.io/projected/e4d5e62e-7344-4f06-acd8-f24543f7de82-kube-api-access-vgnxx\") pod \"istiod-openshift-gateway-94bb8fbfd-bxgt5\" (UID: \"e4d5e62e-7344-4f06-acd8-f24543f7de82\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.280465 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.280384    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:06.415433 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:06.415411    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"]
Jul 15 12:29:06.417822 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:29:06.417793    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d5e62e_7344_4f06_acd8_f24543f7de82.slice/crio-0d28b658fc93163254417d9763edfadc5819f00f94f6ee57b4a75ac8130925fd WatchSource:0}: Error finding container 0d28b658fc93163254417d9763edfadc5819f00f94f6ee57b4a75ac8130925fd: Status 404 returned error can't find the container with id 0d28b658fc93163254417d9763edfadc5819f00f94f6ee57b4a75ac8130925fd
Jul 15 12:29:07.059255 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:07.059166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:07.188567 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:07.188483    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:07.329314 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:07.329231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5" event={"ID":"e4d5e62e-7344-4f06-acd8-f24543f7de82","Type":"ContainerStarted","Data":"0d28b658fc93163254417d9763edfadc5819f00f94f6ee57b4a75ac8130925fd"}
Jul 15 12:29:07.958787 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:07.958743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:08.114339 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:08.114291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:08.269221 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:08.269142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:08.601216 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:08.601172    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 12:29:08.601280 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:08.601253    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 15 12:29:09.340859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:09.340820    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5" event={"ID":"e4d5e62e-7344-4f06-acd8-f24543f7de82","Type":"ContainerStarted","Data":"54327a6aff7a39bddd57c69a65b3c014612b360704440a1e1de573ed42c76468"}
Jul 15 12:29:09.341455 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:09.341032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:09.342675 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:09.342648    2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-bxgt5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 15 12:29:09.342816 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:09.342692    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5" podUID="e4d5e62e-7344-4f06-acd8-f24543f7de82" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 15 12:29:09.426205 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:09.425988    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5" podStartSLOduration=2.244606885 podStartE2EDuration="4.425930863s" totalImagesPullingTime="2.181323978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:29:09.383265006 +0000 UTC m=+332.931765302" watchObservedRunningTime="2026-07-15 12:29:09.425930863 +0000 UTC m=+332.974431130"
Jul 15 12:29:10.306458 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:10.306427    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-849c5974c6-m5ttm"
Jul 15 12:29:10.344643 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:10.344619    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-bxgt5"
Jul 15 12:29:11.895472 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:11.895441    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:12.024570 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:12.024535    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:12.169770 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:12.169674    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:12.343611 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:12.343575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:12.494704 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:12.494619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:12.604863 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:12.604831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:16.936462 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:16.936432    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:17.051211 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:17.051178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:58.193257 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:58.193166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:58.349117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:58.349084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:58.591977 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:29:58.591943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:31.627874 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:31.627839    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:34.013243 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:34.013202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:36.382465 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:36.382424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:37.293972 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:37.293934    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:41.165899 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:41.165856    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:41.864991 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:41.864955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:44.294652 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:44.294585    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:44.387386 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:44.387338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:46.597168 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:46.597124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:46.730116 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:46.730079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:47.606710 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:47.606673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:49.226909 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:49.226872    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:49.371264 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:49.371223    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:52.895512 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:52.895452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:55.084003 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:55.083969    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:55.179741 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:55.179697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:57.595045 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:57.595004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:57.698019 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:30:57.697964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:03.708762 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:03.708683    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:03.807999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:03.807955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:08.442832 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:08.442792    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:08.547956 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:08.547925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:12.409908 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:12.409870    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:12.479113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:12.479077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:13.009205 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:13.009167    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:13.080842 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:13.080776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:16.612321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:16.612285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:16.678445 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:16.678414    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:22.696304 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:22.696264    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:22.796814 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:22.796780    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:23.364354 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:23.364295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:27.414065 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:27.414034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:27.514056 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:27.514017    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:30.684200 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:30.684146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:30.786359 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:30.786323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:31.616632 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:31.616600    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:31.717360 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:31.717323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:31.817814 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:31.817768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:32.327667 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:32.327630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:32.393364 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:32.393310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:33.220586 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:33.220543    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:34.409162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:34.409126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:35.854132 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:35.854097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:35.918565 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:35.918531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:36.603680 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:36.603643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:36.662842 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:36.662810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:39.708396 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:39.708350    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:40.075181 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.075147    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:31:40.078015 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.077999    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:40.080912 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.080892    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 12:31:40.081035 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.080897    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 12:31:40.081999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.081983    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 12:31:40.082095 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.082050    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7c6ng\""
Jul 15 12:31:40.087667 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.087648    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:31:40.120458 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.120433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00626143-e7fc-4f7b-a8cd-101c1b5db070-config-file\") pod \"limitador-limitador-54d6d988d5-kqdms\" (UID: \"00626143-e7fc-4f7b-a8cd-101c1b5db070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:40.120572 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.120535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54hhl\" (UniqueName: \"kubernetes.io/projected/00626143-e7fc-4f7b-a8cd-101c1b5db070-kube-api-access-54hhl\") pod \"limitador-limitador-54d6d988d5-kqdms\" (UID: \"00626143-e7fc-4f7b-a8cd-101c1b5db070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:40.121513 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.121496    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:31:40.220938 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.220909    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54hhl\" (UniqueName: \"kubernetes.io/projected/00626143-e7fc-4f7b-a8cd-101c1b5db070-kube-api-access-54hhl\") pod \"limitador-limitador-54d6d988d5-kqdms\" (UID: \"00626143-e7fc-4f7b-a8cd-101c1b5db070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:40.221070 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.220950    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00626143-e7fc-4f7b-a8cd-101c1b5db070-config-file\") pod \"limitador-limitador-54d6d988d5-kqdms\" (UID: \"00626143-e7fc-4f7b-a8cd-101c1b5db070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:40.221502 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.221486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/00626143-e7fc-4f7b-a8cd-101c1b5db070-config-file\") pod \"limitador-limitador-54d6d988d5-kqdms\" (UID: \"00626143-e7fc-4f7b-a8cd-101c1b5db070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:40.229512 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.229494    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54hhl\" (UniqueName: \"kubernetes.io/projected/00626143-e7fc-4f7b-a8cd-101c1b5db070-kube-api-access-54hhl\") pod \"limitador-limitador-54d6d988d5-kqdms\" (UID: \"00626143-e7fc-4f7b-a8cd-101c1b5db070\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:40.388191 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.388109    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:40.524295 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.524274    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:31:40.526518 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:31:40.526495    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00626143_e7fc_4f7b_a8cd_101c1b5db070.slice/crio-fc2448bc467ccd75c25269d3197643bc08ca3975e77da28721dbf636328deb92 WatchSource:0}: Error finding container fc2448bc467ccd75c25269d3197643bc08ca3975e77da28721dbf636328deb92: Status 404 returned error can't find the container with id fc2448bc467ccd75c25269d3197643bc08ca3975e77da28721dbf636328deb92
Jul 15 12:31:40.855385 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:40.855349    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms" event={"ID":"00626143-e7fc-4f7b-a8cd-101c1b5db070","Type":"ContainerStarted","Data":"fc2448bc467ccd75c25269d3197643bc08ca3975e77da28721dbf636328deb92"}
Jul 15 12:31:42.971052 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:42.971021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:43.868435 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:43.868401    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms" event={"ID":"00626143-e7fc-4f7b-a8cd-101c1b5db070","Type":"ContainerStarted","Data":"7ab56bc8788b3eb3f66bc0b70867f5a9c55fa4322b20947118ceb772f13bf165"}
Jul 15 12:31:43.868625 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:43.868524    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:43.888472 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:43.888427    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms" podStartSLOduration=1.2010004730000001 podStartE2EDuration="3.888410891s" totalImagesPullingTime="2.687410418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:31:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:31:43.886874436 +0000 UTC m=+487.435374706" watchObservedRunningTime="2026-07-15 12:31:43.888410891 +0000 UTC m=+487.436911161"
Jul 15 12:31:44.785935 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:44.785893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:54.872562 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:54.872533    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kqdms"
Jul 15 12:31:57.185758 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:57.185691    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:57.282038 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:57.282003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:57.688718 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:31:57.688679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:12.228097 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:12.228056    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:12.573936 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:12.573903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:20.212712 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:20.212677    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:20.429658 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:20.429628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:20.522298 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:20.522217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:23.783933 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:23.783899    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:23.884811 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:23.884772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:55.937159 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:55.937069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:56.041666 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:56.041630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:56.519054 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:56.519019    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:56.678623 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:56.678588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:57.552542 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:57.552502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:57.656837 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:57.656801    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:58.253593 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:32:58.253564    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:33:07.973115 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:07.973075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:33:08.061406 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:08.061354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:33:33.807825 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:33.807791    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:33:34.249236 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:34.249155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:33:36.910418 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:36.910390    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:33:36.910891 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:36.910551    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:33:50.456860 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:50.456826    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:33:51.125447 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:51.125415    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:33:52.407532 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:33:52.407496    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:34:01.264061 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:01.264024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:34:02.537085 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:02.537050    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:34:18.486394 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.486354    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"]
Jul 15 12:34:18.488575 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.488555    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.491841 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.491813    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 12:34:18.492842 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.492820    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 12:34:18.492916 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.492896    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 12:34:18.494449 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.494432    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8v9kl\""
Jul 15 12:34:18.506519 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.506495    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"]
Jul 15 12:34:18.529259 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.529227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:34:18.591882 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.591844    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.591882 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.591884    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.592082 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.591908    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.592082 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.592000    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-994wd\" (UniqueName: \"kubernetes.io/projected/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-kube-api-access-994wd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.592082 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.592057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.592182 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.592116    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693226 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693420 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693584 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-994wd\" (UniqueName: \"kubernetes.io/projected/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-kube-api-access-994wd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693584 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693664 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693776 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693752    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.693869 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.693827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.695635 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.695614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.695818 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.695800    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.703691 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.703665    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-994wd\" (UniqueName: \"kubernetes.io/projected/ee1fb765-e1c7-4516-9c44-0c63000f0dd2-kube-api-access-994wd\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl\" (UID: \"ee1fb765-e1c7-4516-9c44-0c63000f0dd2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.798573 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.798544    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:18.935254 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.935221    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"]
Jul 15 12:34:18.938557 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:34:18.938530    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1fb765_e1c7_4516_9c44_0c63000f0dd2.slice/crio-5600e0755bf231aa8fcf5ab78e68d6d6d9b2ca975a346a4164be9d89a1456e1a WatchSource:0}: Error finding container 5600e0755bf231aa8fcf5ab78e68d6d6d9b2ca975a346a4164be9d89a1456e1a: Status 404 returned error can't find the container with id 5600e0755bf231aa8fcf5ab78e68d6d6d9b2ca975a346a4164be9d89a1456e1a
Jul 15 12:34:18.939858 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:18.939841    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:34:19.394227 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:19.394150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl" event={"ID":"ee1fb765-e1c7-4516-9c44-0c63000f0dd2","Type":"ContainerStarted","Data":"5600e0755bf231aa8fcf5ab78e68d6d6d9b2ca975a346a4164be9d89a1456e1a"}
Jul 15 12:34:20.243671 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:20.243581    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:34:20.398766 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:20.398714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl" event={"ID":"ee1fb765-e1c7-4516-9c44-0c63000f0dd2","Type":"ContainerStarted","Data":"a2ee4d6597c3268fe0a9b1f1114decafccf978cdc58a176633cb77fbbc1bbcd4"}
Jul 15 12:34:20.423826 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:20.423777    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl" podStartSLOduration=1.469187533 podStartE2EDuration="2.423760693s" totalImagesPullingTime="954.57316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:34:20.422023117 +0000 UTC m=+643.970523409" watchObservedRunningTime="2026-07-15 12:34:20.423760693 +0000 UTC m=+643.972260960"
Jul 15 12:34:25.827251 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:25.827216    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:34:27.750805 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:27.750766    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:34:28.799389 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:28.799351    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:28.799840 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:28.799409    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:28.811753 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:28.811709    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:29.441522 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:29.441488    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl"
Jul 15 12:34:35.874750 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:35.874692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:34:38.695294 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:38.695258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:34:47.906283 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:34:47.906245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:38.904526 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:35:38.904445    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:39.008685 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:35:39.008652    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:43.118606 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:35:43.118569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:49.053648 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:35:49.053614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:49.163687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:35:49.163657    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:50.317518 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:35:50.317472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:50.437646 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:35:50.437611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:51.950262 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:35:51.950230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:36:17.662958 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:36:17.662926    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:36:25.850711 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:36:25.850673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:36:25.964099 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:36:25.964046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:36:29.449126 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:36:29.449095    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:36:39.351242 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:36:39.351204    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:36:48.130996 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:36:48.130960    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:36:59.445157 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:36:59.445084    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:37:01.517413 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:01.517375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:37:03.431994 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:03.431953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:37:27.324708 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:27.324674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:37:41.874286 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:41.874255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:37:48.426435 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:48.426400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:37:48.517852 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:48.517817    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:37:48.658365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:48.658326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:37:54.550139 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:54.550100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:37:54.622667 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:54.622632    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:37:54.701660 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:54.701610    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:37:54.912103 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:37:54.912022    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:38:01.109802 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:01.109761    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:38:01.211541 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:01.211508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:38:03.502375 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:03.502344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:38:17.833340 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:17.833302    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:38:28.737845 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:28.737811    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:38:36.931134 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:36.931054    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:38:36.931134 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:36.931117    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:38:39.629035 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:39.629000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:38:46.627977 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:46.627941    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:38:58.134508 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:38:58.134471    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:39:08.917319 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:39:08.917282    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:39:20.720100 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:39:20.720059    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:39:24.722977 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:39:24.722943    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:39:31.623196 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:39:31.623162    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:39:50.253071 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:39:50.253033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:39:52.942144 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:39:52.942106    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:40:05.628459 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:40:05.628428    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:40:31.827113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:40:31.827079    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:40:42.723764 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:40:42.723716    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:40:58.232389 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:40:58.232352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:41:09.625179 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:41:09.625145    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:41:19.817902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:41:19.817865    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:41:29.251376 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:41:29.251340    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:41:38.933498 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:41:38.933462    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:42:56.998593 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:42:56.998559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:42:58.310232 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:42:58.310199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:43:26.406295 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:43:26.406258    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:43:36.054160 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:43:36.054120    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:43:36.950364 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:43:36.950335    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:43:36.951142 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:43:36.951120    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:43:49.097775 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:43:49.097710    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:43:50.929062 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:43:50.929025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:44:01.028890 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:44:01.028857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:44:13.026076 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:44:13.026045    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:44:22.419667 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:44:22.419628    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:44:31.132745 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:44:31.132638    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:44:42.030216 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:44:42.030182    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:44:53.827113 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:44:53.827080    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:45:00.166220 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:00.166183    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2"]
Jul 15 12:45:00.169254 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:00.169237    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2"
Jul 15 12:45:00.175429 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:00.175379    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2gg6\""
Jul 15 12:45:00.178160 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:00.178140    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2"
Jul 15 12:45:00.190849 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:00.190779    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2"]
Jul 15 12:45:00.311913 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:00.311875    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2"]
Jul 15 12:45:00.314710 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:45:00.314684    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f355302_8390_4db0_b148_d93d6fd10691.slice/crio-57dc7cfbc986b081deb949262a6e423dd54fc159a8450282677e3d02615ee180 WatchSource:0}: Error finding container 57dc7cfbc986b081deb949262a6e423dd54fc159a8450282677e3d02615ee180: Status 404 returned error can't find the container with id 57dc7cfbc986b081deb949262a6e423dd54fc159a8450282677e3d02615ee180
Jul 15 12:45:00.316477 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:00.316460    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:45:00.627601 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:00.627567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2" event={"ID":"9f355302-8390-4db0-b148-d93d6fd10691","Type":"ContainerStarted","Data":"57dc7cfbc986b081deb949262a6e423dd54fc159a8450282677e3d02615ee180"}
Jul 15 12:45:02.730207 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:02.730170    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:45:03.646629 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:03.646592    2563 generic.go:356] "Generic (PLEG): container finished" podID="9f355302-8390-4db0-b148-d93d6fd10691" containerID="1bb986734279ed6f9aa75a68d791151a58511f3e19078266cefa686d2624214a" exitCode=0
Jul 15 12:45:03.646812 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:03.646683    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2" event={"ID":"9f355302-8390-4db0-b148-d93d6fd10691","Type":"ContainerDied","Data":"1bb986734279ed6f9aa75a68d791151a58511f3e19078266cefa686d2624214a"}
Jul 15 12:45:04.776331 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:04.776309    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2"
Jul 15 12:45:05.655372 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:05.655338    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2" event={"ID":"9f355302-8390-4db0-b148-d93d6fd10691","Type":"ContainerDied","Data":"57dc7cfbc986b081deb949262a6e423dd54fc159a8450282677e3d02615ee180"}
Jul 15 12:45:05.655372 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:05.655367    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735325-9zlx2"
Jul 15 12:45:05.655592 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:05.655393    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="57dc7cfbc986b081deb949262a6e423dd54fc159a8450282677e3d02615ee180"
Jul 15 12:45:13.328358 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:13.328308    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:45:35.606265 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:35.606227    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:45:42.004154 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:42.004120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:45:44.737750 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:44.737702    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:45:54.832300 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:45:54.832263    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:46:06.635126 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:46:06.635090    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:46:23.140408 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:46:23.140368    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:46:34.392982 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:46:34.392940    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:46:44.323492 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:46:44.323453    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:46:52.240268 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:46:52.240232    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:47:02.858365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:47:02.858330    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:47:12.128921 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:47:12.128887    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:47:25.530681 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:47:25.530642    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:47:34.835009 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:47:34.834929    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:47:45.142461 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:47:45.142418    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:47:55.033746 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:47:55.033686    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:48:08.434756 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:48:08.434708    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:48:19.847865 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:48:19.847831    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:48:32.932331 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:48:32.932298    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:48:36.969345 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:48:36.969317    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:48:36.971332 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:48:36.971310    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:48:38.181145 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:48:38.181104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:47.186460 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:48:47.186426    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:49:02.190983 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:02.190949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:49:06.564662 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:06.564621    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:06.745748 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:06.745697    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:07.298442 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:07.298405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:14.186662 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:14.186596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:14.297482 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:14.297442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:14.515252 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:14.515219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:14.620449 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:14.620400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:15.761610 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.761572    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:15.918616 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.918583    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"]
Jul 15 12:49:15.918865 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.918853    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f355302-8390-4db0-b148-d93d6fd10691" containerName="cleanup"
Jul 15 12:49:15.918910 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.918866    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f355302-8390-4db0-b148-d93d6fd10691" containerName="cleanup"
Jul 15 12:49:15.918944 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.918915    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f355302-8390-4db0-b148-d93d6fd10691" containerName="cleanup"
Jul 15 12:49:15.921621 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.921604    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:15.955805 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.955762    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-fce6d3aa-serving-cert\""
Jul 15 12:49:15.955805 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.955802    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:49:15.955986 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.955821    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:49:15.956997 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.956982    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 12:49:15.970036 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.970012    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"]
Jul 15 12:49:15.988954 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.988926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57814b34-d394-4627-a8da-9cce48445037-openshift-service-ca\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:15.989084 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.988964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:15.989084 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:15.989042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qttb\" (UniqueName: \"kubernetes.io/projected/57814b34-d394-4627-a8da-9cce48445037-kube-api-access-5qttb\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.089499 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.089462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qttb\" (UniqueName: \"kubernetes.io/projected/57814b34-d394-4627-a8da-9cce48445037-kube-api-access-5qttb\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.089676 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.089507    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57814b34-d394-4627-a8da-9cce48445037-openshift-service-ca\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.089676 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.089645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.089830 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:49:16.089814    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-serving-cert: secret "maas-api-e2e-ait-fce6d3aa-serving-cert" not found
Jul 15 12:49:16.089884 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:49:16.089873    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls podName:57814b34-d394-4627-a8da-9cce48445037 nodeName:}" failed. No retries permitted until 2026-07-15 12:49:16.589856311 +0000 UTC m=+1540.138356558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls") pod "maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d" (UID: "57814b34-d394-4627-a8da-9cce48445037") : secret "maas-api-e2e-ait-fce6d3aa-serving-cert" not found
Jul 15 12:49:16.090216 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.090200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57814b34-d394-4627-a8da-9cce48445037-openshift-service-ca\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.118891 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.118865    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qttb\" (UniqueName: \"kubernetes.io/projected/57814b34-d394-4627-a8da-9cce48445037-kube-api-access-5qttb\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.593663 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.593624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.596030 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.596005    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls\") pod \"maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.742532 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.742497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:16.830990 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.830948    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:16.849633 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.849557    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:16.985657 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:16.985625    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"]
Jul 15 12:49:16.989032 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:49:16.988999    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57814b34_d394_4627_a8da_9cce48445037.slice/crio-6133fb29aa9e4a3220dc951ddbf9202d1d61828eb3370f297b832c8badfdcbd4 WatchSource:0}: Error finding container 6133fb29aa9e4a3220dc951ddbf9202d1d61828eb3370f297b832c8badfdcbd4: Status 404 returned error can't find the container with id 6133fb29aa9e4a3220dc951ddbf9202d1d61828eb3370f297b832c8badfdcbd4
Jul 15 12:49:17.086362 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:17.086316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:17.297806 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:17.297768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:17.549555 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:17.549463    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d" event={"ID":"57814b34-d394-4627-a8da-9cce48445037","Type":"ContainerStarted","Data":"6133fb29aa9e4a3220dc951ddbf9202d1d61828eb3370f297b832c8badfdcbd4"}
Jul 15 12:49:18.374125 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:18.374088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:19.559956 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:19.559919    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d" event={"ID":"57814b34-d394-4627-a8da-9cce48445037","Type":"ContainerStarted","Data":"43d9415b19800f0e9a6e84e20a7f04a2e335a7ef164ffc23790276f48abb6fde"}
Jul 15 12:49:19.560406 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:19.560054    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:19.589202 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:19.589151    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d" podStartSLOduration=2.110411138 podStartE2EDuration="4.589136945s" totalImagesPullingTime="2.478725807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:49:19.58898315 +0000 UTC m=+1543.137483442" watchObservedRunningTime="2026-07-15 12:49:19.589136945 +0000 UTC m=+1543.137637214"
Jul 15 12:49:20.901310 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:20.901270    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"]
Jul 15 12:49:20.904462 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:20.904445    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"
Jul 15 12:49:20.907929 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:20.907904    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2gg6\""
Jul 15 12:49:20.927834 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:20.927808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf\" (UID: \"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"
Jul 15 12:49:20.931617 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:20.931586    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"]
Jul 15 12:49:21.028409 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:21.028379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf\" (UID: \"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"
Jul 15 12:49:21.028981 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:21.028964    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf\" (UID: \"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"
Jul 15 12:49:21.213791 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:21.213695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"
Jul 15 12:49:21.365079 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:21.365047    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:49:21.369112 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:21.369078    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"]
Jul 15 12:49:21.372228 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:49:21.372202    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode939d4d6_8ea2_40cb_8eaf_21677ed7d1f2.slice/crio-dc0b143d2916d5e42bde094191863b395b0e33170836ef5da82896a425e4ba23 WatchSource:0}: Error finding container dc0b143d2916d5e42bde094191863b395b0e33170836ef5da82896a425e4ba23: Status 404 returned error can't find the container with id dc0b143d2916d5e42bde094191863b395b0e33170836ef5da82896a425e4ba23
Jul 15 12:49:21.569149 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:21.569109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" event={"ID":"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2","Type":"ContainerStarted","Data":"6baf84808896d4a31c2745f30f701a8fefee4d9c3b87e7b70970ce8d6083e10f"}
Jul 15 12:49:21.569325 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:21.569162    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" event={"ID":"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2","Type":"ContainerStarted","Data":"dc0b143d2916d5e42bde094191863b395b0e33170836ef5da82896a425e4ba23"}
Jul 15 12:49:21.596640 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:21.596584    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" podStartSLOduration=1.59656679 podStartE2EDuration="1.59656679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:49:21.59484532 +0000 UTC m=+1545.143345589" watchObservedRunningTime="2026-07-15 12:49:21.59656679 +0000 UTC m=+1545.145067059"
Jul 15 12:49:22.574639 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:22.574601    2563 generic.go:356] "Generic (PLEG): container finished" podID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerID="6baf84808896d4a31c2745f30f701a8fefee4d9c3b87e7b70970ce8d6083e10f" exitCode=7
Jul 15 12:49:22.575060 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:22.574649    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" event={"ID":"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2","Type":"ContainerDied","Data":"6baf84808896d4a31c2745f30f701a8fefee4d9c3b87e7b70970ce8d6083e10f"}
Jul 15 12:49:22.575060 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:22.574891    2563 scope.go:117] "RemoveContainer" containerID="6baf84808896d4a31c2745f30f701a8fefee4d9c3b87e7b70970ce8d6083e10f"
Jul 15 12:49:23.581663 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:23.581625    2563 generic.go:356] "Generic (PLEG): container finished" podID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerID="cf7e831b42b0f526113176fe32c08bcb441ab60434201c17a28a836f5fcdf8e8" exitCode=7
Jul 15 12:49:23.582125 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:23.581669    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" event={"ID":"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2","Type":"ContainerDied","Data":"cf7e831b42b0f526113176fe32c08bcb441ab60434201c17a28a836f5fcdf8e8"}
Jul 15 12:49:23.582125 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:23.581756    2563 scope.go:117] "RemoveContainer" containerID="6baf84808896d4a31c2745f30f701a8fefee4d9c3b87e7b70970ce8d6083e10f"
Jul 15 12:49:23.582125 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:23.582008    2563 scope.go:117] "RemoveContainer" containerID="cf7e831b42b0f526113176fe32c08bcb441ab60434201c17a28a836f5fcdf8e8"
Jul 15 12:49:23.582237 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:49:23.582219    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf_odh-ai-gateway-infra(e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2"
Jul 15 12:49:24.587153 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:24.587126    2563 scope.go:117] "RemoveContainer" containerID="cf7e831b42b0f526113176fe32c08bcb441ab60434201c17a28a836f5fcdf8e8"
Jul 15 12:49:24.587517 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:49:24.587292    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf_odh-ai-gateway-infra(e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2"
Jul 15 12:49:25.569706 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:25.569677    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:49:40.014317 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:40.014284    2563 scope.go:117] "RemoveContainer" containerID="cf7e831b42b0f526113176fe32c08bcb441ab60434201c17a28a836f5fcdf8e8"
Jul 15 12:49:40.656663 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:40.656629    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" event={"ID":"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2","Type":"ContainerStarted","Data":"c5a167c10ebd8f4d6b0034633842d29019e145b4e94dfa8622edca7433b7e23a"}
Jul 15 12:49:41.661874 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:41.661839    2563 generic.go:356] "Generic (PLEG): container finished" podID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerID="c5a167c10ebd8f4d6b0034633842d29019e145b4e94dfa8622edca7433b7e23a" exitCode=0
Jul 15 12:49:41.661874 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:41.661879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" event={"ID":"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2","Type":"ContainerDied","Data":"c5a167c10ebd8f4d6b0034633842d29019e145b4e94dfa8622edca7433b7e23a"}
Jul 15 12:49:41.662290 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:41.661954    2563 scope.go:117] "RemoveContainer" containerID="cf7e831b42b0f526113176fe32c08bcb441ab60434201c17a28a836f5fcdf8e8"
Jul 15 12:49:41.707131 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:41.707105    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"]
Jul 15 12:49:42.353626 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:42.353591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:42.799279 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:42.799256    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"
Jul 15 12:49:42.907940 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:42.907903    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2-maas-api-service-ca\") pod \"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2\" (UID: \"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2\") "
Jul 15 12:49:42.908324 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:42.908306    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" (UID: "e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:49:43.009431 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:43.009361    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2-maas-api-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:49:43.672017 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:43.671988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf" event={"ID":"e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2","Type":"ContainerDied","Data":"dc0b143d2916d5e42bde094191863b395b0e33170836ef5da82896a425e4ba23"}
Jul 15 12:49:43.672017 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:43.672020    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"
Jul 15 12:49:43.672218 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:43.672033    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dc0b143d2916d5e42bde094191863b395b0e33170836ef5da82896a425e4ba23"
Jul 15 12:49:43.718465 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:43.718433    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"]
Jul 15 12:49:43.720901 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:43.720877    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-tfvxf"]
Jul 15 12:49:45.019433 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:45.019403    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" path="/var/lib/kubelet/pods/e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2/volumes"
Jul 15 12:49:53.410528 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:49:53.410498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:04.390242 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:04.390179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:20.979460 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.979419    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"]
Jul 15 12:50:20.979885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.979695    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:20.979885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.979705    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:20.979885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.979734    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:20.979885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.979740    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:20.979885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.979784    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:20.979885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.979791    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:20.982489 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.982473    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"
Jul 15 12:50:20.985831 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.985807    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2gg6\""
Jul 15 12:50:20.992160 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:20.992140    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"]
Jul 15 12:50:21.009238 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:21.009208    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c051ab3-fbe0-4314-8161-3577d993713e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6\" (UID: \"9c051ab3-fbe0-4314-8161-3577d993713e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"
Jul 15 12:50:21.110050 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:21.110012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c051ab3-fbe0-4314-8161-3577d993713e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6\" (UID: \"9c051ab3-fbe0-4314-8161-3577d993713e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"
Jul 15 12:50:21.110705 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:21.110676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c051ab3-fbe0-4314-8161-3577d993713e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6\" (UID: \"9c051ab3-fbe0-4314-8161-3577d993713e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"
Jul 15 12:50:21.293434 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:21.293332    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"
Jul 15 12:50:21.432433 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:21.432400    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"]
Jul 15 12:50:21.435674 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:50:21.435642    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c051ab3_fbe0_4314_8161_3577d993713e.slice/crio-8338f3de711e9bd7a94397bb028c679e79d82d47696fefd46c2ac36993f8523c WatchSource:0}: Error finding container 8338f3de711e9bd7a94397bb028c679e79d82d47696fefd46c2ac36993f8523c: Status 404 returned error can't find the container with id 8338f3de711e9bd7a94397bb028c679e79d82d47696fefd46c2ac36993f8523c
Jul 15 12:50:21.833875 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:21.833836    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6" event={"ID":"9c051ab3-fbe0-4314-8161-3577d993713e","Type":"ContainerStarted","Data":"c5e564ba62f3cc8e96f797922d0ba43427cf96e3e94e0ad9a593c2d9aa99c3ef"}
Jul 15 12:50:21.834066 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:21.833888    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6" event={"ID":"9c051ab3-fbe0-4314-8161-3577d993713e","Type":"ContainerStarted","Data":"8338f3de711e9bd7a94397bb028c679e79d82d47696fefd46c2ac36993f8523c"}
Jul 15 12:50:21.858773 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:21.858698    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6" podStartSLOduration=1.8586819490000002 podStartE2EDuration="1.858681949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:50:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:50:21.85812327 +0000 UTC m=+1605.406623528" watchObservedRunningTime="2026-07-15 12:50:21.858681949 +0000 UTC m=+1605.407182217"
Jul 15 12:50:22.839611 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:22.839573    2563 generic.go:356] "Generic (PLEG): container finished" podID="9c051ab3-fbe0-4314-8161-3577d993713e" containerID="c5e564ba62f3cc8e96f797922d0ba43427cf96e3e94e0ad9a593c2d9aa99c3ef" exitCode=0
Jul 15 12:50:22.840068 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:22.839659    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6" event={"ID":"9c051ab3-fbe0-4314-8161-3577d993713e","Type":"ContainerDied","Data":"c5e564ba62f3cc8e96f797922d0ba43427cf96e3e94e0ad9a593c2d9aa99c3ef"}
Jul 15 12:50:23.967372 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:23.967342    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"
Jul 15 12:50:24.035338 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:24.035303    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c051ab3-fbe0-4314-8161-3577d993713e-maas-api-service-ca\") pod \"9c051ab3-fbe0-4314-8161-3577d993713e\" (UID: \"9c051ab3-fbe0-4314-8161-3577d993713e\") "
Jul 15 12:50:24.035661 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:24.035637    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c051ab3-fbe0-4314-8161-3577d993713e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9c051ab3-fbe0-4314-8161-3577d993713e" (UID: "9c051ab3-fbe0-4314-8161-3577d993713e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:50:24.136514 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:24.136428    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9c051ab3-fbe0-4314-8161-3577d993713e-maas-api-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:50:24.848965 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:24.848929    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6" event={"ID":"9c051ab3-fbe0-4314-8161-3577d993713e","Type":"ContainerDied","Data":"8338f3de711e9bd7a94397bb028c679e79d82d47696fefd46c2ac36993f8523c"}
Jul 15 12:50:24.849181 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:24.848986    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8338f3de711e9bd7a94397bb028c679e79d82d47696fefd46c2ac36993f8523c"
Jul 15 12:50:24.849181 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:24.848946    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6"
Jul 15 12:50:31.746474 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:31.746391    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"]
Jul 15 12:50:31.746915 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:31.746598    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d" podUID="57814b34-d394-4627-a8da-9cce48445037" containerName="maas-api" containerID="cri-o://43d9415b19800f0e9a6e84e20a7f04a2e335a7ef164ffc23790276f48abb6fde" gracePeriod=30
Jul 15 12:50:31.792168 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:31.792126    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:31.882039 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:31.882009    2563 generic.go:356] "Generic (PLEG): container finished" podID="57814b34-d394-4627-a8da-9cce48445037" containerID="43d9415b19800f0e9a6e84e20a7f04a2e335a7ef164ffc23790276f48abb6fde" exitCode=0
Jul 15 12:50:31.882200 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:31.882062    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d" event={"ID":"57814b34-d394-4627-a8da-9cce48445037","Type":"ContainerDied","Data":"43d9415b19800f0e9a6e84e20a7f04a2e335a7ef164ffc23790276f48abb6fde"}
Jul 15 12:50:31.990665 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:31.990639    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:50:32.102899 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.102869    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5qttb\" (UniqueName: \"kubernetes.io/projected/57814b34-d394-4627-a8da-9cce48445037-kube-api-access-5qttb\") pod \"57814b34-d394-4627-a8da-9cce48445037\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") "
Jul 15 12:50:32.103093 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.102912    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls\") pod \"57814b34-d394-4627-a8da-9cce48445037\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") "
Jul 15 12:50:32.103093 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.102940    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57814b34-d394-4627-a8da-9cce48445037-openshift-service-ca\") pod \"57814b34-d394-4627-a8da-9cce48445037\" (UID: \"57814b34-d394-4627-a8da-9cce48445037\") "
Jul 15 12:50:32.103363 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.103333    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57814b34-d394-4627-a8da-9cce48445037-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "57814b34-d394-4627-a8da-9cce48445037" (UID: "57814b34-d394-4627-a8da-9cce48445037"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:50:32.105221 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.105188    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "57814b34-d394-4627-a8da-9cce48445037" (UID: "57814b34-d394-4627-a8da-9cce48445037"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:50:32.105322 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.105220    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57814b34-d394-4627-a8da-9cce48445037-kube-api-access-5qttb" (OuterVolumeSpecName: "kube-api-access-5qttb") pod "57814b34-d394-4627-a8da-9cce48445037" (UID: "57814b34-d394-4627-a8da-9cce48445037"). InnerVolumeSpecName "kube-api-access-5qttb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:50:32.204472 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.204418    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/57814b34-d394-4627-a8da-9cce48445037-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:50:32.204472 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.204464    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/57814b34-d394-4627-a8da-9cce48445037-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:50:32.204472 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.204479    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5qttb\" (UniqueName: \"kubernetes.io/projected/57814b34-d394-4627-a8da-9cce48445037-kube-api-access-5qttb\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:50:32.887706 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.887677    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"
Jul 15 12:50:32.887706 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.887699    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d" event={"ID":"57814b34-d394-4627-a8da-9cce48445037","Type":"ContainerDied","Data":"6133fb29aa9e4a3220dc951ddbf9202d1d61828eb3370f297b832c8badfdcbd4"}
Jul 15 12:50:32.888219 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.887777    2563 scope.go:117] "RemoveContainer" containerID="43d9415b19800f0e9a6e84e20a7f04a2e335a7ef164ffc23790276f48abb6fde"
Jul 15 12:50:32.931833 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.931794    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"]
Jul 15 12:50:32.949578 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:32.949552    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-fce6d3aa-7c8d5d9df7-7vr2d"]
Jul 15 12:50:33.019124 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:33.019088    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57814b34-d394-4627-a8da-9cce48445037" path="/var/lib/kubelet/pods/57814b34-d394-4627-a8da-9cce48445037/volumes"
Jul 15 12:50:34.641960 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:34.641914    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:50:36.107444 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:36.107410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:42.296883 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:42.296843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:42.371039 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:42.370997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:46.395565 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:46.395527    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:48.450192 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450157    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"]
Jul 15 12:50:48.450637 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450526    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c051ab3-fbe0-4314-8161-3577d993713e" containerName="revoke-keys"
Jul 15 12:50:48.450637 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450542    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c051ab3-fbe0-4314-8161-3577d993713e" containerName="revoke-keys"
Jul 15 12:50:48.450637 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450565    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57814b34-d394-4627-a8da-9cce48445037" containerName="maas-api"
Jul 15 12:50:48.450637 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450573    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="57814b34-d394-4627-a8da-9cce48445037" containerName="maas-api"
Jul 15 12:50:48.450637 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450591    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:48.450637 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450600    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:48.450957 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450667    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="57814b34-d394-4627-a8da-9cce48445037" containerName="maas-api"
Jul 15 12:50:48.450957 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450680    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e939d4d6-8ea2-40cb-8eaf-21677ed7d1f2" containerName="revoke-keys"
Jul 15 12:50:48.450957 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.450688    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c051ab3-fbe0-4314-8161-3577d993713e" containerName="revoke-keys"
Jul 15 12:50:48.453488 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.453469    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.456596 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.456576    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 12:50:48.456709 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.456679    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:50:48.457591 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.457572    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-6532cca1-serving-cert\""
Jul 15 12:50:48.457665 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.457603    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:50:48.468372 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.468353    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"]
Jul 15 12:50:48.533021 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.532987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c560b995-b8f2-4311-bcad-0c0d28ca8d37-openshift-service-ca\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.533021 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.533020    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8hpd\" (UniqueName: \"kubernetes.io/projected/c560b995-b8f2-4311-bcad-0c0d28ca8d37-kube-api-access-c8hpd\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.533231 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.533052    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c560b995-b8f2-4311-bcad-0c0d28ca8d37-maas-api-tls\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.634032 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.633996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c560b995-b8f2-4311-bcad-0c0d28ca8d37-openshift-service-ca\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.634032 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.634032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8hpd\" (UniqueName: \"kubernetes.io/projected/c560b995-b8f2-4311-bcad-0c0d28ca8d37-kube-api-access-c8hpd\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.634293 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.634065    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c560b995-b8f2-4311-bcad-0c0d28ca8d37-maas-api-tls\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.634708 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.634684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c560b995-b8f2-4311-bcad-0c0d28ca8d37-openshift-service-ca\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.636522 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.636503    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c560b995-b8f2-4311-bcad-0c0d28ca8d37-maas-api-tls\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.650841 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.650818    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8hpd\" (UniqueName: \"kubernetes.io/projected/c560b995-b8f2-4311-bcad-0c0d28ca8d37-kube-api-access-c8hpd\") pod \"maas-api-e2e-migrate-6532cca1-86487455fc-8snhw\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.763679 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.763594    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:48.924785 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.924753    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"]
Jul 15 12:50:48.928069 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:50:48.928044    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc560b995_b8f2_4311_bcad_0c0d28ca8d37.slice/crio-33dfb5ce4d946a24768c9d73ad278cf5d2bf941f1a29120cdac137ac54a3506f WatchSource:0}: Error finding container 33dfb5ce4d946a24768c9d73ad278cf5d2bf941f1a29120cdac137ac54a3506f: Status 404 returned error can't find the container with id 33dfb5ce4d946a24768c9d73ad278cf5d2bf941f1a29120cdac137ac54a3506f
Jul 15 12:50:48.929376 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.929357    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:50:48.952182 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:48.952151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw" event={"ID":"c560b995-b8f2-4311-bcad-0c0d28ca8d37","Type":"ContainerStarted","Data":"33dfb5ce4d946a24768c9d73ad278cf5d2bf941f1a29120cdac137ac54a3506f"}
Jul 15 12:50:49.285185 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:49.285148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:49.441767 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:49.441692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:49.541537 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:49.541510    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:49.957973 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:49.957938    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw" event={"ID":"c560b995-b8f2-4311-bcad-0c0d28ca8d37","Type":"ContainerStarted","Data":"2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20"}
Jul 15 12:50:49.958184 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:49.958050    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:50:50.773963 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:50.773892    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw" podStartSLOduration=2.210793194 podStartE2EDuration="2.773873905s" totalImagesPullingTime="563.080711ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:50:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:50:49.993623335 +0000 UTC m=+1633.542123603" watchObservedRunningTime="2026-07-15 12:50:50.773873905 +0000 UTC m=+1634.322374176"
Jul 15 12:50:50.774936 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:50.774919    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:50:55.966996 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:50:55.966962    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:51:03.517394 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.517354    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"]
Jul 15 12:51:03.517893 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.517628    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw" podUID="c560b995-b8f2-4311-bcad-0c0d28ca8d37" containerName="maas-api" containerID="cri-o://2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20" gracePeriod=30
Jul 15 12:51:03.552092 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.552055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:03.761470 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.761442    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:51:03.862371 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.862331    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c560b995-b8f2-4311-bcad-0c0d28ca8d37-openshift-service-ca\") pod \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") "
Jul 15 12:51:03.862547 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.862422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8hpd\" (UniqueName: \"kubernetes.io/projected/c560b995-b8f2-4311-bcad-0c0d28ca8d37-kube-api-access-c8hpd\") pod \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") "
Jul 15 12:51:03.862547 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.862451    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c560b995-b8f2-4311-bcad-0c0d28ca8d37-maas-api-tls\") pod \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\" (UID: \"c560b995-b8f2-4311-bcad-0c0d28ca8d37\") "
Jul 15 12:51:03.862787 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.862762    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c560b995-b8f2-4311-bcad-0c0d28ca8d37-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c560b995-b8f2-4311-bcad-0c0d28ca8d37" (UID: "c560b995-b8f2-4311-bcad-0c0d28ca8d37"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:51:03.864584 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.864548    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c560b995-b8f2-4311-bcad-0c0d28ca8d37-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c560b995-b8f2-4311-bcad-0c0d28ca8d37" (UID: "c560b995-b8f2-4311-bcad-0c0d28ca8d37"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:51:03.864697 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.864603    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c560b995-b8f2-4311-bcad-0c0d28ca8d37-kube-api-access-c8hpd" (OuterVolumeSpecName: "kube-api-access-c8hpd") pod "c560b995-b8f2-4311-bcad-0c0d28ca8d37" (UID: "c560b995-b8f2-4311-bcad-0c0d28ca8d37"). InnerVolumeSpecName "kube-api-access-c8hpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:51:03.963335 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.963283    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8hpd\" (UniqueName: \"kubernetes.io/projected/c560b995-b8f2-4311-bcad-0c0d28ca8d37-kube-api-access-c8hpd\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:51:03.963335 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.963328    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c560b995-b8f2-4311-bcad-0c0d28ca8d37-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:51:03.963335 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:03.963337    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c560b995-b8f2-4311-bcad-0c0d28ca8d37-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:51:04.011689 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.011651    2563 generic.go:356] "Generic (PLEG): container finished" podID="c560b995-b8f2-4311-bcad-0c0d28ca8d37" containerID="2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20" exitCode=0
Jul 15 12:51:04.011859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.011694    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"
Jul 15 12:51:04.011859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.011714    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw" event={"ID":"c560b995-b8f2-4311-bcad-0c0d28ca8d37","Type":"ContainerDied","Data":"2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20"}
Jul 15 12:51:04.011859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.011785    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw" event={"ID":"c560b995-b8f2-4311-bcad-0c0d28ca8d37","Type":"ContainerDied","Data":"33dfb5ce4d946a24768c9d73ad278cf5d2bf941f1a29120cdac137ac54a3506f"}
Jul 15 12:51:04.011859 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.011815    2563 scope.go:117] "RemoveContainer" containerID="2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20"
Jul 15 12:51:04.024812 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.024790    2563 scope.go:117] "RemoveContainer" containerID="2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20"
Jul 15 12:51:04.025148 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:51:04.025126    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20\": container with ID starting with 2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20 not found: ID does not exist" containerID="2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20"
Jul 15 12:51:04.025213 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.025158    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20"} err="failed to get container status \"2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20\": rpc error: code = NotFound desc = could not find container \"2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20\": container with ID starting with 2ab698885ff662e8cc5c1b6d60cabf08b1f0ee800573d2665195fada78529b20 not found: ID does not exist"
Jul 15 12:51:04.039913 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.039876    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"]
Jul 15 12:51:04.044313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:04.044284    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-6532cca1-86487455fc-8snhw"]
Jul 15 12:51:05.019306 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:05.019268    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c560b995-b8f2-4311-bcad-0c0d28ca8d37" path="/var/lib/kubelet/pods/c560b995-b8f2-4311-bcad-0c0d28ca8d37/volumes"
Jul 15 12:51:06.231795 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:06.231764    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:51:08.527313 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:08.527192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:08.626851 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:08.626814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:11.722286 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:11.722241    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:14.887550 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:14.887502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:15.015869 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:15.015832    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:18.179356 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:18.179316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:18.545194 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:18.545130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:19.770513 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.770483    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"]
Jul 15 12:51:19.770990 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.770754    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c560b995-b8f2-4311-bcad-0c0d28ca8d37" containerName="maas-api"
Jul 15 12:51:19.770990 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.770766    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c560b995-b8f2-4311-bcad-0c0d28ca8d37" containerName="maas-api"
Jul 15 12:51:19.770990 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.770824    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c560b995-b8f2-4311-bcad-0c0d28ca8d37" containerName="maas-api"
Jul 15 12:51:19.773602 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.773580    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:19.776593 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.776567    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-da069d38-serving-cert\""
Jul 15 12:51:19.776705 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.776572    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:51:19.777287 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.777271    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:51:19.777917 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.777899    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 12:51:19.794094 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.794061    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"]
Jul 15 12:51:19.884176 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.884141    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242f708f-cd61-40c2-b312-b5b8d686dd1f-openshift-service-ca\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:19.884176 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.884178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6wlc\" (UniqueName: \"kubernetes.io/projected/242f708f-cd61-40c2-b312-b5b8d686dd1f-kube-api-access-d6wlc\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:19.884389 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.884211    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242f708f-cd61-40c2-b312-b5b8d686dd1f-maas-api-tls\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:19.984780 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.984744    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242f708f-cd61-40c2-b312-b5b8d686dd1f-openshift-service-ca\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:19.984780 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.984778    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6wlc\" (UniqueName: \"kubernetes.io/projected/242f708f-cd61-40c2-b312-b5b8d686dd1f-kube-api-access-d6wlc\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:19.985009 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.984815    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242f708f-cd61-40c2-b312-b5b8d686dd1f-maas-api-tls\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:19.985372 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.985349    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242f708f-cd61-40c2-b312-b5b8d686dd1f-openshift-service-ca\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:19.987200 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:19.987170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242f708f-cd61-40c2-b312-b5b8d686dd1f-maas-api-tls\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:20.002843 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:20.002823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6wlc\" (UniqueName: \"kubernetes.io/projected/242f708f-cd61-40c2-b312-b5b8d686dd1f-kube-api-access-d6wlc\") pod \"maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:20.084175 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:20.084145    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:20.278093 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:20.278066    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"]
Jul 15 12:51:20.278518 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:51:20.278493    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod242f708f_cd61_40c2_b312_b5b8d686dd1f.slice/crio-fc2e99130c28eba909712ddf6227a530a8f1252aef1520ff6ce2c13f23f22506 WatchSource:0}: Error finding container fc2e99130c28eba909712ddf6227a530a8f1252aef1520ff6ce2c13f23f22506: Status 404 returned error can't find the container with id fc2e99130c28eba909712ddf6227a530a8f1252aef1520ff6ce2c13f23f22506
Jul 15 12:51:20.458846 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:20.458752    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:20.574753 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:20.574698    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:20.683642 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:20.683611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:20.799436 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:20.799404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:21.081040 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:21.081002    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv" event={"ID":"242f708f-cd61-40c2-b312-b5b8d686dd1f","Type":"ContainerStarted","Data":"33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625"}
Jul 15 12:51:21.081195 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:21.081061    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv" event={"ID":"242f708f-cd61-40c2-b312-b5b8d686dd1f","Type":"ContainerStarted","Data":"fc2e99130c28eba909712ddf6227a530a8f1252aef1520ff6ce2c13f23f22506"}
Jul 15 12:51:21.081195 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:21.081135    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:21.193702 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:21.193638    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv" podStartSLOduration=1.7521001649999999 podStartE2EDuration="2.193620264s" totalImagesPullingTime="441.520099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:51:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:51:21.193066833 +0000 UTC m=+1664.741567103" watchObservedRunningTime="2026-07-15 12:51:21.193620264 +0000 UTC m=+1664.742120532"
Jul 15 12:51:22.233885 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:22.233851    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:51:24.482200 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:24.482163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:24.850806 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:24.850769    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"]
Jul 15 12:51:24.854068 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:24.854048    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"
Jul 15 12:51:24.858450 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:24.858427    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2gg6\""
Jul 15 12:51:24.871850 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:24.871821    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"]
Jul 15 12:51:24.925624 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:24.925579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bc5ed44-1230-4dbf-8ccc-080ad0b329fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da069d38-cngxt\" (UID: \"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"
Jul 15 12:51:25.026984 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:25.026949    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bc5ed44-1230-4dbf-8ccc-080ad0b329fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da069d38-cngxt\" (UID: \"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"
Jul 15 12:51:25.027539 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:25.027519    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bc5ed44-1230-4dbf-8ccc-080ad0b329fa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da069d38-cngxt\" (UID: \"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"
Jul 15 12:51:25.164019 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:25.163931    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"
Jul 15 12:51:25.300536 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:25.300513    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"]
Jul 15 12:51:25.302314 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:51:25.302288    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc5ed44_1230_4dbf_8ccc_080ad0b329fa.slice/crio-553508340a0afd81f4b0f90032861c06950ff7c480b1e5565c441783a7135dd1 WatchSource:0}: Error finding container 553508340a0afd81f4b0f90032861c06950ff7c480b1e5565c441783a7135dd1: Status 404 returned error can't find the container with id 553508340a0afd81f4b0f90032861c06950ff7c480b1e5565c441783a7135dd1
Jul 15 12:51:26.101436 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:26.101394    2563 generic.go:356] "Generic (PLEG): container finished" podID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerID="0bd9c4d300e1cec7c02763b98c46cd39d7bcad94b7fae2b79740ce6bae03c905" exitCode=7
Jul 15 12:51:26.101907 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:26.101482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt" event={"ID":"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa","Type":"ContainerDied","Data":"0bd9c4d300e1cec7c02763b98c46cd39d7bcad94b7fae2b79740ce6bae03c905"}
Jul 15 12:51:26.101907 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:26.101534    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt" event={"ID":"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa","Type":"ContainerStarted","Data":"553508340a0afd81f4b0f90032861c06950ff7c480b1e5565c441783a7135dd1"}
Jul 15 12:51:26.101907 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:26.101693    2563 scope.go:117] "RemoveContainer" containerID="0bd9c4d300e1cec7c02763b98c46cd39d7bcad94b7fae2b79740ce6bae03c905"
Jul 15 12:51:27.091338 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:27.091304    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:51:27.106953 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:27.106918    2563 generic.go:356] "Generic (PLEG): container finished" podID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerID="a12cfeeafef5b1cdbd36664bd0a18a1a9766594a8b53541af98a727f0aaf76dd" exitCode=7
Jul 15 12:51:27.107388 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:27.106979    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt" event={"ID":"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa","Type":"ContainerDied","Data":"a12cfeeafef5b1cdbd36664bd0a18a1a9766594a8b53541af98a727f0aaf76dd"}
Jul 15 12:51:27.107388 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:27.107029    2563 scope.go:117] "RemoveContainer" containerID="0bd9c4d300e1cec7c02763b98c46cd39d7bcad94b7fae2b79740ce6bae03c905"
Jul 15 12:51:27.107388 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:27.107227    2563 scope.go:117] "RemoveContainer" containerID="a12cfeeafef5b1cdbd36664bd0a18a1a9766594a8b53541af98a727f0aaf76dd"
Jul 15 12:51:27.107537 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:51:27.107454    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-da069d38-cngxt_odh-ai-gateway-infra(3bc5ed44-1230-4dbf-8ccc-080ad0b329fa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa"
Jul 15 12:51:28.112646 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:28.112612    2563 scope.go:117] "RemoveContainer" containerID="a12cfeeafef5b1cdbd36664bd0a18a1a9766594a8b53541af98a727f0aaf76dd"
Jul 15 12:51:28.113053 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:51:28.112821    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-da069d38-cngxt_odh-ai-gateway-infra(3bc5ed44-1230-4dbf-8ccc-080ad0b329fa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa"
Jul 15 12:51:42.014798 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:42.014765    2563 scope.go:117] "RemoveContainer" containerID="a12cfeeafef5b1cdbd36664bd0a18a1a9766594a8b53541af98a727f0aaf76dd"
Jul 15 12:51:43.173316 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:43.173286    2563 generic.go:356] "Generic (PLEG): container finished" podID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerID="3e40bfcd41e1cefec0d4646a1c0b93ce6d48e3e438dfacfdabe6db5413452eb9" exitCode=0
Jul 15 12:51:43.173790 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:43.173329    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt" event={"ID":"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa","Type":"ContainerDied","Data":"3e40bfcd41e1cefec0d4646a1c0b93ce6d48e3e438dfacfdabe6db5413452eb9"}
Jul 15 12:51:43.173790 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:43.173377    2563 scope.go:117] "RemoveContainer" containerID="a12cfeeafef5b1cdbd36664bd0a18a1a9766594a8b53541af98a727f0aaf76dd"
Jul 15 12:51:44.210191 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:44.210160    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"]
Jul 15 12:51:44.307939 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:44.307916    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"
Jul 15 12:51:44.388194 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:44.388144    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bc5ed44-1230-4dbf-8ccc-080ad0b329fa-maas-api-service-ca\") pod \"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa\" (UID: \"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa\") "
Jul 15 12:51:44.388506 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:44.388484    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bc5ed44-1230-4dbf-8ccc-080ad0b329fa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" (UID: "3bc5ed44-1230-4dbf-8ccc-080ad0b329fa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:51:44.489655 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:44.489575    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3bc5ed44-1230-4dbf-8ccc-080ad0b329fa-maas-api-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:51:45.184427 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:45.184396    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"
Jul 15 12:51:45.184606 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:45.184430    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt" event={"ID":"3bc5ed44-1230-4dbf-8ccc-080ad0b329fa","Type":"ContainerDied","Data":"553508340a0afd81f4b0f90032861c06950ff7c480b1e5565c441783a7135dd1"}
Jul 15 12:51:45.184606 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:45.184488    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="553508340a0afd81f4b0f90032861c06950ff7c480b1e5565c441783a7135dd1"
Jul 15 12:51:45.222085 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:45.222055    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"]
Jul 15 12:51:45.228615 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:45.228592    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-cngxt"]
Jul 15 12:51:47.019672 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:51:47.019642    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" path="/var/lib/kubelet/pods/3bc5ed44-1230-4dbf-8ccc-080ad0b329fa/volumes"
Jul 15 12:52:24.902387 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.902350    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"]
Jul 15 12:52:24.902877 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.902634    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:24.902877 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.902645    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:24.902877 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.902666    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:24.902877 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.902672    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:24.902877 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.902713    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:24.902877 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.902739    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:24.905591 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.905576    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"
Jul 15 12:52:24.908620 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.908598    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2gg6\""
Jul 15 12:52:24.914078 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:24.914047    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"]
Jul 15 12:52:25.022536 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:25.022503    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da069d38-p9wvr\" (UID: \"fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"
Jul 15 12:52:25.123425 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:25.123391    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da069d38-p9wvr\" (UID: \"fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"
Jul 15 12:52:25.124042 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:25.124021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-da069d38-p9wvr\" (UID: \"fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"
Jul 15 12:52:25.216751 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:25.216645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"
Jul 15 12:52:25.344400 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:25.344350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"]
Jul 15 12:52:25.346980 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:52:25.346949    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8cb7a9_0b67_45ad_8e3b_da2e16bd2df0.slice/crio-b3d9e25740890e49da9cc4212615ff5ed16b10ba8565a7adf8b0233abdf93700 WatchSource:0}: Error finding container b3d9e25740890e49da9cc4212615ff5ed16b10ba8565a7adf8b0233abdf93700: Status 404 returned error can't find the container with id b3d9e25740890e49da9cc4212615ff5ed16b10ba8565a7adf8b0233abdf93700
Jul 15 12:52:26.350024 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:26.349994    2563 generic.go:356] "Generic (PLEG): container finished" podID="fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0" containerID="84cba3ab58308a7b976dcb89e814fb68645a7b1111f081a7c5a3332ae8e7d97e" exitCode=0
Jul 15 12:52:26.350392 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:26.350041    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr" event={"ID":"fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0","Type":"ContainerDied","Data":"84cba3ab58308a7b976dcb89e814fb68645a7b1111f081a7c5a3332ae8e7d97e"}
Jul 15 12:52:26.350392 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:26.350083    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr" event={"ID":"fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0","Type":"ContainerStarted","Data":"b3d9e25740890e49da9cc4212615ff5ed16b10ba8565a7adf8b0233abdf93700"}
Jul 15 12:52:26.527188 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:26.527153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:26.627050 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:26.626956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:27.483374 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:27.483352    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"
Jul 15 12:52:27.543444 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:27.543416    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0-maas-api-service-ca\") pod \"fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0\" (UID: \"fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0\") "
Jul 15 12:52:27.543786 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:27.543766    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0" (UID: "fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:52:27.644369 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:27.644282    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0-maas-api-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:52:28.359068 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:28.359036    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr"
Jul 15 12:52:28.359255 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:28.359067    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-da069d38-p9wvr" event={"ID":"fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0","Type":"ContainerDied","Data":"b3d9e25740890e49da9cc4212615ff5ed16b10ba8565a7adf8b0233abdf93700"}
Jul 15 12:52:28.359255 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:28.359121    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3d9e25740890e49da9cc4212615ff5ed16b10ba8565a7adf8b0233abdf93700"
Jul 15 12:52:35.522021 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:35.521982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:35.627188 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:35.627151    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:35.894693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:35.894659    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"]
Jul 15 12:52:35.894919 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:35.894893    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv" podUID="242f708f-cd61-40c2-b312-b5b8d686dd1f" containerName="maas-api" containerID="cri-o://33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625" gracePeriod=30
Jul 15 12:52:35.927878 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:35.927848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:36.132845 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.132823    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:52:36.212559 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.212464    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6wlc\" (UniqueName: \"kubernetes.io/projected/242f708f-cd61-40c2-b312-b5b8d686dd1f-kube-api-access-d6wlc\") pod \"242f708f-cd61-40c2-b312-b5b8d686dd1f\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") "
Jul 15 12:52:36.212752 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.212567    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242f708f-cd61-40c2-b312-b5b8d686dd1f-openshift-service-ca\") pod \"242f708f-cd61-40c2-b312-b5b8d686dd1f\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") "
Jul 15 12:52:36.212752 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.212673    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242f708f-cd61-40c2-b312-b5b8d686dd1f-maas-api-tls\") pod \"242f708f-cd61-40c2-b312-b5b8d686dd1f\" (UID: \"242f708f-cd61-40c2-b312-b5b8d686dd1f\") "
Jul 15 12:52:36.212958 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.212934    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/242f708f-cd61-40c2-b312-b5b8d686dd1f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "242f708f-cd61-40c2-b312-b5b8d686dd1f" (UID: "242f708f-cd61-40c2-b312-b5b8d686dd1f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:52:36.214702 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.214679    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/242f708f-cd61-40c2-b312-b5b8d686dd1f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "242f708f-cd61-40c2-b312-b5b8d686dd1f" (UID: "242f708f-cd61-40c2-b312-b5b8d686dd1f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:52:36.214702 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.214689    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/242f708f-cd61-40c2-b312-b5b8d686dd1f-kube-api-access-d6wlc" (OuterVolumeSpecName: "kube-api-access-d6wlc") pod "242f708f-cd61-40c2-b312-b5b8d686dd1f" (UID: "242f708f-cd61-40c2-b312-b5b8d686dd1f"). InnerVolumeSpecName "kube-api-access-d6wlc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:52:36.313262 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.313228    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/242f708f-cd61-40c2-b312-b5b8d686dd1f-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:52:36.313262 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.313260    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/242f708f-cd61-40c2-b312-b5b8d686dd1f-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:52:36.313262 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.313270    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6wlc\" (UniqueName: \"kubernetes.io/projected/242f708f-cd61-40c2-b312-b5b8d686dd1f-kube-api-access-d6wlc\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:52:36.392875 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.392844    2563 generic.go:356] "Generic (PLEG): container finished" podID="242f708f-cd61-40c2-b312-b5b8d686dd1f" containerID="33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625" exitCode=0
Jul 15 12:52:36.393022 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.392898    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv" event={"ID":"242f708f-cd61-40c2-b312-b5b8d686dd1f","Type":"ContainerDied","Data":"33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625"}
Jul 15 12:52:36.393022 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.392963    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv" event={"ID":"242f708f-cd61-40c2-b312-b5b8d686dd1f","Type":"ContainerDied","Data":"fc2e99130c28eba909712ddf6227a530a8f1252aef1520ff6ce2c13f23f22506"}
Jul 15 12:52:36.393022 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.392901    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"
Jul 15 12:52:36.393022 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.392987    2563 scope.go:117] "RemoveContainer" containerID="33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625"
Jul 15 12:52:36.400927 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.400904    2563 scope.go:117] "RemoveContainer" containerID="33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625"
Jul 15 12:52:36.401165 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:52:36.401145    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625\": container with ID starting with 33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625 not found: ID does not exist" containerID="33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625"
Jul 15 12:52:36.401220 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.401173    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625"} err="failed to get container status \"33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625\": rpc error: code = NotFound desc = could not find container \"33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625\": container with ID starting with 33e0af01e659340ab029c75e563a4e74b443e04f303fceb853f15221c0125625 not found: ID does not exist"
Jul 15 12:52:36.416944 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.416920    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"]
Jul 15 12:52:36.421434 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:36.421411    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-da069d38-547dcc5bb9-n4kxv"]
Jul 15 12:52:37.020000 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:37.019967    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="242f708f-cd61-40c2-b312-b5b8d686dd1f" path="/var/lib/kubelet/pods/242f708f-cd61-40c2-b312-b5b8d686dd1f/volumes"
Jul 15 12:52:38.823310 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:38.823273    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:52:40.007975 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:40.007944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:46.507338 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:46.507302    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:46.584633 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:46.584602    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:46.656714 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:46.656668    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:51.114320 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:51.114273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:51.441372 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:51.441329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:52.724326 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724296    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"]
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724549    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724560    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724567    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0" containerName="revoke-keys"
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724573    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0" containerName="revoke-keys"
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724585    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="242f708f-cd61-40c2-b312-b5b8d686dd1f" containerName="maas-api"
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724592    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="242f708f-cd61-40c2-b312-b5b8d686dd1f" containerName="maas-api"
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724641    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="242f708f-cd61-40c2-b312-b5b8d686dd1f" containerName="maas-api"
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724650    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc5ed44-1230-4dbf-8ccc-080ad0b329fa" containerName="revoke-keys"
Jul 15 12:52:52.724693 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.724655    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0" containerName="revoke-keys"
Jul 15 12:52:52.727512 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.727495    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.730518 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.730496    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-8e27a08d-serving-cert\""
Jul 15 12:52:52.730692 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.730674    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 12:52:52.731552 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.731530    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:52:52.731552 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.731542    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:52:52.744203 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.744176    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"]
Jul 15 12:52:52.859273 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.859238    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dad329e-d890-4752-a6ec-c96e4d39dddb-maas-api-tls\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.859436 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.859298    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72prd\" (UniqueName: \"kubernetes.io/projected/2dad329e-d890-4752-a6ec-c96e4d39dddb-kube-api-access-72prd\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.859436 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.859318    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dad329e-d890-4752-a6ec-c96e4d39dddb-openshift-service-ca\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.960646 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.960612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72prd\" (UniqueName: \"kubernetes.io/projected/2dad329e-d890-4752-a6ec-c96e4d39dddb-kube-api-access-72prd\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.960646 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.960645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dad329e-d890-4752-a6ec-c96e4d39dddb-openshift-service-ca\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.960920 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.960761    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dad329e-d890-4752-a6ec-c96e4d39dddb-maas-api-tls\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.961440 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.961418    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dad329e-d890-4752-a6ec-c96e4d39dddb-openshift-service-ca\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.963246 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.963220    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dad329e-d890-4752-a6ec-c96e4d39dddb-maas-api-tls\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:52.969900 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:52.969870    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72prd\" (UniqueName: \"kubernetes.io/projected/2dad329e-d890-4752-a6ec-c96e4d39dddb-kube-api-access-72prd\") pod \"maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:53.037676 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:53.037598    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:53.171471 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:53.171448    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"]
Jul 15 12:52:53.174118 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:52:53.174090    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dad329e_d890_4752_a6ec_c96e4d39dddb.slice/crio-849c0f5892c689d8177ec6512275e81f80065948a78af5e2c7696d51bef21d9f WatchSource:0}: Error finding container 849c0f5892c689d8177ec6512275e81f80065948a78af5e2c7696d51bef21d9f: Status 404 returned error can't find the container with id 849c0f5892c689d8177ec6512275e81f80065948a78af5e2c7696d51bef21d9f
Jul 15 12:52:53.462657 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:53.462620    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7" event={"ID":"2dad329e-d890-4752-a6ec-c96e4d39dddb","Type":"ContainerStarted","Data":"849c0f5892c689d8177ec6512275e81f80065948a78af5e2c7696d51bef21d9f"}
Jul 15 12:52:53.862317 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:53.862291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:53.961774 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:53.961703    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:54.468233 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:54.468199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7" event={"ID":"2dad329e-d890-4752-a6ec-c96e4d39dddb","Type":"ContainerStarted","Data":"e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415"}
Jul 15 12:52:54.468458 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:54.468272    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:52:54.489274 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:54.489218    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7" podStartSLOduration=1.859259476 podStartE2EDuration="2.489201235s" totalImagesPullingTime="629.941759ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:52:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:52:54.488748138 +0000 UTC m=+1758.037248398" watchObservedRunningTime="2026-07-15 12:52:54.489201235 +0000 UTC m=+1758.037701505"
Jul 15 12:52:55.238583 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:52:55.238544    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:53:00.479153 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:00.479116    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:53:03.006477 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:03.006433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:03.077953 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:03.077907    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:06.328011 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:06.327977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:36.990665 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:36.990632    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:53:36.993863 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:36.993841    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:53:47.045996 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.045962    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"]
Jul 15 12:53:47.048899 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.048884    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"
Jul 15 12:53:47.056514 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.056495    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2gg6\""
Jul 15 12:53:47.066454 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.066432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"]
Jul 15 12:53:47.189926 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.189889    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29da8286-8cea-4776-b556-610201f634df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz\" (UID: \"29da8286-8cea-4776-b556-610201f634df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"
Jul 15 12:53:47.291196 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.291165    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29da8286-8cea-4776-b556-610201f634df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz\" (UID: \"29da8286-8cea-4776-b556-610201f634df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"
Jul 15 12:53:47.291764 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.291747    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29da8286-8cea-4776-b556-610201f634df-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz\" (UID: \"29da8286-8cea-4776-b556-610201f634df\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"
Jul 15 12:53:47.358706 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.358626    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"
Jul 15 12:53:47.491032 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.490990    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"]
Jul 15 12:53:47.493915 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:53:47.493885    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29da8286_8cea_4776_b556_610201f634df.slice/crio-a50f5ac315c963cd96e80e94b1d4d6f43b8844dfb81e57a9b588b8c6afbdc997 WatchSource:0}: Error finding container a50f5ac315c963cd96e80e94b1d4d6f43b8844dfb81e57a9b588b8c6afbdc997: Status 404 returned error can't find the container with id a50f5ac315c963cd96e80e94b1d4d6f43b8844dfb81e57a9b588b8c6afbdc997
Jul 15 12:53:47.694964 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:47.694873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz" event={"ID":"29da8286-8cea-4776-b556-610201f634df","Type":"ContainerStarted","Data":"a50f5ac315c963cd96e80e94b1d4d6f43b8844dfb81e57a9b588b8c6afbdc997"}
Jul 15 12:53:48.700005 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:48.699967    2563 generic.go:356] "Generic (PLEG): container finished" podID="29da8286-8cea-4776-b556-610201f634df" containerID="b7c9d27b37fe0e2cb33ddb697b00a12f9f2682d719b8a1f1211f387f5c2e972b" exitCode=0
Jul 15 12:53:48.700369 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:48.700051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz" event={"ID":"29da8286-8cea-4776-b556-610201f634df","Type":"ContainerDied","Data":"b7c9d27b37fe0e2cb33ddb697b00a12f9f2682d719b8a1f1211f387f5c2e972b"}
Jul 15 12:53:49.825511 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:49.825488    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"
Jul 15 12:53:49.913893 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:49.913861    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29da8286-8cea-4776-b556-610201f634df-maas-api-service-ca\") pod \"29da8286-8cea-4776-b556-610201f634df\" (UID: \"29da8286-8cea-4776-b556-610201f634df\") "
Jul 15 12:53:49.914221 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:49.914198    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29da8286-8cea-4776-b556-610201f634df-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "29da8286-8cea-4776-b556-610201f634df" (UID: "29da8286-8cea-4776-b556-610201f634df"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:53:50.014502 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:50.014426    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/29da8286-8cea-4776-b556-610201f634df-maas-api-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:53:50.709500 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:50.709469    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz"
Jul 15 12:53:50.709708 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:50.709466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz" event={"ID":"29da8286-8cea-4776-b556-610201f634df","Type":"ContainerDied","Data":"a50f5ac315c963cd96e80e94b1d4d6f43b8844dfb81e57a9b588b8c6afbdc997"}
Jul 15 12:53:50.709708 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:50.709595    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a50f5ac315c963cd96e80e94b1d4d6f43b8844dfb81e57a9b588b8c6afbdc997"
Jul 15 12:53:57.666173 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:57.666136    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"]
Jul 15 12:53:57.666631 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:57.666383    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7" podUID="2dad329e-d890-4752-a6ec-c96e4d39dddb" containerName="maas-api" containerID="cri-o://e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415" gracePeriod=30
Jul 15 12:53:57.706285 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:57.706255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:57.920102 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:57.920048    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:53:58.080003 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.079968    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dad329e-d890-4752-a6ec-c96e4d39dddb-openshift-service-ca\") pod \"2dad329e-d890-4752-a6ec-c96e4d39dddb\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") "
Jul 15 12:53:58.080172 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.080062    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72prd\" (UniqueName: \"kubernetes.io/projected/2dad329e-d890-4752-a6ec-c96e4d39dddb-kube-api-access-72prd\") pod \"2dad329e-d890-4752-a6ec-c96e4d39dddb\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") "
Jul 15 12:53:58.080172 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.080118    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dad329e-d890-4752-a6ec-c96e4d39dddb-maas-api-tls\") pod \"2dad329e-d890-4752-a6ec-c96e4d39dddb\" (UID: \"2dad329e-d890-4752-a6ec-c96e4d39dddb\") "
Jul 15 12:53:58.080362 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.080337    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2dad329e-d890-4752-a6ec-c96e4d39dddb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2dad329e-d890-4752-a6ec-c96e4d39dddb" (UID: "2dad329e-d890-4752-a6ec-c96e4d39dddb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:53:58.082118 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.082083    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2dad329e-d890-4752-a6ec-c96e4d39dddb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2dad329e-d890-4752-a6ec-c96e4d39dddb" (UID: "2dad329e-d890-4752-a6ec-c96e4d39dddb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:53:58.082218 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.082128    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dad329e-d890-4752-a6ec-c96e4d39dddb-kube-api-access-72prd" (OuterVolumeSpecName: "kube-api-access-72prd") pod "2dad329e-d890-4752-a6ec-c96e4d39dddb" (UID: "2dad329e-d890-4752-a6ec-c96e4d39dddb"). InnerVolumeSpecName "kube-api-access-72prd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:53:58.180842 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.180764    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2dad329e-d890-4752-a6ec-c96e4d39dddb-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:53:58.180842 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.180792    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72prd\" (UniqueName: \"kubernetes.io/projected/2dad329e-d890-4752-a6ec-c96e4d39dddb-kube-api-access-72prd\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:53:58.180842 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.180803    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2dad329e-d890-4752-a6ec-c96e4d39dddb-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:53:58.742512 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.742478    2563 generic.go:356] "Generic (PLEG): container finished" podID="2dad329e-d890-4752-a6ec-c96e4d39dddb" containerID="e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415" exitCode=0
Jul 15 12:53:58.743007 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.742526    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"
Jul 15 12:53:58.743007 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.742549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7" event={"ID":"2dad329e-d890-4752-a6ec-c96e4d39dddb","Type":"ContainerDied","Data":"e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415"}
Jul 15 12:53:58.743007 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.742590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7" event={"ID":"2dad329e-d890-4752-a6ec-c96e4d39dddb","Type":"ContainerDied","Data":"849c0f5892c689d8177ec6512275e81f80065948a78af5e2c7696d51bef21d9f"}
Jul 15 12:53:58.743007 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.742613    2563 scope.go:117] "RemoveContainer" containerID="e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415"
Jul 15 12:53:58.750767 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.750751    2563 scope.go:117] "RemoveContainer" containerID="e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415"
Jul 15 12:53:58.751043 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:53:58.751021    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415\": container with ID starting with e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415 not found: ID does not exist" containerID="e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415"
Jul 15 12:53:58.751094 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.751064    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415"} err="failed to get container status \"e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415\": rpc error: code = NotFound desc = could not find container \"e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415\": container with ID starting with e2824a7cc2d50dd46986614273a0455c1dbdff12e15f686aa8f2b1b4e1fb9415 not found: ID does not exist"
Jul 15 12:53:58.778343 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.778313    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"]
Jul 15 12:53:58.800777 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:58.800755    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-8e27a08d-645d7669c4-ghlc7"]
Jul 15 12:53:59.019058 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:53:59.018982    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dad329e-d890-4752-a6ec-c96e4d39dddb" path="/var/lib/kubelet/pods/2dad329e-d890-4752-a6ec-c96e4d39dddb/volumes"
Jul 15 12:54:00.825470 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:00.825440    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:54:02.143423 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:02.143387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:08.881966 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:08.881898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:08.981850 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:08.981803    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:12.354584 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:12.354545    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:13.047525 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:13.047497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:13.141765 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:13.141705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:14.718853 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:14.718816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:18.936107 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:18.936068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:21.552740 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:21.552685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:21.654188 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:21.654158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:21.753959 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:21.753926    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:21.856262 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:21.856155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:22.276046 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:22.275956    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:48.271459 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:48.271427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:55.518991 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:55.518952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:55.649310 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:55.649273    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:55.774670 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:54:55.774581    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:11.734097 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:11.734054    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:16.852326 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:16.852288    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:17.999783 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:17.999748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:18.112687 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:18.112641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:18.201016 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:18.200982    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:27.166291 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:27.166256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:28.777389 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:28.777353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:29.623527 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:29.623491    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:35.801005 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:35.800814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:35.905499 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:35.905459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:36.000502 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:36.000472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:36.100936 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:36.100842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:36.960636 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:36.960598    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:37.094944 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:37.094906    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:37.237077 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:37.236990    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:38.529995 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:38.529965    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:55:38.903108 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:38.903064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:45.064015 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:45.063977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:45.158809 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:45.158772    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:45.778713 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:45.778681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:47.437157 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:47.437122    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:55:51.979999 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:51.979962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:55.129711 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.129672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:55.632220 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.632170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:55.751855 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.751820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:55.810296 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.810261    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"]
Jul 15 12:55:55.810523 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.810512    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29da8286-8cea-4776-b556-610201f634df" containerName="revoke-keys"
Jul 15 12:55:55.810596 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.810525    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="29da8286-8cea-4776-b556-610201f634df" containerName="revoke-keys"
Jul 15 12:55:55.810596 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.810539    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dad329e-d890-4752-a6ec-c96e4d39dddb" containerName="maas-api"
Jul 15 12:55:55.810596 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.810544    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dad329e-d890-4752-a6ec-c96e4d39dddb" containerName="maas-api"
Jul 15 12:55:55.810596 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.810595    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dad329e-d890-4752-a6ec-c96e4d39dddb" containerName="maas-api"
Jul 15 12:55:55.810719 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.810602    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="29da8286-8cea-4776-b556-610201f634df" containerName="revoke-keys"
Jul 15 12:55:55.813443 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.813425    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:55.817229 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.817207    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8635587b-serving-cert\""
Jul 15 12:55:55.817341 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.817235    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:55:55.817880 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.817859    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 12:55:55.817977 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.817870    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:55:55.843363 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.843322    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"]
Jul 15 12:55:55.870002 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.869964    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:55.877223 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.877195    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:55.877359 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.877237    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkjb2\" (UniqueName: \"kubernetes.io/projected/7ebc961c-4929-4808-a19f-8cc56b871f5f-kube-api-access-lkjb2\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:55.877359 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.877269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebc961c-4929-4808-a19f-8cc56b871f5f-openshift-service-ca\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:55.978045 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.977954    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebc961c-4929-4808-a19f-8cc56b871f5f-openshift-service-ca\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:55.978225 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.978048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:55.978225 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.978085    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkjb2\" (UniqueName: \"kubernetes.io/projected/7ebc961c-4929-4808-a19f-8cc56b871f5f-kube-api-access-lkjb2\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:55.978225 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:55:55.978190    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-serving-cert: secret "maas-api-e2e-mt-8635587b-serving-cert" not found
Jul 15 12:55:55.978380 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:55:55.978254    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls podName:7ebc961c-4929-4808-a19f-8cc56b871f5f nodeName:}" failed. No retries permitted until 2026-07-15 12:55:56.478236122 +0000 UTC m=+1940.026736371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls") pod "maas-api-e2e-mt-8635587b-755b44d75-z8xw7" (UID: "7ebc961c-4929-4808-a19f-8cc56b871f5f") : secret "maas-api-e2e-mt-8635587b-serving-cert" not found
Jul 15 12:55:55.978621 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:55.978597    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebc961c-4929-4808-a19f-8cc56b871f5f-openshift-service-ca\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:56.001429 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:56.001395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkjb2\" (UniqueName: \"kubernetes.io/projected/7ebc961c-4929-4808-a19f-8cc56b871f5f-kube-api-access-lkjb2\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:56.324839 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:56.324800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:56.482674 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:56.482634    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:56.485058 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:56.485037    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls\") pod \"maas-api-e2e-mt-8635587b-755b44d75-z8xw7\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:56.723268 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:56.723175    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:56.873864 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:56.873817    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"]
Jul 15 12:55:56.876615 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:55:56.876591    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebc961c_4929_4808_a19f_8cc56b871f5f.slice/crio-5eccd8a89b4f73cc48514fc6c96c3b680c93761c3feb42f5800cc16a5b7fd4e6 WatchSource:0}: Error finding container 5eccd8a89b4f73cc48514fc6c96c3b680c93761c3feb42f5800cc16a5b7fd4e6: Status 404 returned error can't find the container with id 5eccd8a89b4f73cc48514fc6c96c3b680c93761c3feb42f5800cc16a5b7fd4e6
Jul 15 12:55:56.877925 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:56.877909    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:55:57.218924 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:57.218882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:57.236524 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:57.236493    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7" event={"ID":"7ebc961c-4929-4808-a19f-8cc56b871f5f","Type":"ContainerStarted","Data":"5eccd8a89b4f73cc48514fc6c96c3b680c93761c3feb42f5800cc16a5b7fd4e6"}
Jul 15 12:55:57.322970 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:57.322935    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:58.241921 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:58.241887    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7" event={"ID":"7ebc961c-4929-4808-a19f-8cc56b871f5f","Type":"ContainerStarted","Data":"5fbfbf47ca00671f6108fdcb654789066bb1d1beafd9699b4abbc7e38c05286a"}
Jul 15 12:55:58.242365 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:58.242020    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:55:58.267991 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:55:58.267944    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7" podStartSLOduration=2.647774673 podStartE2EDuration="3.267926324s" totalImagesPullingTime="620.151651ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:55:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:55:58.265693658 +0000 UTC m=+1941.814193917" watchObservedRunningTime="2026-07-15 12:55:58.267926324 +0000 UTC m=+1941.816426592"
Jul 15 12:56:00.134590 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:00.134533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:00.902116 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:00.902078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:00.993862 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:00.993830    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:01.379359 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:01.379325    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:56:01.410907 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:01.410880    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:04.250920 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:04.250887    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:56:08.030478 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:08.030438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:08.143664 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:08.143626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:19.176015 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.175978    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"]
Jul 15 12:56:19.176498 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.176173    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7" podUID="7ebc961c-4929-4808-a19f-8cc56b871f5f" containerName="maas-api" containerID="cri-o://5fbfbf47ca00671f6108fdcb654789066bb1d1beafd9699b4abbc7e38c05286a" gracePeriod=30
Jul 15 12:56:19.218703 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.218676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:19.246587 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.246548    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7" podUID="7ebc961c-4929-4808-a19f-8cc56b871f5f" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.29:8443/health\": dial tcp 10.133.0.29:8443: connect: connection refused"
Jul 15 12:56:19.329652 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.329614    2563 generic.go:356] "Generic (PLEG): container finished" podID="7ebc961c-4929-4808-a19f-8cc56b871f5f" containerID="5fbfbf47ca00671f6108fdcb654789066bb1d1beafd9699b4abbc7e38c05286a" exitCode=0
Jul 15 12:56:19.329835 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.329679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7" event={"ID":"7ebc961c-4929-4808-a19f-8cc56b871f5f","Type":"ContainerDied","Data":"5fbfbf47ca00671f6108fdcb654789066bb1d1beafd9699b4abbc7e38c05286a"}
Jul 15 12:56:19.421944 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.421921    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:56:19.565004 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.564976    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebc961c-4929-4808-a19f-8cc56b871f5f-openshift-service-ca\") pod \"7ebc961c-4929-4808-a19f-8cc56b871f5f\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") "
Jul 15 12:56:19.565168 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.565032    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls\") pod \"7ebc961c-4929-4808-a19f-8cc56b871f5f\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") "
Jul 15 12:56:19.565168 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.565049    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkjb2\" (UniqueName: \"kubernetes.io/projected/7ebc961c-4929-4808-a19f-8cc56b871f5f-kube-api-access-lkjb2\") pod \"7ebc961c-4929-4808-a19f-8cc56b871f5f\" (UID: \"7ebc961c-4929-4808-a19f-8cc56b871f5f\") "
Jul 15 12:56:19.565425 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.565395    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ebc961c-4929-4808-a19f-8cc56b871f5f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7ebc961c-4929-4808-a19f-8cc56b871f5f" (UID: "7ebc961c-4929-4808-a19f-8cc56b871f5f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:56:19.567190 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.567157    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ebc961c-4929-4808-a19f-8cc56b871f5f-kube-api-access-lkjb2" (OuterVolumeSpecName: "kube-api-access-lkjb2") pod "7ebc961c-4929-4808-a19f-8cc56b871f5f" (UID: "7ebc961c-4929-4808-a19f-8cc56b871f5f"). InnerVolumeSpecName "kube-api-access-lkjb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:56:19.567190 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.567167    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7ebc961c-4929-4808-a19f-8cc56b871f5f" (UID: "7ebc961c-4929-4808-a19f-8cc56b871f5f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:56:19.666398 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.666366    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebc961c-4929-4808-a19f-8cc56b871f5f-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:56:19.666398 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.666395    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7ebc961c-4929-4808-a19f-8cc56b871f5f-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:56:19.666398 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:19.666404    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkjb2\" (UniqueName: \"kubernetes.io/projected/7ebc961c-4929-4808-a19f-8cc56b871f5f-kube-api-access-lkjb2\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:56:20.335304 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:20.335263    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7" event={"ID":"7ebc961c-4929-4808-a19f-8cc56b871f5f","Type":"ContainerDied","Data":"5eccd8a89b4f73cc48514fc6c96c3b680c93761c3feb42f5800cc16a5b7fd4e6"}
Jul 15 12:56:20.335757 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:20.335333    2563 scope.go:117] "RemoveContainer" containerID="5fbfbf47ca00671f6108fdcb654789066bb1d1beafd9699b4abbc7e38c05286a"
Jul 15 12:56:20.335757 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:20.335286    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"
Jul 15 12:56:20.359491 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:20.359454    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"]
Jul 15 12:56:20.364076 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:20.364053    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8635587b-755b44d75-z8xw7"]
Jul 15 12:56:21.018474 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:21.018438    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ebc961c-4929-4808-a19f-8cc56b871f5f" path="/var/lib/kubelet/pods/7ebc961c-4929-4808-a19f-8cc56b871f5f/volumes"
Jul 15 12:56:22.105041 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:22.105010    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:56:23.639783 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:23.639746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:29.813655 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:29.813571    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:30.121912 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:30.121814    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:34.366294 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:34.366262    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:34.783213 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:34.783119    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:34.885533 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:34.885501    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:34.987395 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:34.987360    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:37.043966 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:37.043938    2563 scope.go:117] "RemoveContainer" containerID="c5a167c10ebd8f4d6b0034633842d29019e145b4e94dfa8622edca7433b7e23a"
Jul 15 12:56:41.822927 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:41.822894    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:41.922555 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:41.922481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:48.022028 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:48.021992    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:48.126568 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:48.126529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:54.889801 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:54.889765    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:55.254377 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:55.254261    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:55.381873 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:55.381843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:57.861697 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.861654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:57.984226 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.984195    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"]
Jul 15 12:56:57.984455 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.984444    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ebc961c-4929-4808-a19f-8cc56b871f5f" containerName="maas-api"
Jul 15 12:56:57.984494 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.984457    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebc961c-4929-4808-a19f-8cc56b871f5f" containerName="maas-api"
Jul 15 12:56:57.984528 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.984507    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ebc961c-4929-4808-a19f-8cc56b871f5f" containerName="maas-api"
Jul 15 12:56:57.987262 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.987247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:57.991678 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.991659    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:56:57.992676 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.992656    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a2ddf8f4-serving-cert\""
Jul 15 12:56:57.992817 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.992800    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 12:56:57.993563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:57.993407    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:56:58.001309 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.001282    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:58.050963 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.050934    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"]
Jul 15 12:56:58.064610 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.064590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58caafe6-a9f9-4800-a529-4cce881544dc-openshift-service-ca\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.064694 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.064635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcvvq\" (UniqueName: \"kubernetes.io/projected/58caafe6-a9f9-4800-a529-4cce881544dc-kube-api-access-dcvvq\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.064759 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.064710    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.160009 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.159901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:58.165919 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.165894    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58caafe6-a9f9-4800-a529-4cce881544dc-openshift-service-ca\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.166060 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.165946    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcvvq\" (UniqueName: \"kubernetes.io/projected/58caafe6-a9f9-4800-a529-4cce881544dc-kube-api-access-dcvvq\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.166060 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.165997    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.166171 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:56:58.166114    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-serving-cert: secret "maas-api-e2e-mt-a2ddf8f4-serving-cert" not found
Jul 15 12:56:58.166221 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:56:58.166181    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls podName:58caafe6-a9f9-4800-a529-4cce881544dc nodeName:}" failed. No retries permitted until 2026-07-15 12:56:58.666159292 +0000 UTC m=+2002.214659557 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls") pod "maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds" (UID: "58caafe6-a9f9-4800-a529-4cce881544dc") : secret "maas-api-e2e-mt-a2ddf8f4-serving-cert" not found
Jul 15 12:56:58.166567 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.166547    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58caafe6-a9f9-4800-a529-4cce881544dc-openshift-service-ca\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.197617 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.197584    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcvvq\" (UniqueName: \"kubernetes.io/projected/58caafe6-a9f9-4800-a529-4cce881544dc-kube-api-access-dcvvq\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.334960 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.334928    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:58.671216 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.671182    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.673604 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.673571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls\") pod \"maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:58.848636 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.848578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:58.897079 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:58.897038    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:59.007542 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:59.007509    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:59.038053 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:59.038025    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"]
Jul 15 12:56:59.039906 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:56:59.039881    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58caafe6_a9f9_4800_a529_4cce881544dc.slice/crio-68caf47f9a72c1984e5f130e3a741a767572b9663e7aa99f37ad1b05f09d9080 WatchSource:0}: Error finding container 68caf47f9a72c1984e5f130e3a741a767572b9663e7aa99f37ad1b05f09d9080: Status 404 returned error can't find the container with id 68caf47f9a72c1984e5f130e3a741a767572b9663e7aa99f37ad1b05f09d9080
Jul 15 12:56:59.498413 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:59.498377    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds" event={"ID":"58caafe6-a9f9-4800-a529-4cce881544dc","Type":"ContainerStarted","Data":"fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9"}
Jul 15 12:56:59.498623 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:59.498437    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds" event={"ID":"58caafe6-a9f9-4800-a529-4cce881544dc","Type":"ContainerStarted","Data":"68caf47f9a72c1984e5f130e3a741a767572b9663e7aa99f37ad1b05f09d9080"}
Jul 15 12:56:59.498623 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:59.498463    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:56:59.517469 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:56:59.517422    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds" podStartSLOduration=2.176565585 podStartE2EDuration="2.517405321s" totalImagesPullingTime="340.839736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:56:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:56:59.516602855 +0000 UTC m=+2003.065103125" watchObservedRunningTime="2026-07-15 12:56:59.517405321 +0000 UTC m=+2003.065905619"
Jul 15 12:57:03.760331 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:03.760288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:57:04.043148 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:04.043057    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:05.508560 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:05.508527    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:57:07.082311 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:07.082252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:12.639848 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:12.639816    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:57:27.050447 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:27.050414    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:57:27.696028 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:27.695996    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:27.799531 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:27.799489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:31.601898 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:31.601863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:31.697500 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:31.697464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:41.792446 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:41.792410    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"]
Jul 15 12:57:41.793033 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:41.792606    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds" podUID="58caafe6-a9f9-4800-a529-4cce881544dc" containerName="maas-api" containerID="cri-o://fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9" gracePeriod=30
Jul 15 12:57:41.834611 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:41.834584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:42.039656 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.039625    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:57:42.129603 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.129567    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58caafe6-a9f9-4800-a529-4cce881544dc-openshift-service-ca\") pod \"58caafe6-a9f9-4800-a529-4cce881544dc\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") "
Jul 15 12:57:42.129826 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.129626    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls\") pod \"58caafe6-a9f9-4800-a529-4cce881544dc\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") "
Jul 15 12:57:42.129826 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.129657    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcvvq\" (UniqueName: \"kubernetes.io/projected/58caafe6-a9f9-4800-a529-4cce881544dc-kube-api-access-dcvvq\") pod \"58caafe6-a9f9-4800-a529-4cce881544dc\" (UID: \"58caafe6-a9f9-4800-a529-4cce881544dc\") "
Jul 15 12:57:42.129977 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.129951    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58caafe6-a9f9-4800-a529-4cce881544dc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "58caafe6-a9f9-4800-a529-4cce881544dc" (UID: "58caafe6-a9f9-4800-a529-4cce881544dc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:57:42.131774 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.131752    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "58caafe6-a9f9-4800-a529-4cce881544dc" (UID: "58caafe6-a9f9-4800-a529-4cce881544dc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:57:42.131835 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.131780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58caafe6-a9f9-4800-a529-4cce881544dc-kube-api-access-dcvvq" (OuterVolumeSpecName: "kube-api-access-dcvvq") pod "58caafe6-a9f9-4800-a529-4cce881544dc" (UID: "58caafe6-a9f9-4800-a529-4cce881544dc"). InnerVolumeSpecName "kube-api-access-dcvvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:57:42.230454 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.230416    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/58caafe6-a9f9-4800-a529-4cce881544dc-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:57:42.230454 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.230448    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcvvq\" (UniqueName: \"kubernetes.io/projected/58caafe6-a9f9-4800-a529-4cce881544dc-kube-api-access-dcvvq\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:57:42.230454 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.230464    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/58caafe6-a9f9-4800-a529-4cce881544dc-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 12:57:42.672404 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.672373    2563 generic.go:356] "Generic (PLEG): container finished" podID="58caafe6-a9f9-4800-a529-4cce881544dc" containerID="fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9" exitCode=0
Jul 15 12:57:42.672576 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.672416    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"
Jul 15 12:57:42.672576 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.672433    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds" event={"ID":"58caafe6-a9f9-4800-a529-4cce881544dc","Type":"ContainerDied","Data":"fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9"}
Jul 15 12:57:42.672576 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.672473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds" event={"ID":"58caafe6-a9f9-4800-a529-4cce881544dc","Type":"ContainerDied","Data":"68caf47f9a72c1984e5f130e3a741a767572b9663e7aa99f37ad1b05f09d9080"}
Jul 15 12:57:42.672576 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.672496    2563 scope.go:117] "RemoveContainer" containerID="fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9"
Jul 15 12:57:42.680300 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.680285    2563 scope.go:117] "RemoveContainer" containerID="fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9"
Jul 15 12:57:42.680518 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:57:42.680497    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9\": container with ID starting with fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9 not found: ID does not exist" containerID="fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9"
Jul 15 12:57:42.680564 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.680527    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9"} err="failed to get container status \"fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9\": rpc error: code = NotFound desc = could not find container \"fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9\": container with ID starting with fa2ce86ddf41ed874f4e6d6c1573c7c39aa389f30b086b72aef861d3360c6dd9 not found: ID does not exist"
Jul 15 12:57:42.713745 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.713703    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"]
Jul 15 12:57:42.719321 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:42.719298    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a2ddf8f4-d9976d558-9tfds"]
Jul 15 12:57:43.018681 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:43.018597    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58caafe6-a9f9-4800-a529-4cce881544dc" path="/var/lib/kubelet/pods/58caafe6-a9f9-4800-a529-4cce881544dc/volumes"
Jul 15 12:57:45.822253 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:45.822174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:57:45.984471 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:45.984439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:51.045963 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:57:51.045930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:16.924303 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:16.924267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:17.057935 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:17.057908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:27.222944 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:27.222905    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:30.008816 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:30.008781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:36.869566 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:36.869525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:37.012944 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:37.012911    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:58:37.018378 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:37.018356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 12:58:37.071808 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:37.071777    2563 scope.go:117] "RemoveContainer" containerID="3e40bfcd41e1cefec0d4646a1c0b93ce6d48e3e438dfacfdabe6db5413452eb9"
Jul 15 12:58:43.976031 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:43.975986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:44.076072 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:44.076033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:48.410280 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:48.410245    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:48.634051 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:48.634015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:49.670275 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:49.670236    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:49.762683 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:49.762638    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:49.866251 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:49.866214    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:50.660327 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:50.660287    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:50.802116 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:50.802082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:52.171565 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:52.171528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:52.256520 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:52.256482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:58:59.263051 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:59.263015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:59.371455 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:59.371426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:59.914116 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:58:59.914079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:04.556987 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:04.556956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:59:06.669234 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:06.669199    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:06.780297 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:06.780255    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:06.885269 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:06.885234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:17.416299 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:17.416232    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:17.755823 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:17.755707    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:38.794183 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:38.794100    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:45.405615 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:45.405578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:45.542044 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:45.541997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:45.834007 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:45.833966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:46.140027 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:46.139936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:46.304053 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:46.304009    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:49.644489 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.644452    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:49.741472 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.741443    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"]
Jul 15 12:59:49.741708 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.741696    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58caafe6-a9f9-4800-a529-4cce881544dc" containerName="maas-api"
Jul 15 12:59:49.741802 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.741708    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="58caafe6-a9f9-4800-a529-4cce881544dc" containerName="maas-api"
Jul 15 12:59:49.741802 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.741784    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="58caafe6-a9f9-4800-a529-4cce881544dc" containerName="maas-api"
Jul 15 12:59:49.744607 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.744587    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.747027 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.746997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:49.747587 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.747567    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:59:49.747696 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.747605    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-1fe3a4-serving-cert\""
Jul 15 12:59:49.747696 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.747617    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 12:59:49.748669 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.748654    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 12:59:49.756582 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.756561    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"]
Jul 15 12:59:49.819418 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.819380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560437f5-5e80-4423-96a3-dae6e515674e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.819613 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.819436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4kbw\" (UniqueName: \"kubernetes.io/projected/560437f5-5e80-4423-96a3-dae6e515674e-kube-api-access-d4kbw\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.819613 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.819499    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560437f5-5e80-4423-96a3-dae6e515674e-maas-api-tls\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.835341 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.835285    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:49.920346 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.920254    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560437f5-5e80-4423-96a3-dae6e515674e-maas-api-tls\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.920346 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.920291    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560437f5-5e80-4423-96a3-dae6e515674e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.920825 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.920548    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4kbw\" (UniqueName: \"kubernetes.io/projected/560437f5-5e80-4423-96a3-dae6e515674e-kube-api-access-d4kbw\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.921004 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.920988    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560437f5-5e80-4423-96a3-dae6e515674e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.922713 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.922692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560437f5-5e80-4423-96a3-dae6e515674e-maas-api-tls\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.929716 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.929696    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4kbw\" (UniqueName: \"kubernetes.io/projected/560437f5-5e80-4423-96a3-dae6e515674e-kube-api-access-d4kbw\") pod \"maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:49.977084 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:49.977056    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:50.054645 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:50.054608    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:50.183623 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:50.183482    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"]
Jul 15 12:59:50.186066 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:59:50.186032    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560437f5_5e80_4423_96a3_dae6e515674e.slice/crio-64be5b4ec948439981a26d2de5a3531e4b715239318909d62cc1c40b7cf8903c WatchSource:0}: Error finding container 64be5b4ec948439981a26d2de5a3531e4b715239318909d62cc1c40b7cf8903c: Status 404 returned error can't find the container with id 64be5b4ec948439981a26d2de5a3531e4b715239318909d62cc1c40b7cf8903c
Jul 15 12:59:50.196842 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:50.196817    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr" event={"ID":"560437f5-5e80-4423-96a3-dae6e515674e","Type":"ContainerStarted","Data":"64be5b4ec948439981a26d2de5a3531e4b715239318909d62cc1c40b7cf8903c"}
Jul 15 12:59:50.428779 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:50.428719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:50.528969 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:50.528860    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:52.205902 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:52.205866    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr" event={"ID":"560437f5-5e80-4423-96a3-dae6e515674e","Type":"ContainerStarted","Data":"f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c"}
Jul 15 12:59:52.206301 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:52.205968    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:52.228422 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:52.228376    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr" podStartSLOduration=2.147315603 podStartE2EDuration="3.228361292s" totalImagesPullingTime="1.081045689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:59:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:59:52.226401721 +0000 UTC m=+2175.774902001" watchObservedRunningTime="2026-07-15 12:59:52.228361292 +0000 UTC m=+2175.776861560"
Jul 15 12:59:54.161884 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:54.161843    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:54.530096 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:54.530003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:54.891359 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:54.891322    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:55.239168 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:55.239078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:55.770564 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:55.770532    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 12:59:57.727971 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.727936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:57.809513 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.809478    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"]
Jul 15 12:59:57.812843 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.812822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:57.815572 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.815553    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-34f439-serving-cert\""
Jul 15 12:59:57.826092 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.826054    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"]
Jul 15 12:59:57.840117 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.840004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:57.877933 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.877899    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r2mf\" (UniqueName: \"kubernetes.io/projected/f8e32096-1306-4479-ac66-fb72dd5156ef-kube-api-access-4r2mf\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:57.878093 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.877975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e32096-1306-4479-ac66-fb72dd5156ef-openshift-service-ca\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:57.878093 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.878003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:57.928671 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.928622    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:57.978982 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.978904    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r2mf\" (UniqueName: \"kubernetes.io/projected/f8e32096-1306-4479-ac66-fb72dd5156ef-kube-api-access-4r2mf\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:57.978982 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.978969    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e32096-1306-4479-ac66-fb72dd5156ef-openshift-service-ca\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:57.979162 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.978991    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:57.979162 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:59:57.979101    2563 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-serving-cert: secret "maas-api-e2e-inf-b-34f439-serving-cert" not found
Jul 15 12:59:57.979162 ip-10-0-138-184 kubenswrapper[2563]: E0715 12:59:57.979158    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls podName:f8e32096-1306-4479-ac66-fb72dd5156ef nodeName:}" failed. No retries permitted until 2026-07-15 12:59:58.479137302 +0000 UTC m=+2182.027637561 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls") pod "maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2" (UID: "f8e32096-1306-4479-ac66-fb72dd5156ef") : secret "maas-api-e2e-inf-b-34f439-serving-cert" not found
Jul 15 12:59:57.979604 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.979583    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e32096-1306-4479-ac66-fb72dd5156ef-openshift-service-ca\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:57.990756 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:57.990735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r2mf\" (UniqueName: \"kubernetes.io/projected/f8e32096-1306-4479-ac66-fb72dd5156ef-kube-api-access-4r2mf\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:58.150530 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:58.150494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:58.215563 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:58.215537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 12:59:58.484647 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:58.484600    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:58.487012 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:58.486982    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls\") pod \"maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:58.569430 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:58.569395    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:58.685553 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:58.685521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:58.723387 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:58.723359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 12:59:58.863060 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:58.863028    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"]
Jul 15 12:59:58.865774 ip-10-0-138-184 kubenswrapper[2563]: W0715 12:59:58.865737    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e32096_1306_4479_ac66_fb72dd5156ef.slice/crio-4908b3a6e7b860491a02413d9cea19e67be6f69a7dbed74955ddc370ddab7cb2 WatchSource:0}: Error finding container 4908b3a6e7b860491a02413d9cea19e67be6f69a7dbed74955ddc370ddab7cb2: Status 404 returned error can't find the container with id 4908b3a6e7b860491a02413d9cea19e67be6f69a7dbed74955ddc370ddab7cb2
Jul 15 12:59:59.233874 ip-10-0-138-184 kubenswrapper[2563]: I0715 12:59:59.233840    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2" event={"ID":"f8e32096-1306-4479-ac66-fb72dd5156ef","Type":"ContainerStarted","Data":"4908b3a6e7b860491a02413d9cea19e67be6f69a7dbed74955ddc370ddab7cb2"}
Jul 15 13:00:00.164557 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.164519    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2"]
Jul 15 13:00:00.168011 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.167759    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2"
Jul 15 13:00:00.172083 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.172046    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2gg6\""
Jul 15 13:00:00.177359 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.177341    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2"
Jul 15 13:00:00.182820 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.182785    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2"]
Jul 15 13:00:00.240342 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.240310    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2" event={"ID":"f8e32096-1306-4479-ac66-fb72dd5156ef","Type":"ContainerStarted","Data":"c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738"}
Jul 15 13:00:00.240496 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.240423    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 13:00:00.264577 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.264530    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2" podStartSLOduration=2.442790711 podStartE2EDuration="3.264516236s" totalImagesPullingTime="821.725525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:59:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:00:00.264486978 +0000 UTC m=+2183.812987248" watchObservedRunningTime="2026-07-15 13:00:00.264516236 +0000 UTC m=+2183.813016503"
Jul 15 13:00:00.305181 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:00.305149    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2"]
Jul 15 13:00:00.308811 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:00:00.308787    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129ab441_21f0_4ec1_90ad_5f6b4aa2ca6a.slice/crio-11abb100aa70f5031bf8a1784d51a4cbffcbe85c49149adb37b72170feab1c79 WatchSource:0}: Error finding container 11abb100aa70f5031bf8a1784d51a4cbffcbe85c49149adb37b72170feab1c79: Status 404 returned error can't find the container with id 11abb100aa70f5031bf8a1784d51a4cbffcbe85c49149adb37b72170feab1c79
Jul 15 13:00:01.246117 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:01.246089    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2" event={"ID":"129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a","Type":"ContainerStarted","Data":"5108368e4714d8fc15a2944cfbf259f4edbc82ebd43f326aecdb322dcb02d229"}
Jul 15 13:00:01.246424 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:01.246140    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2" event={"ID":"129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a","Type":"ContainerStarted","Data":"11abb100aa70f5031bf8a1784d51a4cbffcbe85c49149adb37b72170feab1c79"}
Jul 15 13:00:02.251094 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:02.251059    2563 generic.go:356] "Generic (PLEG): container finished" podID="129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a" containerID="5108368e4714d8fc15a2944cfbf259f4edbc82ebd43f326aecdb322dcb02d229" exitCode=0
Jul 15 13:00:02.251480 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:02.251099    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2" event={"ID":"129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a","Type":"ContainerDied","Data":"5108368e4714d8fc15a2944cfbf259f4edbc82ebd43f326aecdb322dcb02d229"}
Jul 15 13:00:02.380235 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:02.380213    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2"
Jul 15 13:00:02.616991 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:02.616958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:03.256308 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:03.256278    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2"
Jul 15 13:00:03.256794 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:03.256278    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-87nm2" event={"ID":"129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a","Type":"ContainerDied","Data":"11abb100aa70f5031bf8a1784d51a4cbffcbe85c49149adb37b72170feab1c79"}
Jul 15 13:00:03.256794 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:03.256408    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11abb100aa70f5031bf8a1784d51a4cbffcbe85c49149adb37b72170feab1c79"
Jul 15 13:00:05.760599 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:05.760561    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:06.251449 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:06.251423    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 13:00:08.847491 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:08.847452    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:00:11.526123 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:11.526089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:11.629212 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:11.629174    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:19.750025 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:19.749979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:20.098248 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:20.098214    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:21.763393 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:21.763358    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:00:26.363315 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.363275    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"]
Jul 15 13:00:26.363767 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.363599    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a" containerName="cleanup"
Jul 15 13:00:26.363767 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.363616    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a" containerName="cleanup"
Jul 15 13:00:26.363767 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.363699    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a" containerName="cleanup"
Jul 15 13:00:26.366530 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.366515    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.372182 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.372156    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-34f439\"/\"default-dockercfg-mbh8w\""
Jul 15 13:00:26.373233 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.373216    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-34f439\"/\"openshift-service-ca.crt\""
Jul 15 13:00:26.373333 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.373294    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-34f439\"/\"test-model-34f439-kserve-self-signed-certs\""
Jul 15 13:00:26.373394 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.373378    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-34f439\"/\"kube-root-ca.crt\""
Jul 15 13:00:26.396127 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.396098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"]
Jul 15 13:00:26.479304 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.479267    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:26.507345 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.507317    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-home\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.507511 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.507352    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-dshm\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.507511 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.507377    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0116e38d-4497-4498-8f8e-aa17d520e369-tls-certs\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.507511 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.507399    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq9p6\" (UniqueName: \"kubernetes.io/projected/0116e38d-4497-4498-8f8e-aa17d520e369-kube-api-access-mq9p6\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.507668 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.507530    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-model-cache\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.507668 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.507565    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-tmp-dir\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608415 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq9p6\" (UniqueName: \"kubernetes.io/projected/0116e38d-4497-4498-8f8e-aa17d520e369-kube-api-access-mq9p6\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608614 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608442    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-model-cache\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608614 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-tmp-dir\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608614 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608481    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-home\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608614 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608501    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-dshm\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608614 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0116e38d-4497-4498-8f8e-aa17d520e369-tls-certs\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608916 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608879    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-model-cache\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608958 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608915    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-home\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.608996 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.608971    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-tmp-dir\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.610772 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.610754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-dshm\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.611163 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.611144    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0116e38d-4497-4498-8f8e-aa17d520e369-tls-certs\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.641600 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.641546    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq9p6\" (UniqueName: \"kubernetes.io/projected/0116e38d-4497-4498-8f8e-aa17d520e369-kube-api-access-mq9p6\") pod \"test-model-34f439-kserve-875c556b7-hvpqr\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") " pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.675442 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.675414    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:26.813386 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:26.813359    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"]
Jul 15 13:00:26.815410 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:00:26.815381    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0116e38d_4497_4498_8f8e_aa17d520e369.slice/crio-8989417545b606b18729fc1d2113f516cf43caf202f45026b9c3f5f9d5678749 WatchSource:0}: Error finding container 8989417545b606b18729fc1d2113f516cf43caf202f45026b9c3f5f9d5678749: Status 404 returned error can't find the container with id 8989417545b606b18729fc1d2113f516cf43caf202f45026b9c3f5f9d5678749
Jul 15 13:00:27.357277 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:27.357241    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr" event={"ID":"0116e38d-4497-4498-8f8e-aa17d520e369","Type":"ContainerStarted","Data":"a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337"}
Jul 15 13:00:27.357277 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:27.357283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr" event={"ID":"0116e38d-4497-4498-8f8e-aa17d520e369","Type":"ContainerStarted","Data":"8989417545b606b18729fc1d2113f516cf43caf202f45026b9c3f5f9d5678749"}
Jul 15 13:00:27.382498 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:27.382445    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr" podStartSLOduration=1.382428978 podStartE2EDuration="1.382428978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:00:27.379613983 +0000 UTC m=+2210.928114250" watchObservedRunningTime="2026-07-15 13:00:27.382428978 +0000 UTC m=+2210.930929246"
Jul 15 13:00:34.367848 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:34.367813    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:00:36.675688 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:36.675656    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:36.675688 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:36.675699    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:36.688353 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:36.688330    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:37.408652 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:37.408624    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:00:44.737445 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:44.737404    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:45.946553 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:45.946519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:46.924812 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:46.924781    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"]
Jul 15 13:00:48.289343 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:48.289309    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:48.386015 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:48.385984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:49.237233 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:49.237198    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:00:57.768506 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:57.768475    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"]
Jul 15 13:00:57.768903 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:57.768697    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr" podUID="560437f5-5e80-4423-96a3-dae6e515674e" containerName="maas-api" containerID="cri-o://f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c" gracePeriod=30
Jul 15 13:00:57.806868 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:57.806827    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:58.012062 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.012040    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 13:00:58.065425 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.065399    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560437f5-5e80-4423-96a3-dae6e515674e-openshift-service-ca\") pod \"560437f5-5e80-4423-96a3-dae6e515674e\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") "
Jul 15 13:00:58.065617 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.065494    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560437f5-5e80-4423-96a3-dae6e515674e-maas-api-tls\") pod \"560437f5-5e80-4423-96a3-dae6e515674e\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") "
Jul 15 13:00:58.065617 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.065522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4kbw\" (UniqueName: \"kubernetes.io/projected/560437f5-5e80-4423-96a3-dae6e515674e-kube-api-access-d4kbw\") pod \"560437f5-5e80-4423-96a3-dae6e515674e\" (UID: \"560437f5-5e80-4423-96a3-dae6e515674e\") "
Jul 15 13:00:58.065779 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.065757    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/560437f5-5e80-4423-96a3-dae6e515674e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "560437f5-5e80-4423-96a3-dae6e515674e" (UID: "560437f5-5e80-4423-96a3-dae6e515674e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:00:58.066253 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.065874    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/560437f5-5e80-4423-96a3-dae6e515674e-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:00:58.067711 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.067684    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/560437f5-5e80-4423-96a3-dae6e515674e-kube-api-access-d4kbw" (OuterVolumeSpecName: "kube-api-access-d4kbw") pod "560437f5-5e80-4423-96a3-dae6e515674e" (UID: "560437f5-5e80-4423-96a3-dae6e515674e"). InnerVolumeSpecName "kube-api-access-d4kbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:00:58.067711 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.067684    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/560437f5-5e80-4423-96a3-dae6e515674e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "560437f5-5e80-4423-96a3-dae6e515674e" (UID: "560437f5-5e80-4423-96a3-dae6e515674e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:00:58.166776 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.166739    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/560437f5-5e80-4423-96a3-dae6e515674e-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:00:58.166776 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.166769    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4kbw\" (UniqueName: \"kubernetes.io/projected/560437f5-5e80-4423-96a3-dae6e515674e-kube-api-access-d4kbw\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:00:58.480255 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.480161    2563 generic.go:356] "Generic (PLEG): container finished" podID="560437f5-5e80-4423-96a3-dae6e515674e" containerID="f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c" exitCode=0
Jul 15 13:00:58.480255 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.480211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr" event={"ID":"560437f5-5e80-4423-96a3-dae6e515674e","Type":"ContainerDied","Data":"f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c"}
Jul 15 13:00:58.480255 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.480221    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"
Jul 15 13:00:58.480480 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.480258    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr" event={"ID":"560437f5-5e80-4423-96a3-dae6e515674e","Type":"ContainerDied","Data":"64be5b4ec948439981a26d2de5a3531e4b715239318909d62cc1c40b7cf8903c"}
Jul 15 13:00:58.480480 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.480282    2563 scope.go:117] "RemoveContainer" containerID="f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c"
Jul 15 13:00:58.489796 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.489773    2563 scope.go:117] "RemoveContainer" containerID="f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c"
Jul 15 13:00:58.490209 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:00:58.490067    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c\": container with ID starting with f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c not found: ID does not exist" containerID="f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c"
Jul 15 13:00:58.490209 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.490100    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c"} err="failed to get container status \"f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c\": rpc error: code = NotFound desc = could not find container \"f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c\": container with ID starting with f0ac353f368cd68d816d79ce38994472311ec2c8b462c7ef25e1e641c0c6de7c not found: ID does not exist"
Jul 15 13:00:58.514290 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.514257    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"]
Jul 15 13:00:58.517815 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:58.517791    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-1fe3a4-c8bf486b9-mnhlr"]
Jul 15 13:00:59.019574 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:00:59.019539    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="560437f5-5e80-4423-96a3-dae6e515674e" path="/var/lib/kubelet/pods/560437f5-5e80-4423-96a3-dae6e515674e/volumes"
Jul 15 13:01:01.943966 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:01.943906    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr" podUID="0116e38d-4497-4498-8f8e-aa17d520e369" containerName="main" containerID="cri-o://a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337" gracePeriod=45
Jul 15 13:01:01.982191 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:01:01.982163    2563 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0116e38d_4497_4498_8f8e_aa17d520e369.slice/crio-conmon-a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337.scope\": RecentStats: unable to find data in memory cache]"
Jul 15 13:01:02.155462 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.155427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:02.187868 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.187847    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:01:02.199799 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.199754    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-dshm\") pod \"0116e38d-4497-4498-8f8e-aa17d520e369\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") "
Jul 15 13:01:02.199799 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.199785    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-home\") pod \"0116e38d-4497-4498-8f8e-aa17d520e369\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") "
Jul 15 13:01:02.199917 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.199844    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-model-cache\") pod \"0116e38d-4497-4498-8f8e-aa17d520e369\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") "
Jul 15 13:01:02.199917 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.199871    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0116e38d-4497-4498-8f8e-aa17d520e369-tls-certs\") pod \"0116e38d-4497-4498-8f8e-aa17d520e369\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") "
Jul 15 13:01:02.199917 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.199887    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-tmp-dir\") pod \"0116e38d-4497-4498-8f8e-aa17d520e369\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") "
Jul 15 13:01:02.199917 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.199913    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mq9p6\" (UniqueName: \"kubernetes.io/projected/0116e38d-4497-4498-8f8e-aa17d520e369-kube-api-access-mq9p6\") pod \"0116e38d-4497-4498-8f8e-aa17d520e369\" (UID: \"0116e38d-4497-4498-8f8e-aa17d520e369\") "
Jul 15 13:01:02.200169 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.200134    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-home" (OuterVolumeSpecName: "home") pod "0116e38d-4497-4498-8f8e-aa17d520e369" (UID: "0116e38d-4497-4498-8f8e-aa17d520e369"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:02.200169 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.200147    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-model-cache" (OuterVolumeSpecName: "model-cache") pod "0116e38d-4497-4498-8f8e-aa17d520e369" (UID: "0116e38d-4497-4498-8f8e-aa17d520e369"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:02.200311 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.200180    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0116e38d-4497-4498-8f8e-aa17d520e369" (UID: "0116e38d-4497-4498-8f8e-aa17d520e369"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:02.201967 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.201944    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0116e38d-4497-4498-8f8e-aa17d520e369-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0116e38d-4497-4498-8f8e-aa17d520e369" (UID: "0116e38d-4497-4498-8f8e-aa17d520e369"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:01:02.202061 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.201980    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-dshm" (OuterVolumeSpecName: "dshm") pod "0116e38d-4497-4498-8f8e-aa17d520e369" (UID: "0116e38d-4497-4498-8f8e-aa17d520e369"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:01:02.202061 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.202002    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0116e38d-4497-4498-8f8e-aa17d520e369-kube-api-access-mq9p6" (OuterVolumeSpecName: "kube-api-access-mq9p6") pod "0116e38d-4497-4498-8f8e-aa17d520e369" (UID: "0116e38d-4497-4498-8f8e-aa17d520e369"). InnerVolumeSpecName "kube-api-access-mq9p6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:01:02.301175 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.301140    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-model-cache\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:02.301175 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.301170    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0116e38d-4497-4498-8f8e-aa17d520e369-tls-certs\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:02.301175 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.301182    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-tmp-dir\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:02.301395 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.301195    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mq9p6\" (UniqueName: \"kubernetes.io/projected/0116e38d-4497-4498-8f8e-aa17d520e369-kube-api-access-mq9p6\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:02.301395 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.301208    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-dshm\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:02.301395 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.301219    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0116e38d-4497-4498-8f8e-aa17d520e369-home\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:02.500684 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.500604    2563 generic.go:356] "Generic (PLEG): container finished" podID="0116e38d-4497-4498-8f8e-aa17d520e369" containerID="a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337" exitCode=0
Jul 15 13:01:02.500684 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.500644    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"
Jul 15 13:01:02.500890 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.500643    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr" event={"ID":"0116e38d-4497-4498-8f8e-aa17d520e369","Type":"ContainerDied","Data":"a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337"}
Jul 15 13:01:02.500890 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.500774    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr" event={"ID":"0116e38d-4497-4498-8f8e-aa17d520e369","Type":"ContainerDied","Data":"8989417545b606b18729fc1d2113f516cf43caf202f45026b9c3f5f9d5678749"}
Jul 15 13:01:02.500890 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.500802    2563 scope.go:117] "RemoveContainer" containerID="a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337"
Jul 15 13:01:02.509037 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.509019    2563 scope.go:117] "RemoveContainer" containerID="a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337"
Jul 15 13:01:02.509278 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:01:02.509257    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337\": container with ID starting with a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337 not found: ID does not exist" containerID="a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337"
Jul 15 13:01:02.509380 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.509283    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337"} err="failed to get container status \"a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337\": rpc error: code = NotFound desc = could not find container \"a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337\": container with ID starting with a918d523ab88c87cdd473217e02e493f56561ec2c2ce93f95d4ba34d92c42337 not found: ID does not exist"
Jul 15 13:01:02.522570 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.522549    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"]
Jul 15 13:01:02.526625 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:02.526606    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-34f439/test-model-34f439-kserve-875c556b7-hvpqr"]
Jul 15 13:01:03.018904 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:03.018865    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0116e38d-4497-4498-8f8e-aa17d520e369" path="/var/lib/kubelet/pods/0116e38d-4497-4498-8f8e-aa17d520e369/volumes"
Jul 15 13:01:08.282603 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:08.282563    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:08.324031 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:08.324000    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:01:08.383791 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:08.383744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:12.907605 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:12.907565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:13.178129 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:13.178046    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:13.929073 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:13.929033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:14.024629 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:14.024592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:23.808085 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:23.808051    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"]
Jul 15 13:01:23.808856 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:23.808369    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2" podUID="f8e32096-1306-4479-ac66-fb72dd5156ef" containerName="maas-api" containerID="cri-o://c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738" gracePeriod=30
Jul 15 13:01:23.842856 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:23.842828    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:25.048995 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.048972    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 13:01:25.171636 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.171546    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e32096-1306-4479-ac66-fb72dd5156ef-openshift-service-ca\") pod \"f8e32096-1306-4479-ac66-fb72dd5156ef\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") "
Jul 15 13:01:25.171636 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.171597    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls\") pod \"f8e32096-1306-4479-ac66-fb72dd5156ef\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") "
Jul 15 13:01:25.171881 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.171666    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4r2mf\" (UniqueName: \"kubernetes.io/projected/f8e32096-1306-4479-ac66-fb72dd5156ef-kube-api-access-4r2mf\") pod \"f8e32096-1306-4479-ac66-fb72dd5156ef\" (UID: \"f8e32096-1306-4479-ac66-fb72dd5156ef\") "
Jul 15 13:01:25.171922 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.171873    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8e32096-1306-4479-ac66-fb72dd5156ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8e32096-1306-4479-ac66-fb72dd5156ef" (UID: "f8e32096-1306-4479-ac66-fb72dd5156ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:01:25.173659 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.173631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8e32096-1306-4479-ac66-fb72dd5156ef-kube-api-access-4r2mf" (OuterVolumeSpecName: "kube-api-access-4r2mf") pod "f8e32096-1306-4479-ac66-fb72dd5156ef" (UID: "f8e32096-1306-4479-ac66-fb72dd5156ef"). InnerVolumeSpecName "kube-api-access-4r2mf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:01:25.173772 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.173666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8e32096-1306-4479-ac66-fb72dd5156ef" (UID: "f8e32096-1306-4479-ac66-fb72dd5156ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:01:25.272378 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.272345    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4r2mf\" (UniqueName: \"kubernetes.io/projected/f8e32096-1306-4479-ac66-fb72dd5156ef-kube-api-access-4r2mf\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:25.272378 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.272373    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8e32096-1306-4479-ac66-fb72dd5156ef-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:25.272378 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.272384    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8e32096-1306-4479-ac66-fb72dd5156ef-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:01:25.598739 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.598701    2563 generic.go:356] "Generic (PLEG): container finished" podID="f8e32096-1306-4479-ac66-fb72dd5156ef" containerID="c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738" exitCode=0
Jul 15 13:01:25.598930 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.598748    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2" event={"ID":"f8e32096-1306-4479-ac66-fb72dd5156ef","Type":"ContainerDied","Data":"c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738"}
Jul 15 13:01:25.598930 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.598762    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"
Jul 15 13:01:25.598930 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.598790    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2" event={"ID":"f8e32096-1306-4479-ac66-fb72dd5156ef","Type":"ContainerDied","Data":"4908b3a6e7b860491a02413d9cea19e67be6f69a7dbed74955ddc370ddab7cb2"}
Jul 15 13:01:25.598930 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.598812    2563 scope.go:117] "RemoveContainer" containerID="c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738"
Jul 15 13:01:25.608818 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.608666    2563 scope.go:117] "RemoveContainer" containerID="c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738"
Jul 15 13:01:25.609093 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:01:25.609051    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738\": container with ID starting with c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738 not found: ID does not exist" containerID="c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738"
Jul 15 13:01:25.609198 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.609098    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738"} err="failed to get container status \"c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738\": rpc error: code = NotFound desc = could not find container \"c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738\": container with ID starting with c378a70bb4fde4279a77c2eb5f32797628f8c3106f96c3ba92f4889c13411738 not found: ID does not exist"
Jul 15 13:01:25.626500 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.626475    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"]
Jul 15 13:01:25.628896 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.628874    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-34f439-668649fbc7-wc4m2"]
Jul 15 13:01:25.843655 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:25.843618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:01:27.020346 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:27.020302    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8e32096-1306-4479-ac66-fb72dd5156ef" path="/var/lib/kubelet/pods/f8e32096-1306-4479-ac66-fb72dd5156ef/volumes"
Jul 15 13:01:28.391952 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:28.391912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:35.039205 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:35.039170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:36.853413 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:36.853379    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:39.149714 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:39.149679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:39.357665 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:39.357628    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:39.722854 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:39.722824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:40.027987 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:40.027901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:40.417939 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:40.417903    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:43.353491 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.353450    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:43.380515 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380485    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"]
Jul 15 13:01:43.380759 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380746    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="560437f5-5e80-4423-96a3-dae6e515674e" containerName="maas-api"
Jul 15 13:01:43.380819 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380761    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="560437f5-5e80-4423-96a3-dae6e515674e" containerName="maas-api"
Jul 15 13:01:43.380819 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380776    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8e32096-1306-4479-ac66-fb72dd5156ef" containerName="maas-api"
Jul 15 13:01:43.380819 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380782    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8e32096-1306-4479-ac66-fb72dd5156ef" containerName="maas-api"
Jul 15 13:01:43.380819 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380788    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0116e38d-4497-4498-8f8e-aa17d520e369" containerName="main"
Jul 15 13:01:43.380819 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380795    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0116e38d-4497-4498-8f8e-aa17d520e369" containerName="main"
Jul 15 13:01:43.380986 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380839    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="560437f5-5e80-4423-96a3-dae6e515674e" containerName="maas-api"
Jul 15 13:01:43.380986 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380846    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0116e38d-4497-4498-8f8e-aa17d520e369" containerName="main"
Jul 15 13:01:43.380986 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.380852    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8e32096-1306-4479-ac66-fb72dd5156ef" containerName="maas-api"
Jul 15 13:01:43.383425 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.383409    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.386135 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.386114    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-9c73fd-serving-cert\""
Jul 15 13:01:43.387308 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.387284    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 13:01:43.387406 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.387330    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 13:01:43.387406 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.387367    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 13:01:43.400615 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.400597    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"]
Jul 15 13:01:43.507737 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.507690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:43.513898 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.513858    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-openshift-service-ca\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.514039 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.513964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-maas-api-tls\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.514039 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.514013    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzj5t\" (UniqueName: \"kubernetes.io/projected/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-kube-api-access-lzj5t\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.614795 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.614677    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-maas-api-tls\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.614795 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.614757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzj5t\" (UniqueName: \"kubernetes.io/projected/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-kube-api-access-lzj5t\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.615006 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.614825    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-openshift-service-ca\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.615524 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.615497    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-openshift-service-ca\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.617262 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.617243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-maas-api-tls\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.624406 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.624384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzj5t\" (UniqueName: \"kubernetes.io/projected/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-kube-api-access-lzj5t\") pod \"maas-api-e2e-api-a-9c73fd-56d79bc974-g258m\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.644491 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.644460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:43.693338 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.693303    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:43.830265 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.830229    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"]
Jul 15 13:01:43.833319 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:01:43.833290    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ca6ec7c_cb1e_40a7_97f1_bd2ec7ee08b7.slice/crio-cafc68a681face2b734f9385c4aab1120655f82798665d87660403bd82da23ec WatchSource:0}: Error finding container cafc68a681face2b734f9385c4aab1120655f82798665d87660403bd82da23ec: Status 404 returned error can't find the container with id cafc68a681face2b734f9385c4aab1120655f82798665d87660403bd82da23ec
Jul 15 13:01:43.834845 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:43.834825    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:01:44.004852 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:44.004762    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:44.129044 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:44.129006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:44.675639 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:44.675559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m" event={"ID":"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7","Type":"ContainerStarted","Data":"7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808"}
Jul 15 13:01:44.675639 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:44.675619    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m" event={"ID":"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7","Type":"ContainerStarted","Data":"cafc68a681face2b734f9385c4aab1120655f82798665d87660403bd82da23ec"}
Jul 15 13:01:44.676073 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:44.675662    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:44.700691 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:44.700639    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m" podStartSLOduration=1.159537294 podStartE2EDuration="1.700623279s" totalImagesPullingTime="541.085985ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:01:44.69950379 +0000 UTC m=+2288.248004069" watchObservedRunningTime="2026-07-15 13:01:44.700623279 +0000 UTC m=+2288.249123546"
Jul 15 13:01:47.788548 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:47.788508    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:48.261990 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:48.261960    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:48.663165 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:48.663128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:48.850772 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:48.850739    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:01:49.326200 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:49.326169    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:50.685382 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:50.685348    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:01:51.342422 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.342363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:51.463429 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.463391    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"]
Jul 15 13:01:51.466503 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.466480    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.469821 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.469802    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-8a1d21-serving-cert\""
Jul 15 13:01:51.486287 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.486255    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"]
Jul 15 13:01:51.579168 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.579135    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6321a67-b6ef-49f2-a421-d851ffc54d02-maas-api-tls\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.579360 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.579177    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6321a67-b6ef-49f2-a421-d851ffc54d02-openshift-service-ca\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.579360 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.579201    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9nbw\" (UniqueName: \"kubernetes.io/projected/f6321a67-b6ef-49f2-a421-d851ffc54d02-kube-api-access-q9nbw\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.660408 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.660310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:51.680315 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.680285    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6321a67-b6ef-49f2-a421-d851ffc54d02-maas-api-tls\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.680463 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.680323    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6321a67-b6ef-49f2-a421-d851ffc54d02-openshift-service-ca\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.680463 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.680344    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9nbw\" (UniqueName: \"kubernetes.io/projected/f6321a67-b6ef-49f2-a421-d851ffc54d02-kube-api-access-q9nbw\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.680935 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.680906    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6321a67-b6ef-49f2-a421-d851ffc54d02-openshift-service-ca\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.682783 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.682765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6321a67-b6ef-49f2-a421-d851ffc54d02-maas-api-tls\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.689921 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.689901    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9nbw\" (UniqueName: \"kubernetes.io/projected/f6321a67-b6ef-49f2-a421-d851ffc54d02-kube-api-access-q9nbw\") pod \"maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.761420 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.761384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:51.777644 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.777616    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:51.915677 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:51.915655    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"]
Jul 15 13:01:51.917640 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:01:51.917612    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6321a67_b6ef_49f2_a421_d851ffc54d02.slice/crio-62045b2990e5ca0f802464ba1a7a30fc466654bef82d4c800443edc619a96913 WatchSource:0}: Error finding container 62045b2990e5ca0f802464ba1a7a30fc466654bef82d4c800443edc619a96913: Status 404 returned error can't find the container with id 62045b2990e5ca0f802464ba1a7a30fc466654bef82d4c800443edc619a96913
Jul 15 13:01:52.038747 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:52.038696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:52.320568 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:52.320531    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:52.714197 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:52.714109    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g" event={"ID":"f6321a67-b6ef-49f2-a421-d851ffc54d02","Type":"ContainerStarted","Data":"354b62a7e6bfc81fec50a03fb8f1e0ff3b61a67cc41bd36e78d424f0e288cee5"}
Jul 15 13:01:52.714636 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:52.714196    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g" event={"ID":"f6321a67-b6ef-49f2-a421-d851ffc54d02","Type":"ContainerStarted","Data":"62045b2990e5ca0f802464ba1a7a30fc466654bef82d4c800443edc619a96913"}
Jul 15 13:01:52.714636 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:52.714225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:01:52.738220 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:52.738170    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g" podStartSLOduration=1.314337579 podStartE2EDuration="1.738155808s" totalImagesPullingTime="423.818229ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:01:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:01:52.736608164 +0000 UTC m=+2296.285108433" watchObservedRunningTime="2026-07-15 13:01:52.738155808 +0000 UTC m=+2296.286656075"
Jul 15 13:01:55.855172 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:55.855120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:58.724539 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:01:58.724504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:02:02.054822 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:02.054786    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:02:04.653211 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:04.653175    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:04.757991 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:04.757953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:12.879804 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:12.879768    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:12.976475 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:12.976438    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:14.715443 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:14.715411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:14.814742 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:14.814692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:14.950236 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:14.950202    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"]
Jul 15 13:02:14.950464 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:14.950440    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m" podUID="6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" containerName="maas-api" containerID="cri-o://7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808" gracePeriod=30
Jul 15 13:02:14.979907 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:14.979836    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:15.189468 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.189443    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:02:15.274129 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.274056    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lzj5t\" (UniqueName: \"kubernetes.io/projected/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-kube-api-access-lzj5t\") pod \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") "
Jul 15 13:02:15.274129 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.274091    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-openshift-service-ca\") pod \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") "
Jul 15 13:02:15.274294 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.274159    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-maas-api-tls\") pod \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\" (UID: \"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7\") "
Jul 15 13:02:15.274511 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.274477    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" (UID: "6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:02:15.276127 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.276099    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" (UID: "6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:02:15.276206 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.276126    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-kube-api-access-lzj5t" (OuterVolumeSpecName: "kube-api-access-lzj5t") pod "6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" (UID: "6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7"). InnerVolumeSpecName "kube-api-access-lzj5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:02:15.375228 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.375203    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:02:15.375228 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.375227    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzj5t\" (UniqueName: \"kubernetes.io/projected/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-kube-api-access-lzj5t\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:02:15.375415 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.375236    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:02:15.810109 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.810077    2563 generic.go:356] "Generic (PLEG): container finished" podID="6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" containerID="7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808" exitCode=0
Jul 15 13:02:15.810504 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.810127    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"
Jul 15 13:02:15.810504 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.810141    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m" event={"ID":"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7","Type":"ContainerDied","Data":"7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808"}
Jul 15 13:02:15.810504 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.810179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m" event={"ID":"6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7","Type":"ContainerDied","Data":"cafc68a681face2b734f9385c4aab1120655f82798665d87660403bd82da23ec"}
Jul 15 13:02:15.810504 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.810200    2563 scope.go:117] "RemoveContainer" containerID="7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808"
Jul 15 13:02:15.818850 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.818834    2563 scope.go:117] "RemoveContainer" containerID="7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808"
Jul 15 13:02:15.819083 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:02:15.819064    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808\": container with ID starting with 7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808 not found: ID does not exist" containerID="7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808"
Jul 15 13:02:15.819128 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.819091    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808"} err="failed to get container status \"7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808\": rpc error: code = NotFound desc = could not find container \"7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808\": container with ID starting with 7b58dc858c7cc22a77532ccdd707f0bf8b5113e95230dc1082a4d52c6a8d2808 not found: ID does not exist"
Jul 15 13:02:15.831167 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.831145    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"]
Jul 15 13:02:15.833096 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:15.833076    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-9c73fd-56d79bc974-g258m"]
Jul 15 13:02:16.829804 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:16.829772    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:02:17.019047 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:17.019016    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" path="/var/lib/kubelet/pods/6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7/volumes"
Jul 15 13:02:19.141543 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:19.141505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:25.704683 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:25.704646    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:26.817071 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:26.816997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:28.595804 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:28.595767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:28.715433 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:28.715394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:29.835666 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:29.835587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:30.109640 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:30.109546    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:30.794038 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:30.794005    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:30.894781 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:30.894733    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:40.718390 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:40.718353    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"]
Jul 15 13:02:40.718838 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:40.718633    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g" podUID="f6321a67-b6ef-49f2-a421-d851ffc54d02" containerName="maas-api" containerID="cri-o://354b62a7e6bfc81fec50a03fb8f1e0ff3b61a67cc41bd36e78d424f0e288cee5" gracePeriod=30
Jul 15 13:02:40.762510 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:40.762478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:40.921628 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:40.921592    2563 generic.go:356] "Generic (PLEG): container finished" podID="f6321a67-b6ef-49f2-a421-d851ffc54d02" containerID="354b62a7e6bfc81fec50a03fb8f1e0ff3b61a67cc41bd36e78d424f0e288cee5" exitCode=0
Jul 15 13:02:40.921846 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:40.921660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g" event={"ID":"f6321a67-b6ef-49f2-a421-d851ffc54d02","Type":"ContainerDied","Data":"354b62a7e6bfc81fec50a03fb8f1e0ff3b61a67cc41bd36e78d424f0e288cee5"}
Jul 15 13:02:40.961892 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:40.961870    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:02:41.067434 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.067406    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6321a67-b6ef-49f2-a421-d851ffc54d02-maas-api-tls\") pod \"f6321a67-b6ef-49f2-a421-d851ffc54d02\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") "
Jul 15 13:02:41.067599 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.067498    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9nbw\" (UniqueName: \"kubernetes.io/projected/f6321a67-b6ef-49f2-a421-d851ffc54d02-kube-api-access-q9nbw\") pod \"f6321a67-b6ef-49f2-a421-d851ffc54d02\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") "
Jul 15 13:02:41.067599 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.067530    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6321a67-b6ef-49f2-a421-d851ffc54d02-openshift-service-ca\") pod \"f6321a67-b6ef-49f2-a421-d851ffc54d02\" (UID: \"f6321a67-b6ef-49f2-a421-d851ffc54d02\") "
Jul 15 13:02:41.067946 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.067916    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6321a67-b6ef-49f2-a421-d851ffc54d02-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6321a67-b6ef-49f2-a421-d851ffc54d02" (UID: "f6321a67-b6ef-49f2-a421-d851ffc54d02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:02:41.069383 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.069353    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6321a67-b6ef-49f2-a421-d851ffc54d02-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6321a67-b6ef-49f2-a421-d851ffc54d02" (UID: "f6321a67-b6ef-49f2-a421-d851ffc54d02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:02:41.069472 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.069452    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6321a67-b6ef-49f2-a421-d851ffc54d02-kube-api-access-q9nbw" (OuterVolumeSpecName: "kube-api-access-q9nbw") pod "f6321a67-b6ef-49f2-a421-d851ffc54d02" (UID: "f6321a67-b6ef-49f2-a421-d851ffc54d02"). InnerVolumeSpecName "kube-api-access-q9nbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:02:41.168561 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.168524    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9nbw\" (UniqueName: \"kubernetes.io/projected/f6321a67-b6ef-49f2-a421-d851ffc54d02-kube-api-access-q9nbw\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:02:41.168561 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.168555    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6321a67-b6ef-49f2-a421-d851ffc54d02-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:02:41.168561 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.168566    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6321a67-b6ef-49f2-a421-d851ffc54d02-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:02:41.926795 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.926761    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"
Jul 15 13:02:41.926795 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.926778    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g" event={"ID":"f6321a67-b6ef-49f2-a421-d851ffc54d02","Type":"ContainerDied","Data":"62045b2990e5ca0f802464ba1a7a30fc466654bef82d4c800443edc619a96913"}
Jul 15 13:02:41.927265 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.926840    2563 scope.go:117] "RemoveContainer" containerID="354b62a7e6bfc81fec50a03fb8f1e0ff3b61a67cc41bd36e78d424f0e288cee5"
Jul 15 13:02:41.948816 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.948784    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"]
Jul 15 13:02:41.952700 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:41.952677    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-8a1d21-7f54d8fbf8-z5t9g"]
Jul 15 13:02:43.019320 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:43.019287    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6321a67-b6ef-49f2-a421-d851ffc54d02" path="/var/lib/kubelet/pods/f6321a67-b6ef-49f2-a421-d851ffc54d02/volumes"
Jul 15 13:02:43.426155 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:43.426121    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:02:45.372104 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:45.372065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:49.481208 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:49.481160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:52.824371 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:52.824333    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:53.004116 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:53.004080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:56.145107 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:56.145075    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:56.416426 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:56.416336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:56.792604 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:56.792520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:57.117439 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:57.117399    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:57.392101 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:57.391972    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:59.688036 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.688004    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:59.837019 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.836980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:59.921514 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.921489    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"]
Jul 15 13:02:59.921805 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.921791    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" containerName="maas-api"
Jul 15 13:02:59.921861 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.921807    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" containerName="maas-api"
Jul 15 13:02:59.921861 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.921816    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6321a67-b6ef-49f2-a421-d851ffc54d02" containerName="maas-api"
Jul 15 13:02:59.921861 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.921821    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6321a67-b6ef-49f2-a421-d851ffc54d02" containerName="maas-api"
Jul 15 13:02:59.921958 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.921867    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ca6ec7c-cb1e-40a7-97f1-bd2ec7ee08b7" containerName="maas-api"
Jul 15 13:02:59.921958 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.921878    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6321a67-b6ef-49f2-a421-d851ffc54d02" containerName="maas-api"
Jul 15 13:02:59.924714 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.924695    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:02:59.927416 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.927397    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-ce0265-serving-cert\""
Jul 15 13:02:59.927981 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.927965    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 13:02:59.928853 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.928838    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-gw8fc\""
Jul 15 13:02:59.928903 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.928868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 13:02:59.940868 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:02:59.940809    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"]
Jul 15 13:03:00.020960 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.020933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fb0fd8-794f-4ded-91d4-71c05cff0142-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.021148 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.020982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7fb0fd8-794f-4ded-91d4-71c05cff0142-maas-api-tls\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.021148 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.021060    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx9j5\" (UniqueName: \"kubernetes.io/projected/b7fb0fd8-794f-4ded-91d4-71c05cff0142-kube-api-access-zx9j5\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.108280 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.108247    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:00.121892 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.121862    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7fb0fd8-794f-4ded-91d4-71c05cff0142-maas-api-tls\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.122004 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.121907    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx9j5\" (UniqueName: \"kubernetes.io/projected/b7fb0fd8-794f-4ded-91d4-71c05cff0142-kube-api-access-zx9j5\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.122004 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.121948    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fb0fd8-794f-4ded-91d4-71c05cff0142-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.122506 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.122486    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fb0fd8-794f-4ded-91d4-71c05cff0142-openshift-service-ca\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.124113 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.124086    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7fb0fd8-794f-4ded-91d4-71c05cff0142-maas-api-tls\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.131461 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.131438    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx9j5\" (UniqueName: \"kubernetes.io/projected/b7fb0fd8-794f-4ded-91d4-71c05cff0142-kube-api-access-zx9j5\") pod \"maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.234221 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.234118    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:00.280021 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.279987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:00.380517 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.380483    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"]
Jul 15 13:03:00.383297 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:03:00.383268    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7fb0fd8_794f_4ded_91d4_71c05cff0142.slice/crio-71c1918f0b176d81cf13cc5e000274b9c6ae949cb2eb61bc0dceab9f66c90db8 WatchSource:0}: Error finding container 71c1918f0b176d81cf13cc5e000274b9c6ae949cb2eb61bc0dceab9f66c90db8: Status 404 returned error can't find the container with id 71c1918f0b176d81cf13cc5e000274b9c6ae949cb2eb61bc0dceab9f66c90db8
Jul 15 13:03:00.610367 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.610335    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:00.746632 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:00.746599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:01.006847 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:01.006764    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm" event={"ID":"b7fb0fd8-794f-4ded-91d4-71c05cff0142","Type":"ContainerStarted","Data":"c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0"}
Jul 15 13:03:01.006847 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:01.006812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm" event={"ID":"b7fb0fd8-794f-4ded-91d4-71c05cff0142","Type":"ContainerStarted","Data":"71c1918f0b176d81cf13cc5e000274b9c6ae949cb2eb61bc0dceab9f66c90db8"}
Jul 15 13:03:01.007030 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:01.006929    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:01.030864 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:01.030809    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm" podStartSLOduration=1.66214699 podStartE2EDuration="2.030794125s" totalImagesPullingTime="368.647135ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:02:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:03:01.030377783 +0000 UTC m=+2364.578878051" watchObservedRunningTime="2026-07-15 13:03:01.030794125 +0000 UTC m=+2364.579294392"
Jul 15 13:03:04.362394 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:04.362364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:04.587587 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:04.587553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:04.918408 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:04.918298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:05.085683 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:05.085643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:05.423350 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:05.423317    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:03:07.019033 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.019009    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:03:07.785005 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.784970    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"]
Jul 15 13:03:07.788184 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.788168    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:07.790855 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.790834    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-958618-serving-cert\""
Jul 15 13:03:07.811177 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.811156    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"]
Jul 15 13:03:07.835686 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.835654    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:07.891239 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.891125    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f9222e-8618-4613-8d27-d7734bdb82e4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:07.892171 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.891634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdm5m\" (UniqueName: \"kubernetes.io/projected/04f9222e-8618-4613-8d27-d7734bdb82e4-kube-api-access-xdm5m\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:07.892171 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.891847    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f9222e-8618-4613-8d27-d7734bdb82e4-maas-api-tls\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:07.993281 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.993245    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f9222e-8618-4613-8d27-d7734bdb82e4-maas-api-tls\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:07.993462 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.993313    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f9222e-8618-4613-8d27-d7734bdb82e4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:07.993462 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.993365    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdm5m\" (UniqueName: \"kubernetes.io/projected/04f9222e-8618-4613-8d27-d7734bdb82e4-kube-api-access-xdm5m\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:07.994046 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.994021    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f9222e-8618-4613-8d27-d7734bdb82e4-openshift-service-ca\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:07.995597 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:07.995580    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f9222e-8618-4613-8d27-d7734bdb82e4-maas-api-tls\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:08.002772 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:08.002753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdm5m\" (UniqueName: \"kubernetes.io/projected/04f9222e-8618-4613-8d27-d7734bdb82e4-kube-api-access-xdm5m\") pod \"maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:08.084836 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:08.084800    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:08.097848 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:08.097829    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:08.241395 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:08.241371    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"]
Jul 15 13:03:08.243488 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:03:08.243459    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04f9222e_8618_4613_8d27_d7734bdb82e4.slice/crio-46f2086a8ff84827818be8881caea1b9fd71522eca006e160ee83f18be7b28c8 WatchSource:0}: Error finding container 46f2086a8ff84827818be8881caea1b9fd71522eca006e160ee83f18be7b28c8: Status 404 returned error can't find the container with id 46f2086a8ff84827818be8881caea1b9fd71522eca006e160ee83f18be7b28c8
Jul 15 13:03:09.037938 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:09.037853    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59" event={"ID":"04f9222e-8618-4613-8d27-d7734bdb82e4","Type":"ContainerStarted","Data":"12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d"}
Jul 15 13:03:09.037938 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:09.037901    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59" event={"ID":"04f9222e-8618-4613-8d27-d7734bdb82e4","Type":"ContainerStarted","Data":"46f2086a8ff84827818be8881caea1b9fd71522eca006e160ee83f18be7b28c8"}
Jul 15 13:03:09.037938 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:09.037927    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:09.070682 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:09.070634    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59" podStartSLOduration=1.699696329 podStartE2EDuration="2.070615137s" totalImagesPullingTime="370.918808ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:03:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:03:09.070139482 +0000 UTC m=+2372.618639753" watchObservedRunningTime="2026-07-15 13:03:09.070615137 +0000 UTC m=+2372.619115403"
Jul 15 13:03:11.197210 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:11.197163    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:11.448587 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:11.448497    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:12.239352 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:12.239319    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:15.051694 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:15.051663    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:03:17.630415 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:17.630385    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:03:22.493423 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:22.493387    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:22.733713 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:22.733672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:28.833052 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:28.833015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:29.449953 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:29.449910    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:29.759917 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:29.759825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:32.332692 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:32.332658    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:03:37.034986 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:37.034952    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 13:03:37.040499 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:03:37.040478    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 13:04:05.254975 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.254940    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"]
Jul 15 13:04:05.258079 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.258059    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.263642 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.263622    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-958618\"/\"auth-test-model-958618-kserve-self-signed-certs\""
Jul 15 13:04:05.264695 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.264677    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-958618\"/\"kube-root-ca.crt\""
Jul 15 13:04:05.264867 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.264847    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-958618\"/\"default-dockercfg-nlcgp\""
Jul 15 13:04:05.273456 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.273436    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-958618\"/\"openshift-service-ca.crt\""
Jul 15 13:04:05.280340 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.280318    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"]
Jul 15 13:04:05.308367 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.308338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:04:05.341455 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.341427    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-home\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.341568 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.341481    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-model-cache\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.341568 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.341555    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tmp-dir\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.341654 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.341613    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-dshm\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.341654 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.341636    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tls-certs\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.341756 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.341660    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2xrp\" (UniqueName: \"kubernetes.io/projected/136aefc8-5bea-466a-8ad7-7e7417cd69d4-kube-api-access-x2xrp\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.442701 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.442670    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-dshm\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.442701 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.442702    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tls-certs\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.442955 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.442739    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2xrp\" (UniqueName: \"kubernetes.io/projected/136aefc8-5bea-466a-8ad7-7e7417cd69d4-kube-api-access-x2xrp\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.442955 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.442779    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-home\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.442955 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.442803    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-model-cache\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.442955 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.442824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tmp-dir\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.443224 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.443195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-home\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.443345 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.443223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-model-cache\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.443345 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.443246    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tmp-dir\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.444989 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.444968    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-dshm\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.445226 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.445212    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tls-certs\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.452300 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.452282    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2xrp\" (UniqueName: \"kubernetes.io/projected/136aefc8-5bea-466a-8ad7-7e7417cd69d4-kube-api-access-x2xrp\") pod \"auth-test-model-958618-kserve-74c9b67f95-7vr4b\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") " pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.567525 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.567493    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:05.701398 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:05.701376    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"]
Jul 15 13:04:05.703271 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:04:05.703247    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod136aefc8_5bea_466a_8ad7_7e7417cd69d4.slice/crio-18f311b29a89ad1fd7292b50fe15454a2b7e1d19070d74d03e1af34474f0fe73 WatchSource:0}: Error finding container 18f311b29a89ad1fd7292b50fe15454a2b7e1d19070d74d03e1af34474f0fe73: Status 404 returned error can't find the container with id 18f311b29a89ad1fd7292b50fe15454a2b7e1d19070d74d03e1af34474f0fe73
Jul 15 13:04:06.270756 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:06.270705    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b" event={"ID":"136aefc8-5bea-466a-8ad7-7e7417cd69d4","Type":"ContainerStarted","Data":"6554d00d28e379044935421289ef3438340c0ae8f52a6e2deee36891d788af73"}
Jul 15 13:04:06.271128 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:06.270766    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b" event={"ID":"136aefc8-5bea-466a-8ad7-7e7417cd69d4","Type":"ContainerStarted","Data":"18f311b29a89ad1fd7292b50fe15454a2b7e1d19070d74d03e1af34474f0fe73"}
Jul 15 13:04:06.304138 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:06.304076    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b" podStartSLOduration=1.3040570470000001 podStartE2EDuration="1.304057047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:04:06.299920753 +0000 UTC m=+2429.848421021" watchObservedRunningTime="2026-07-15 13:04:06.304057047 +0000 UTC m=+2429.852557316"
Jul 15 13:04:09.530310 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:09.530276    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:04:15.568453 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:15.568407    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:15.568453 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:15.568456    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:15.581110 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:15.581088    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:16.324030 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:16.324001    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:04:20.957120 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:20.957080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:04:29.137785 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:29.137714    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:04:48.130790 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:04:48.130756    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:05:02.435905 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:05:02.435873    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:05:20.130481 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:05:20.130448    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:05:34.828105 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:05:34.828020    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:05:54.029822 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:05:54.029787    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:06:09.120512 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:09.120479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:06:12.926697 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:12.926664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:13.652123 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:13.652095    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"]
Jul 15 13:06:14.349361 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:14.349305    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:16.631646 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.631614    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"]
Jul 15 13:06:16.634633 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.634615    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.637567 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.637547    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ce0265\"/\"openshift-service-ca.crt\""
Jul 15 13:06:16.638952 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.638932    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-ce0265\"/\"kube-root-ca.crt\""
Jul 15 13:06:16.639070 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.638983    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ce0265\"/\"sub-test-model-ce0265-kserve-self-signed-certs\""
Jul 15 13:06:16.639070 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.639004    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-ce0265\"/\"default-dockercfg-lbnzm\""
Jul 15 13:06:16.652879 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.652848    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"]
Jul 15 13:06:16.690235 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.690207    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:16.753147 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.753113    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-home\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.753147 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.753152    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-dshm\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.753330 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.753168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gg7l\" (UniqueName: \"kubernetes.io/projected/1bc9a0ec-e096-4bf0-83db-400acd51082c-kube-api-access-6gg7l\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.753330 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.753271    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-model-cache\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.753402 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.753330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9a0ec-e096-4bf0-83db-400acd51082c-tls-certs\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.753402 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.753385    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-tmp-dir\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.854631 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.854592    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-model-cache\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.854852 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.854653    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9a0ec-e096-4bf0-83db-400acd51082c-tls-certs\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.854852 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.854704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-tmp-dir\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.854990 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.854846    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-home\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.854990 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.854881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-dshm\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.854990 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.854897    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gg7l\" (UniqueName: \"kubernetes.io/projected/1bc9a0ec-e096-4bf0-83db-400acd51082c-kube-api-access-6gg7l\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.855147 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.855068    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-model-cache\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.855147 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.855094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-tmp-dir\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.855270 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.855259    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-home\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.856995 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.856974    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-dshm\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.857278 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.857258    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9a0ec-e096-4bf0-83db-400acd51082c-tls-certs\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.864171 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.864150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gg7l\" (UniqueName: \"kubernetes.io/projected/1bc9a0ec-e096-4bf0-83db-400acd51082c-kube-api-access-6gg7l\") pod \"sub-test-model-ce0265-kserve-7c85dcfc85-zplgn\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") " pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:16.944147 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:16.944044    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:17.087075 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:17.087043    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"]
Jul 15 13:06:17.089457 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:06:17.089427    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1bc9a0ec_e096_4bf0_83db_400acd51082c.slice/crio-dd7fecebf36108884a4499aaff92a7d12b96745bcbe04d14ecebf865adae83c1 WatchSource:0}: Error finding container dd7fecebf36108884a4499aaff92a7d12b96745bcbe04d14ecebf865adae83c1: Status 404 returned error can't find the container with id dd7fecebf36108884a4499aaff92a7d12b96745bcbe04d14ecebf865adae83c1
Jul 15 13:06:17.797376 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:17.797345    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn" event={"ID":"1bc9a0ec-e096-4bf0-83db-400acd51082c","Type":"ContainerStarted","Data":"e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19"}
Jul 15 13:06:17.797376 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:17.797383    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn" event={"ID":"1bc9a0ec-e096-4bf0-83db-400acd51082c","Type":"ContainerStarted","Data":"dd7fecebf36108884a4499aaff92a7d12b96745bcbe04d14ecebf865adae83c1"}
Jul 15 13:06:17.817132 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:17.817073    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn" podStartSLOduration=1.817056831 podStartE2EDuration="1.817056831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:06:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:06:17.81660019 +0000 UTC m=+2561.365100459" watchObservedRunningTime="2026-07-15 13:06:17.817056831 +0000 UTC m=+2561.365557097"
Jul 15 13:06:26.346704 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:26.346674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:06:26.944471 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:26.944421    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:26.944471 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:26.944476    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:26.956812 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:26.956789    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:27.849425 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:27.849392    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:06:28.671100 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.671058    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b" podUID="136aefc8-5bea-466a-8ad7-7e7417cd69d4" containerName="main" containerID="cri-o://6554d00d28e379044935421289ef3438340c0ae8f52a6e2deee36891d788af73" gracePeriod=45
Jul 15 13:06:28.845868 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.845833    2563 generic.go:356] "Generic (PLEG): container finished" podID="136aefc8-5bea-466a-8ad7-7e7417cd69d4" containerID="6554d00d28e379044935421289ef3438340c0ae8f52a6e2deee36891d788af73" exitCode=0
Jul 15 13:06:28.846012 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.845922    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b" event={"ID":"136aefc8-5bea-466a-8ad7-7e7417cd69d4","Type":"ContainerDied","Data":"6554d00d28e379044935421289ef3438340c0ae8f52a6e2deee36891d788af73"}
Jul 15 13:06:28.919921 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.919706    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:06:28.950913 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.950846    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-model-cache\") pod \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") "
Jul 15 13:06:28.950913 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.950879    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tls-certs\") pod \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") "
Jul 15 13:06:28.950913 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.950898    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2xrp\" (UniqueName: \"kubernetes.io/projected/136aefc8-5bea-466a-8ad7-7e7417cd69d4-kube-api-access-x2xrp\") pod \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") "
Jul 15 13:06:28.951181 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.950956    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tmp-dir\") pod \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") "
Jul 15 13:06:28.951181 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.951019    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-home\") pod \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") "
Jul 15 13:06:28.951181 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.951046    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-dshm\") pod \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\" (UID: \"136aefc8-5bea-466a-8ad7-7e7417cd69d4\") "
Jul 15 13:06:28.951181 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.951151    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "136aefc8-5bea-466a-8ad7-7e7417cd69d4" (UID: "136aefc8-5bea-466a-8ad7-7e7417cd69d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:28.951391 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.951287    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "136aefc8-5bea-466a-8ad7-7e7417cd69d4" (UID: "136aefc8-5bea-466a-8ad7-7e7417cd69d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:28.951391 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.951345    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-model-cache\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:06:28.951501 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.951407    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-home" (OuterVolumeSpecName: "home") pod "136aefc8-5bea-466a-8ad7-7e7417cd69d4" (UID: "136aefc8-5bea-466a-8ad7-7e7417cd69d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:28.953294 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.953271    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-dshm" (OuterVolumeSpecName: "dshm") pod "136aefc8-5bea-466a-8ad7-7e7417cd69d4" (UID: "136aefc8-5bea-466a-8ad7-7e7417cd69d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:28.953417 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.953396    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136aefc8-5bea-466a-8ad7-7e7417cd69d4-kube-api-access-x2xrp" (OuterVolumeSpecName: "kube-api-access-x2xrp") pod "136aefc8-5bea-466a-8ad7-7e7417cd69d4" (UID: "136aefc8-5bea-466a-8ad7-7e7417cd69d4"). InnerVolumeSpecName "kube-api-access-x2xrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:06:28.953527 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:28.953430    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "136aefc8-5bea-466a-8ad7-7e7417cd69d4" (UID: "136aefc8-5bea-466a-8ad7-7e7417cd69d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:06:29.051998 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.051973    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-home\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:06:29.051998 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.051997    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-dshm\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:06:29.051998 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.052005    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tls-certs\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:06:29.052218 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.052016    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2xrp\" (UniqueName: \"kubernetes.io/projected/136aefc8-5bea-466a-8ad7-7e7417cd69d4-kube-api-access-x2xrp\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:06:29.052218 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.052025    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136aefc8-5bea-466a-8ad7-7e7417cd69d4-tmp-dir\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:06:29.851420 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.851386    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"
Jul 15 13:06:29.851420 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.851411    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b" event={"ID":"136aefc8-5bea-466a-8ad7-7e7417cd69d4","Type":"ContainerDied","Data":"18f311b29a89ad1fd7292b50fe15454a2b7e1d19070d74d03e1af34474f0fe73"}
Jul 15 13:06:29.851667 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.851455    2563 scope.go:117] "RemoveContainer" containerID="6554d00d28e379044935421289ef3438340c0ae8f52a6e2deee36891d788af73"
Jul 15 13:06:29.885951 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.885924    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"]
Jul 15 13:06:29.897185 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:29.897154    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-958618/auth-test-model-958618-kserve-74c9b67f95-7vr4b"]
Jul 15 13:06:31.019144 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:31.019111    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136aefc8-5bea-466a-8ad7-7e7417cd69d4" path="/var/lib/kubelet/pods/136aefc8-5bea-466a-8ad7-7e7417cd69d4/volumes"
Jul 15 13:06:38.039695 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:38.039664    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:44.332324 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:06:44.332293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:07:00.467710 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:00.467615    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:07:06.880344 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:06.880303    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:06.978599 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:06.978565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:18.284444 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:18.284408    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"]
Jul 15 13:07:18.319895 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:18.319859    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:19.240420 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:19.240390    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:23.439030 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:23.438996    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:07:29.365130 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:29.365094    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:29.465639 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:29.465607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:33.304635 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.304595    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn" podUID="1bc9a0ec-e096-4bf0-83db-400acd51082c" containerName="main" containerID="cri-o://e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19" gracePeriod=45
Jul 15 13:07:33.552842 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.552817    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:07:33.579055 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.578971    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gg7l\" (UniqueName: \"kubernetes.io/projected/1bc9a0ec-e096-4bf0-83db-400acd51082c-kube-api-access-6gg7l\") pod \"1bc9a0ec-e096-4bf0-83db-400acd51082c\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") "
Jul 15 13:07:33.579055 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.579033    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-tmp-dir\") pod \"1bc9a0ec-e096-4bf0-83db-400acd51082c\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") "
Jul 15 13:07:33.579243 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.579090    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-model-cache\") pod \"1bc9a0ec-e096-4bf0-83db-400acd51082c\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") "
Jul 15 13:07:33.579243 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.579115    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-home\") pod \"1bc9a0ec-e096-4bf0-83db-400acd51082c\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") "
Jul 15 13:07:33.579243 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.579137    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-dshm\") pod \"1bc9a0ec-e096-4bf0-83db-400acd51082c\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") "
Jul 15 13:07:33.579243 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.579177    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9a0ec-e096-4bf0-83db-400acd51082c-tls-certs\") pod \"1bc9a0ec-e096-4bf0-83db-400acd51082c\" (UID: \"1bc9a0ec-e096-4bf0-83db-400acd51082c\") "
Jul 15 13:07:33.579547 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.579511    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1bc9a0ec-e096-4bf0-83db-400acd51082c" (UID: "1bc9a0ec-e096-4bf0-83db-400acd51082c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:07:33.579652 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.579546    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-model-cache" (OuterVolumeSpecName: "model-cache") pod "1bc9a0ec-e096-4bf0-83db-400acd51082c" (UID: "1bc9a0ec-e096-4bf0-83db-400acd51082c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:07:33.579652 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.579583    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-home" (OuterVolumeSpecName: "home") pod "1bc9a0ec-e096-4bf0-83db-400acd51082c" (UID: "1bc9a0ec-e096-4bf0-83db-400acd51082c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:07:33.581654 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.581632    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-dshm" (OuterVolumeSpecName: "dshm") pod "1bc9a0ec-e096-4bf0-83db-400acd51082c" (UID: "1bc9a0ec-e096-4bf0-83db-400acd51082c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:07:33.581839 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.581741    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bc9a0ec-e096-4bf0-83db-400acd51082c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1bc9a0ec-e096-4bf0-83db-400acd51082c" (UID: "1bc9a0ec-e096-4bf0-83db-400acd51082c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:07:33.581952 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.581830    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bc9a0ec-e096-4bf0-83db-400acd51082c-kube-api-access-6gg7l" (OuterVolumeSpecName: "kube-api-access-6gg7l") pod "1bc9a0ec-e096-4bf0-83db-400acd51082c" (UID: "1bc9a0ec-e096-4bf0-83db-400acd51082c"). InnerVolumeSpecName "kube-api-access-6gg7l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:07:33.679806 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.679770    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gg7l\" (UniqueName: \"kubernetes.io/projected/1bc9a0ec-e096-4bf0-83db-400acd51082c-kube-api-access-6gg7l\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:07:33.679806 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.679803    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-tmp-dir\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:07:33.679806 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.679813    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-model-cache\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:07:33.680044 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.679821    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-home\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:07:33.680044 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.679829    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1bc9a0ec-e096-4bf0-83db-400acd51082c-dshm\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:07:33.680044 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:33.679836    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1bc9a0ec-e096-4bf0-83db-400acd51082c-tls-certs\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:07:34.130443 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.130405    2563 generic.go:356] "Generic (PLEG): container finished" podID="1bc9a0ec-e096-4bf0-83db-400acd51082c" containerID="e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19" exitCode=0
Jul 15 13:07:34.130443 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.130445    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"
Jul 15 13:07:34.130649 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.130492    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn" event={"ID":"1bc9a0ec-e096-4bf0-83db-400acd51082c","Type":"ContainerDied","Data":"e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19"}
Jul 15 13:07:34.130649 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.130533    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn" event={"ID":"1bc9a0ec-e096-4bf0-83db-400acd51082c","Type":"ContainerDied","Data":"dd7fecebf36108884a4499aaff92a7d12b96745bcbe04d14ecebf865adae83c1"}
Jul 15 13:07:34.130649 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.130554    2563 scope.go:117] "RemoveContainer" containerID="e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19"
Jul 15 13:07:34.139157 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.139141    2563 scope.go:117] "RemoveContainer" containerID="e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19"
Jul 15 13:07:34.139405 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:07:34.139390    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19\": container with ID starting with e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19 not found: ID does not exist" containerID="e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19"
Jul 15 13:07:34.139444 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.139415    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19"} err="failed to get container status \"e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19\": rpc error: code = NotFound desc = could not find container \"e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19\": container with ID starting with e0accccc186d37c6303945aadfc59e7bcc0a224154865ed41e8c719d642e3e19 not found: ID does not exist"
Jul 15 13:07:34.154397 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.154372    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"]
Jul 15 13:07:34.160700 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:34.160677    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-ce0265/sub-test-model-ce0265-kserve-7c85dcfc85-zplgn"]
Jul 15 13:07:35.019199 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:35.019168    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bc9a0ec-e096-4bf0-83db-400acd51082c" path="/var/lib/kubelet/pods/1bc9a0ec-e096-4bf0-83db-400acd51082c/volumes"
Jul 15 13:07:36.738109 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:36.738077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:42.675570 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:42.675535    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:07:50.043197 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:07:50.043161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:23.405200 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:23.405155    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:23.506025 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:23.505987    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:29.795892 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:29.795809    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:30.211868 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:30.211784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:30.313992 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:30.313957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:31.135013 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:31.134966    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:37.057059 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:37.057032    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 13:08:37.062660 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:37.062639    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g7dvp_fb454696-c296-4b29-93f6-6f4fb01e9b49/ovn-acl-logging/0.log"
Jul 15 13:08:58.145817 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.145783    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"]
Jul 15 13:08:58.146290 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.146054    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc9a0ec-e096-4bf0-83db-400acd51082c" containerName="main"
Jul 15 13:08:58.146290 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.146065    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc9a0ec-e096-4bf0-83db-400acd51082c" containerName="main"
Jul 15 13:08:58.146290 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.146080    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136aefc8-5bea-466a-8ad7-7e7417cd69d4" containerName="main"
Jul 15 13:08:58.146290 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.146085    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="136aefc8-5bea-466a-8ad7-7e7417cd69d4" containerName="main"
Jul 15 13:08:58.146290 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.146133    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="136aefc8-5bea-466a-8ad7-7e7417cd69d4" containerName="main"
Jul 15 13:08:58.146290 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.146140    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc9a0ec-e096-4bf0-83db-400acd51082c" containerName="main"
Jul 15 13:08:58.148956 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.148938    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.153139 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.153114    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-958618\"/\"default-dockercfg-nlcgp\""
Jul 15 13:08:58.153264 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.153138    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-958618\"/\"kube-root-ca.crt\""
Jul 15 13:08:58.153264 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.153138    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-958618\"/\"rate-test-model-958618-kserve-self-signed-certs\""
Jul 15 13:08:58.153264 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.153143    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-958618\"/\"openshift-service-ca.crt\""
Jul 15 13:08:58.161852 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.161827    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"]
Jul 15 13:08:58.225449 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.225411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:58.262285 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.262251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-home\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.262398 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.262289    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-tmp-dir\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.262398 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.262311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c074780-f2b9-4216-a457-372b9b272e08-tls-certs\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.262398 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.262349    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-model-cache\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.262398 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.262380    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7twvm\" (UniqueName: \"kubernetes.io/projected/0c074780-f2b9-4216-a457-372b9b272e08-kube-api-access-7twvm\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.262555 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.262451    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-dshm\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.363566 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.363533    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-home\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.363566 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.363567    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-tmp-dir\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.363862 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.363589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c074780-f2b9-4216-a457-372b9b272e08-tls-certs\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.363862 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.363704    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-model-cache\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.363862 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.363780    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7twvm\" (UniqueName: \"kubernetes.io/projected/0c074780-f2b9-4216-a457-372b9b272e08-kube-api-access-7twvm\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.363862 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.363824    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-dshm\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.364079 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.364023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-tmp-dir\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.364127 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.364071    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-home\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.364127 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.364107    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-model-cache\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.366027 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.366010    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-dshm\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.366412 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.366393    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c074780-f2b9-4216-a457-372b9b272e08-tls-certs\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.373565 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.373535    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7twvm\" (UniqueName: \"kubernetes.io/projected/0c074780-f2b9-4216-a457-372b9b272e08-kube-api-access-7twvm\") pod \"rate-test-model-958618-kserve-75479bc55f-wh7tp\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") " pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.457800 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.457678    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:08:58.590786 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:58.590603    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"]
Jul 15 13:08:58.593465 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:08:58.593434    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c074780_f2b9_4216_a457_372b9b272e08.slice/crio-cd864567aec224470ed769ddcbe08d3e37307252686f2d92f8071e3d6aab6c1f WatchSource:0}: Error finding container cd864567aec224470ed769ddcbe08d3e37307252686f2d92f8071e3d6aab6c1f: Status 404 returned error can't find the container with id cd864567aec224470ed769ddcbe08d3e37307252686f2d92f8071e3d6aab6c1f
Jul 15 13:08:59.478850 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:59.478812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp" event={"ID":"0c074780-f2b9-4216-a457-372b9b272e08","Type":"ContainerStarted","Data":"4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf"}
Jul 15 13:08:59.478850 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:59.478857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp" event={"ID":"0c074780-f2b9-4216-a457-372b9b272e08","Type":"ContainerStarted","Data":"cd864567aec224470ed769ddcbe08d3e37307252686f2d92f8071e3d6aab6c1f"}
Jul 15 13:08:59.500314 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:08:59.500269    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp" podStartSLOduration=1.500255096 podStartE2EDuration="1.500255096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:08:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:08:59.498608641 +0000 UTC m=+2723.047108912" watchObservedRunningTime="2026-07-15 13:08:59.500255096 +0000 UTC m=+2723.048755363"
Jul 15 13:09:02.732471 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:02.732432    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:09:08.458775 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:08.458710    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:09:08.458775 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:08.458786    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:09:08.470944 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:08.470916    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:09:08.523549 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:08.523519    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:09:23.229832 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:23.229795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:09:45.026654 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:45.026618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:09:49.338007 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:49.337976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:09:50.205884 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:50.205853    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"]
Jul 15 13:09:50.285030 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:09:50.284998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:02.626894 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:02.626839    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:10:05.225451 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.225410    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp" podUID="0c074780-f2b9-4216-a457-372b9b272e08" containerName="main" containerID="cri-o://4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf" gracePeriod=45
Jul 15 13:10:05.468911 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.468888    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:10:05.604030 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.603996    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-tmp-dir\") pod \"0c074780-f2b9-4216-a457-372b9b272e08\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") "
Jul 15 13:10:05.604215 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604038    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c074780-f2b9-4216-a457-372b9b272e08-tls-certs\") pod \"0c074780-f2b9-4216-a457-372b9b272e08\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") "
Jul 15 13:10:05.604215 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604058    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-dshm\") pod \"0c074780-f2b9-4216-a457-372b9b272e08\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") "
Jul 15 13:10:05.604215 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604090    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-home\") pod \"0c074780-f2b9-4216-a457-372b9b272e08\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") "
Jul 15 13:10:05.604215 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604146    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7twvm\" (UniqueName: \"kubernetes.io/projected/0c074780-f2b9-4216-a457-372b9b272e08-kube-api-access-7twvm\") pod \"0c074780-f2b9-4216-a457-372b9b272e08\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") "
Jul 15 13:10:05.604215 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604192    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-model-cache\") pod \"0c074780-f2b9-4216-a457-372b9b272e08\" (UID: \"0c074780-f2b9-4216-a457-372b9b272e08\") "
Jul 15 13:10:05.604455 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604354    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0c074780-f2b9-4216-a457-372b9b272e08" (UID: "0c074780-f2b9-4216-a457-372b9b272e08"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:10:05.604455 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604387    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-home" (OuterVolumeSpecName: "home") pod "0c074780-f2b9-4216-a457-372b9b272e08" (UID: "0c074780-f2b9-4216-a457-372b9b272e08"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:10:05.604562 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604468    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-home\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:05.604562 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604511    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-tmp-dir\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:05.604658 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.604587    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-model-cache" (OuterVolumeSpecName: "model-cache") pod "0c074780-f2b9-4216-a457-372b9b272e08" (UID: "0c074780-f2b9-4216-a457-372b9b272e08"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:10:05.606189 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.606166    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-dshm" (OuterVolumeSpecName: "dshm") pod "0c074780-f2b9-4216-a457-372b9b272e08" (UID: "0c074780-f2b9-4216-a457-372b9b272e08"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:10:05.606607 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.606585    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c074780-f2b9-4216-a457-372b9b272e08-kube-api-access-7twvm" (OuterVolumeSpecName: "kube-api-access-7twvm") pod "0c074780-f2b9-4216-a457-372b9b272e08" (UID: "0c074780-f2b9-4216-a457-372b9b272e08"). InnerVolumeSpecName "kube-api-access-7twvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:10:05.606673 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.606588    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c074780-f2b9-4216-a457-372b9b272e08-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0c074780-f2b9-4216-a457-372b9b272e08" (UID: "0c074780-f2b9-4216-a457-372b9b272e08"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:10:05.704903 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.704868    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-model-cache\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:05.704903 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.704898    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0c074780-f2b9-4216-a457-372b9b272e08-tls-certs\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:05.704903 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.704906    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0c074780-f2b9-4216-a457-372b9b272e08-dshm\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:05.705129 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.704915    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7twvm\" (UniqueName: \"kubernetes.io/projected/0c074780-f2b9-4216-a457-372b9b272e08-kube-api-access-7twvm\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:05.748171 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.748141    2563 generic.go:356] "Generic (PLEG): container finished" podID="0c074780-f2b9-4216-a457-372b9b272e08" containerID="4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf" exitCode=0
Jul 15 13:10:05.748328 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.748185    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"
Jul 15 13:10:05.748328 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.748218    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp" event={"ID":"0c074780-f2b9-4216-a457-372b9b272e08","Type":"ContainerDied","Data":"4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf"}
Jul 15 13:10:05.748328 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.748247    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp" event={"ID":"0c074780-f2b9-4216-a457-372b9b272e08","Type":"ContainerDied","Data":"cd864567aec224470ed769ddcbe08d3e37307252686f2d92f8071e3d6aab6c1f"}
Jul 15 13:10:05.748328 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.748265    2563 scope.go:117] "RemoveContainer" containerID="4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf"
Jul 15 13:10:05.756973 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.756952    2563 scope.go:117] "RemoveContainer" containerID="4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf"
Jul 15 13:10:05.757242 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:10:05.757224    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf\": container with ID starting with 4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf not found: ID does not exist" containerID="4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf"
Jul 15 13:10:05.757287 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.757252    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf"} err="failed to get container status \"4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf\": rpc error: code = NotFound desc = could not find container \"4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf\": container with ID starting with 4d9d2174a60d72e083a259a67343865a26284088f8addde334926ef6b057c4bf not found: ID does not exist"
Jul 15 13:10:05.769681 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.769650    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"]
Jul 15 13:10:05.774010 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:05.773982    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-958618/rate-test-model-958618-kserve-75479bc55f-wh7tp"]
Jul 15 13:10:07.018952 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:07.018922    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c074780-f2b9-4216-a457-372b9b272e08" path="/var/lib/kubelet/pods/0c074780-f2b9-4216-a457-372b9b272e08/volumes"
Jul 15 13:10:09.836159 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:09.836123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:09.986126 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:09.986088    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:19.757978 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:19.757942    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"]
Jul 15 13:10:19.758495 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:19.758167    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm" podUID="b7fb0fd8-794f-4ded-91d4-71c05cff0142" containerName="maas-api" containerID="cri-o://c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0" gracePeriod=30
Jul 15 13:10:19.893403 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:19.893357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:20.198579 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.198557    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:10:20.328503 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.328470    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7fb0fd8-794f-4ded-91d4-71c05cff0142-maas-api-tls\") pod \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") "
Jul 15 13:10:20.328707 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.328528    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fb0fd8-794f-4ded-91d4-71c05cff0142-openshift-service-ca\") pod \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") "
Jul 15 13:10:20.328707 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.328635    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx9j5\" (UniqueName: \"kubernetes.io/projected/b7fb0fd8-794f-4ded-91d4-71c05cff0142-kube-api-access-zx9j5\") pod \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\" (UID: \"b7fb0fd8-794f-4ded-91d4-71c05cff0142\") "
Jul 15 13:10:20.328925 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.328903    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7fb0fd8-794f-4ded-91d4-71c05cff0142-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7fb0fd8-794f-4ded-91d4-71c05cff0142" (UID: "b7fb0fd8-794f-4ded-91d4-71c05cff0142"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:10:20.330639 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.330616    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7fb0fd8-794f-4ded-91d4-71c05cff0142-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7fb0fd8-794f-4ded-91d4-71c05cff0142" (UID: "b7fb0fd8-794f-4ded-91d4-71c05cff0142"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:10:20.330697 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.330622    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7fb0fd8-794f-4ded-91d4-71c05cff0142-kube-api-access-zx9j5" (OuterVolumeSpecName: "kube-api-access-zx9j5") pod "b7fb0fd8-794f-4ded-91d4-71c05cff0142" (UID: "b7fb0fd8-794f-4ded-91d4-71c05cff0142"). InnerVolumeSpecName "kube-api-access-zx9j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:10:20.430074 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.430021    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7fb0fd8-794f-4ded-91d4-71c05cff0142-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:20.430074 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.430067    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7fb0fd8-794f-4ded-91d4-71c05cff0142-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:20.430074 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.430077    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx9j5\" (UniqueName: \"kubernetes.io/projected/b7fb0fd8-794f-4ded-91d4-71c05cff0142-kube-api-access-zx9j5\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:20.815858 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.815824    2563 generic.go:356] "Generic (PLEG): container finished" podID="b7fb0fd8-794f-4ded-91d4-71c05cff0142" containerID="c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0" exitCode=0
Jul 15 13:10:20.816291 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.815873    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"
Jul 15 13:10:20.816291 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.815908    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm" event={"ID":"b7fb0fd8-794f-4ded-91d4-71c05cff0142","Type":"ContainerDied","Data":"c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0"}
Jul 15 13:10:20.816291 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.815955    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm" event={"ID":"b7fb0fd8-794f-4ded-91d4-71c05cff0142","Type":"ContainerDied","Data":"71c1918f0b176d81cf13cc5e000274b9c6ae949cb2eb61bc0dceab9f66c90db8"}
Jul 15 13:10:20.816291 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.815984    2563 scope.go:117] "RemoveContainer" containerID="c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0"
Jul 15 13:10:20.824299 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.824282    2563 scope.go:117] "RemoveContainer" containerID="c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0"
Jul 15 13:10:20.824536 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:10:20.824515    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0\": container with ID starting with c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0 not found: ID does not exist" containerID="c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0"
Jul 15 13:10:20.824608 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.824548    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0"} err="failed to get container status \"c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0\": rpc error: code = NotFound desc = could not find container \"c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0\": container with ID starting with c8db5d98b169e5e27c91a391f99f42f6264fb1c95026e38eb96ae475ada97bd0 not found: ID does not exist"
Jul 15 13:10:20.836306 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.836284    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"]
Jul 15 13:10:20.840733 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:20.840701    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-ce0265-67798bc57b-s8qqm"]
Jul 15 13:10:21.019353 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:21.019324    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7fb0fd8-794f-4ded-91d4-71c05cff0142" path="/var/lib/kubelet/pods/b7fb0fd8-794f-4ded-91d4-71c05cff0142/volumes"
Jul 15 13:10:23.434612 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:23.434577    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:10:24.407152 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:24.407116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:32.300626 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:32.300592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:32.496648 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:32.496617    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:35.124519 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.124479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:35.360030 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.359991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:35.400614 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.400539    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"]
Jul 15 13:10:35.400838 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.400825    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c074780-f2b9-4216-a457-372b9b272e08" containerName="main"
Jul 15 13:10:35.400885 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.400840    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c074780-f2b9-4216-a457-372b9b272e08" containerName="main"
Jul 15 13:10:35.400885 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.400858    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7fb0fd8-794f-4ded-91d4-71c05cff0142" containerName="maas-api"
Jul 15 13:10:35.400885 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.400866    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7fb0fd8-794f-4ded-91d4-71c05cff0142" containerName="maas-api"
Jul 15 13:10:35.400977 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.400917    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7fb0fd8-794f-4ded-91d4-71c05cff0142" containerName="maas-api"
Jul 15 13:10:35.400977 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.400925    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c074780-f2b9-4216-a457-372b9b272e08" containerName="main"
Jul 15 13:10:35.405119 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.405099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"
Jul 15 13:10:35.407886 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.407865    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b2gg6\""
Jul 15 13:10:35.454856 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.454825    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3387ab2-fda4-42f9-a15f-442ca06dd718-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-958618-mcv8p\" (UID: \"d3387ab2-fda4-42f9-a15f-442ca06dd718\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"
Jul 15 13:10:35.463914 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.463890    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"]
Jul 15 13:10:35.556208 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.556177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3387ab2-fda4-42f9-a15f-442ca06dd718-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-958618-mcv8p\" (UID: \"d3387ab2-fda4-42f9-a15f-442ca06dd718\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"
Jul 15 13:10:35.556882 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.556864    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3387ab2-fda4-42f9-a15f-442ca06dd718-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-958618-mcv8p\" (UID: \"d3387ab2-fda4-42f9-a15f-442ca06dd718\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"
Jul 15 13:10:35.715191 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:35.715080    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"
Jul 15 13:10:36.050793 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:36.050770    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"]
Jul 15 13:10:36.053242 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:10:36.053215    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3387ab2_fda4_42f9_a15f_442ca06dd718.slice/crio-8a0ebecdb6b0d37504322a3a2b3b297688d5ec815ba7a64318c59ff0c664ebf6 WatchSource:0}: Error finding container 8a0ebecdb6b0d37504322a3a2b3b297688d5ec815ba7a64318c59ff0c664ebf6: Status 404 returned error can't find the container with id 8a0ebecdb6b0d37504322a3a2b3b297688d5ec815ba7a64318c59ff0c664ebf6
Jul 15 13:10:36.131086 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:36.131060    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:36.291464 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:36.291442    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:36.885091 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:36.885063    2563 generic.go:356] "Generic (PLEG): container finished" podID="d3387ab2-fda4-42f9-a15f-442ca06dd718" containerID="634954509a6e758b362664c0e5678ba4263bc9f0c471835d6b655fce75fae940" exitCode=0
Jul 15 13:10:36.885263 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:36.885110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p" event={"ID":"d3387ab2-fda4-42f9-a15f-442ca06dd718","Type":"ContainerDied","Data":"634954509a6e758b362664c0e5678ba4263bc9f0c471835d6b655fce75fae940"}
Jul 15 13:10:36.885263 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:36.885156    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p" event={"ID":"d3387ab2-fda4-42f9-a15f-442ca06dd718","Type":"ContainerStarted","Data":"8a0ebecdb6b0d37504322a3a2b3b297688d5ec815ba7a64318c59ff0c664ebf6"}
Jul 15 13:10:38.027019 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:38.026995    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"
Jul 15 13:10:38.074759 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:38.074715    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3387ab2-fda4-42f9-a15f-442ca06dd718-maas-api-service-ca\") pod \"d3387ab2-fda4-42f9-a15f-442ca06dd718\" (UID: \"d3387ab2-fda4-42f9-a15f-442ca06dd718\") "
Jul 15 13:10:38.075106 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:38.075084    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3387ab2-fda4-42f9-a15f-442ca06dd718-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d3387ab2-fda4-42f9-a15f-442ca06dd718" (UID: "d3387ab2-fda4-42f9-a15f-442ca06dd718"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:10:38.176010 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:38.175918    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3387ab2-fda4-42f9-a15f-442ca06dd718-maas-api-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:38.893977 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:38.893950    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p"
Jul 15 13:10:38.894152 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:38.893944    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-958618-mcv8p" event={"ID":"d3387ab2-fda4-42f9-a15f-442ca06dd718","Type":"ContainerDied","Data":"8a0ebecdb6b0d37504322a3a2b3b297688d5ec815ba7a64318c59ff0c664ebf6"}
Jul 15 13:10:38.894152 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:38.894083    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a0ebecdb6b0d37504322a3a2b3b297688d5ec815ba7a64318c59ff0c664ebf6"
Jul 15 13:10:45.966190 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:45.966154    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"]
Jul 15 13:10:45.966602 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:45.966399    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59" podUID="04f9222e-8618-4613-8d27-d7734bdb82e4" containerName="maas-api" containerID="cri-o://12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d" gracePeriod=30
Jul 15 13:10:46.020709 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.020673    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:10:46.216374 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.216321    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:10:46.237607 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.237578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f9222e-8618-4613-8d27-d7734bdb82e4-maas-api-tls\") pod \"04f9222e-8618-4613-8d27-d7734bdb82e4\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") "
Jul 15 13:10:46.237785 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.237625    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f9222e-8618-4613-8d27-d7734bdb82e4-openshift-service-ca\") pod \"04f9222e-8618-4613-8d27-d7734bdb82e4\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") "
Jul 15 13:10:46.237785 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.237669    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdm5m\" (UniqueName: \"kubernetes.io/projected/04f9222e-8618-4613-8d27-d7734bdb82e4-kube-api-access-xdm5m\") pod \"04f9222e-8618-4613-8d27-d7734bdb82e4\" (UID: \"04f9222e-8618-4613-8d27-d7734bdb82e4\") "
Jul 15 13:10:46.238314 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.238274    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04f9222e-8618-4613-8d27-d7734bdb82e4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "04f9222e-8618-4613-8d27-d7734bdb82e4" (UID: "04f9222e-8618-4613-8d27-d7734bdb82e4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:10:46.240165 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.240139    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04f9222e-8618-4613-8d27-d7734bdb82e4-kube-api-access-xdm5m" (OuterVolumeSpecName: "kube-api-access-xdm5m") pod "04f9222e-8618-4613-8d27-d7734bdb82e4" (UID: "04f9222e-8618-4613-8d27-d7734bdb82e4"). InnerVolumeSpecName "kube-api-access-xdm5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:10:46.240298 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.240270    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04f9222e-8618-4613-8d27-d7734bdb82e4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "04f9222e-8618-4613-8d27-d7734bdb82e4" (UID: "04f9222e-8618-4613-8d27-d7734bdb82e4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:10:46.339091 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.339054    2563 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/04f9222e-8618-4613-8d27-d7734bdb82e4-maas-api-tls\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:46.339091 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.339083    2563 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/04f9222e-8618-4613-8d27-d7734bdb82e4-openshift-service-ca\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:46.339091 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.339092    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdm5m\" (UniqueName: \"kubernetes.io/projected/04f9222e-8618-4613-8d27-d7734bdb82e4-kube-api-access-xdm5m\") on node \"ip-10-0-138-184.ec2.internal\" DevicePath \"\""
Jul 15 13:10:46.926829 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.926790    2563 generic.go:356] "Generic (PLEG): container finished" podID="04f9222e-8618-4613-8d27-d7734bdb82e4" containerID="12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d" exitCode=0
Jul 15 13:10:46.927028 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.926836    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"
Jul 15 13:10:46.927028 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.926873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59" event={"ID":"04f9222e-8618-4613-8d27-d7734bdb82e4","Type":"ContainerDied","Data":"12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d"}
Jul 15 13:10:46.927028 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.926934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59" event={"ID":"04f9222e-8618-4613-8d27-d7734bdb82e4","Type":"ContainerDied","Data":"46f2086a8ff84827818be8881caea1b9fd71522eca006e160ee83f18be7b28c8"}
Jul 15 13:10:46.927028 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.926956    2563 scope.go:117] "RemoveContainer" containerID="12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d"
Jul 15 13:10:46.935617 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.935602    2563 scope.go:117] "RemoveContainer" containerID="12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d"
Jul 15 13:10:46.935903 ip-10-0-138-184 kubenswrapper[2563]: E0715 13:10:46.935884    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d\": container with ID starting with 12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d not found: ID does not exist" containerID="12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d"
Jul 15 13:10:46.935962 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.935915    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d"} err="failed to get container status \"12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d\": rpc error: code = NotFound desc = could not find container \"12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d\": container with ID starting with 12dfd973653aef69ba0f300629f82091f92e3649b5cdb2462e40139d176b786d not found: ID does not exist"
Jul 15 13:10:46.948657 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.948627    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"]
Jul 15 13:10:46.952964 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:46.952942    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-958618-75c7f4fb5c-d8r59"]
Jul 15 13:10:47.020299 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:47.020273    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04f9222e-8618-4613-8d27-d7734bdb82e4" path="/var/lib/kubelet/pods/04f9222e-8618-4613-8d27-d7734bdb82e4/volumes"
Jul 15 13:10:48.826713 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:48.826681    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kqdms"]
Jul 15 13:10:50.574545 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:10:50.574511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:11:00.486173 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:00.486132    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:11:00.586492 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:00.586455    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:11:01.188193 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:01.188160    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:11:01.432515 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:01.432477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:11:08.070277 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:08.070249    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-654f68fd79-xdtsd_3420c80d-0029-4625-89e8-8dadaf615d69/copy-manifests/0.log"
Jul 15 13:11:08.077307 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:08.077282    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-654f68fd79-xdtsd_3420c80d-0029-4625-89e8-8dadaf615d69/manager/0.log"
Jul 15 13:11:08.549800 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:08.549765    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735325-9zlx2_9f355302-8390-4db0-b148-d93d6fd10691/cleanup/0.log"
Jul 15 13:11:08.662857 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:08.662829    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735340-87nm2_129ab441-21f0-4ec1-90ad-5f6b4aa2ca6a/cleanup/0.log"
Jul 15 13:11:08.776175 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:08.776150    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-da069d38-p9wvr_fb8cb7a9-0b67-45ad-8e3b-da2e16bd2df0/revoke-keys/0.log"
Jul 15 13:11:08.890239 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:08.890156    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-fce6d3aa-7plw6_9c051ab3-fbe0-4314-8161-3577d993713e/revoke-keys/0.log"
Jul 15 13:11:09.233441 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:09.233369    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-8e27a08d-vkfsz_29da8286-8cea-4776-b556-610201f634df/revoke-keys/0.log"
Jul 15 13:11:10.008051 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:10.008022    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-958618-mcv8p_d3387ab2-fda4-42f9-a15f-442ca06dd718/revoke-keys/0.log"
Jul 15 13:11:12.120828 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:12.120796    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kqdms_00626143-e7fc-4f7b-a8cd-101c1b5db070/limitador/0.log"
Jul 15 13:11:12.693380 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:12.693356    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bxgt5_e4d5e62e-7344-4f06-acd8-f24543f7de82/discovery/0.log"
Jul 15 13:11:14.084183 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:14.084156    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbw5zbl_ee1fb765-e1c7-4516-9c44-0c63000f0dd2/main/0.log"
Jul 15 13:11:18.326928 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:18.326897    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:11:22.790501 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:22.790467    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6lbpz_cd5cd303-19ae-4714-99cd-cc9c52d28904/global-pull-secret-syncer/0.log"
Jul 15 13:11:22.884622 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:22.884593    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log"
Jul 15 13:11:23.006251 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:23.006221    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-184.ec2.internal_3bc6f484d7291ccb2f134583fa25f23a/haproxy/0.log"
Jul 15 13:11:27.603524 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:27.603491    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:11:27.703708 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:27.703678    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-54dfv_017343cd-b0fe-489b-b66e-26f8fec3806d/konnectivity-agent/0.log" limit=1024
Jul 15 13:11:28.528594 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:28.528566    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kqdms_00626143-e7fc-4f7b-a8cd-101c1b5db070/limitador/0.log"
Jul 15 13:11:30.832550 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:30.832523    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqgf2_3d99201d-9084-4959-81e1-99d9b468c588/node-exporter/0.log"
Jul 15 13:11:30.854179 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:30.854155    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqgf2_3d99201d-9084-4959-81e1-99d9b468c588/kube-rbac-proxy/0.log"
Jul 15 13:11:30.878076 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:30.878059    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vqgf2_3d99201d-9084-4959-81e1-99d9b468c588/init-textfile/0.log"
Jul 15 13:11:32.912163 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.912128    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"]
Jul 15 13:11:32.912526 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.912381    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04f9222e-8618-4613-8d27-d7734bdb82e4" containerName="maas-api"
Jul 15 13:11:32.912526 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.912393    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="04f9222e-8618-4613-8d27-d7734bdb82e4" containerName="maas-api"
Jul 15 13:11:32.912526 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.912406    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3387ab2-fda4-42f9-a15f-442ca06dd718" containerName="revoke-keys"
Jul 15 13:11:32.912526 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.912411    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3387ab2-fda4-42f9-a15f-442ca06dd718" containerName="revoke-keys"
Jul 15 13:11:32.912526 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.912459    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="04f9222e-8618-4613-8d27-d7734bdb82e4" containerName="maas-api"
Jul 15 13:11:32.912526 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.912467    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3387ab2-fda4-42f9-a15f-442ca06dd718" containerName="revoke-keys"
Jul 15 13:11:32.915227 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.915210    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:32.918979 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.918961    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9nr7q\"/\"openshift-service-ca.crt\""
Jul 15 13:11:32.919070 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.918976    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9nr7q\"/\"default-dockercfg-xwh4g\""
Jul 15 13:11:32.919585 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.919569    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9nr7q\"/\"kube-root-ca.crt\""
Jul 15 13:11:32.936973 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.936949    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"]
Jul 15 13:11:32.990901 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.990787    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-podres\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:32.990901 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.990890    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-proc\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:32.991809 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.990971    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-lib-modules\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:32.991809 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.991179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-sys\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:32.991809 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:32.991467    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbjws\" (UniqueName: \"kubernetes.io/projected/77200100-c990-4056-ae7f-7b9d9035de03-kube-api-access-qbjws\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092213 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092177    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-sys\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092411 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092234    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbjws\" (UniqueName: \"kubernetes.io/projected/77200100-c990-4056-ae7f-7b9d9035de03-kube-api-access-qbjws\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092411 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092294    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-podres\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092411 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092299    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-sys\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092411 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-proc\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092411 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-lib-modules\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092411 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092396    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-podres\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092655 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092449    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-proc\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.092655 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.092477    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77200100-c990-4056-ae7f-7b9d9035de03-lib-modules\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.102702 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.102674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbjws\" (UniqueName: \"kubernetes.io/projected/77200100-c990-4056-ae7f-7b9d9035de03-kube-api-access-qbjws\") pod \"perf-node-gather-daemonset-s9dm9\" (UID: \"77200100-c990-4056-ae7f-7b9d9035de03\") " pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.224361 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.224269    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:33.359696 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:33.359661    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"]
Jul 15 13:11:33.361906 ip-10-0-138-184 kubenswrapper[2563]: W0715 13:11:33.361882    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod77200100_c990_4056_ae7f_7b9d9035de03.slice/crio-e34b59cc8e7815d226265c0c9e64448102b126dc787707ca3296b8147f8d26f7 WatchSource:0}: Error finding container e34b59cc8e7815d226265c0c9e64448102b126dc787707ca3296b8147f8d26f7: Status 404 returned error can't find the container with id e34b59cc8e7815d226265c0c9e64448102b126dc787707ca3296b8147f8d26f7
Jul 15 13:11:34.117395 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:34.117364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9" event={"ID":"77200100-c990-4056-ae7f-7b9d9035de03","Type":"ContainerStarted","Data":"4518b17fe99171d1e84d3d6342e9709fb14d299b4b4ba2ee1af139b6d3046c58"}
Jul 15 13:11:34.117811 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:34.117416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9" event={"ID":"77200100-c990-4056-ae7f-7b9d9035de03","Type":"ContainerStarted","Data":"e34b59cc8e7815d226265c0c9e64448102b126dc787707ca3296b8147f8d26f7"}
Jul 15 13:11:34.117811 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:34.117443    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:34.141766 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:34.141699    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9" podStartSLOduration=2.141685152 podStartE2EDuration="2.141685152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:11:34.140233266 +0000 UTC m=+2877.688733535" watchObservedRunningTime="2026-07-15 13:11:34.141685152 +0000 UTC m=+2877.690185420"
Jul 15 13:11:35.843429 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:35.843400    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l859h_3212bd1a-0f38-44b5-8386-78980c558ae8/dns/0.log"
Jul 15 13:11:35.882269 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:35.882228    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-l859h_3212bd1a-0f38-44b5-8386-78980c558ae8/kube-rbac-proxy/0.log"
Jul 15 13:11:35.947091 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:35.947064    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffwwg_874942df-dcc0-4613-bdb1-b21b5c23ed48/dns-node-resolver/0.log"
Jul 15 13:11:36.615433 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:36.615403    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-587665fbc5-9qpxs_867d262e-e8f6-4362-9f18-a2f9596f7068/registry/0.log"
Jul 15 13:11:36.658548 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:36.658516    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vs9wc_d91864b8-a5c8-4296-9c56-1fe1ef8333a4/node-ca/0.log"
Jul 15 13:11:37.767364 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:37.767338    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bxgt5_e4d5e62e-7344-4f06-acd8-f24543f7de82/discovery/0.log"
Jul 15 13:11:38.686353 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:38.686324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h4cwj_acbe397a-608d-479c-8ccb-d115d7761632/serve-healthcheck-canary/0.log"
Jul 15 13:11:39.254108 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:39.254078    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27bdz_0c3eea0b-2153-47de-820d-8df00a08fda9/kube-rbac-proxy/0.log"
Jul 15 13:11:39.282719 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:39.282698    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27bdz_0c3eea0b-2153-47de-820d-8df00a08fda9/exporter/0.log"
Jul 15 13:11:39.313528 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:39.313506    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27bdz_0c3eea0b-2153-47de-820d-8df00a08fda9/extractor/0.log"
Jul 15 13:11:40.130546 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:40.130522    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9nr7q/perf-node-gather-daemonset-s9dm9"
Jul 15 13:11:42.395364 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:42.395336    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-654f68fd79-xdtsd_3420c80d-0029-4625-89e8-8dadaf615d69/manager/0.log"
Jul 15 13:11:42.424767 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:42.424675    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-654f68fd79-xdtsd_3420c80d-0029-4625-89e8-8dadaf615d69/copy-manifests/0.log"
Jul 15 13:11:43.562503 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:43.562473    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bxgt5_e4d5e62e-7344-4f06-acd8-f24543f7de82/discovery/0.log"
Jul 15 13:11:43.765837 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:43.765808    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-849c5974c6-m5ttm_fa63c347-d082-41bd-bab7-13b864ff331a/manager/0.log"
Jul 15 13:11:45.053417 ip-10-0-138-184 kubenswrapper[2563]: I0715 13:11:45.053388    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-bxgt5_e4d5e62e-7344-4f06-acd8-f24543f7de82/discovery/0.log"