Jul 10 12:45:51.145281 ip-10-0-134-90 systemd[1]: Starting Kubernetes Kubelet...
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.600309    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606107    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606119    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606123    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606127    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606130    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606133    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606136    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 12:45:51.651648 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606138    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606141    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606144    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606146    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606151    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606155    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606158    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606167    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606170    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606173    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606176    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606179    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606181    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606184    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606187    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606189    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606192    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606195    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606198    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606200    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 12:45:51.916962 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606203    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 12:45:51.678413 ip-10-0-134-90 systemd[1]: Started Kubernetes Kubelet.
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606205    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606208    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606210    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606213    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606217    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606220    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606223    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606225    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606228    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606231    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606233    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606236    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606240    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606244    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606247    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606250    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606253    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606255    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 12:45:51.930476 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606259    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606263    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606266    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606269    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606271    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606274    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606276    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606294    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606298    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606301    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606305    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606308    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606311    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606314    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606317    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606320    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606323    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606325    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606328    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606331    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 12:45:51.931249 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606334    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606337    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606340    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606342    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606346    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606349    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606352    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606354    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606357    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606359    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606362    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606366    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606369    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606372    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606375    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606378    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606381    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606383    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606386    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606388    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 12:45:51.931908 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606392    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606395    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606397    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606400    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606403    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606405    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606408    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606411    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606414    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606416    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606419    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606422    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.606425    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608150    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608161    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608165    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608168    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608173    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608177    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 12:45:51.932499 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608180    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608183    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608187    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608191    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608194    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608197    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608200    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608203    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608205    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608208    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608210    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608213    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608216    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608218    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608221    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608224    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608227    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608229    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608232    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608239    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 12:45:51.933123 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608242    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608244    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608247    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608249    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608252    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608255    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608257    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608260    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608262    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608265    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608267    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608270    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608273    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608275    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608278    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608280    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608283    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608286    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608288    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 12:45:51.933712 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608292    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608296    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608299    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608302    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608305    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608307    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608310    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608312    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608317    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608319    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608322    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608325    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608328    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608335    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608337    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608340    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608343    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608347    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608349    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 12:45:51.934324 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608353    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608355    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608358    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608361    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608364    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608366    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608369    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608371    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608374    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608376    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608379    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608381    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608384    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608386    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608389    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608391    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608394    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608396    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608399    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608408    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 12:45:51.935306 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608410    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608413    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608415    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608418    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608420    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608423    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608426    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608429    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608431    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608434    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608437    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608440    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608442    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608445    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608447    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608914    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608920    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608923    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608926    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608929    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 12:45:51.935958 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608932    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608934    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608937    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608940    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608942    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608944    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608947    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608950    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608953    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608955    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608958    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608966    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608969    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608971    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608974    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608976    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608979    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608981    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.608985    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609010    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 12:45:51.936596 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609015    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609019    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609027    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609031    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609033    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609036    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609039    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609042    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609044    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609047    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609049    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609052    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609055    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609057    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609060    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609062    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609065    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609067    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609070    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 12:45:51.937237 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609072    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609075    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609077    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609080    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609082    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609091    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609094    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609096    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609099    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609101    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609104    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609108    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609111    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609113    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609116    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609121    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609123    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609126    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609128    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609131    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 12:45:51.937860 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609134    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609136    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609138    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609141    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609143    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609146    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609148    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609151    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609153    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609156    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609159    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609161    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609164    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609166    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609168    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609171    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609175    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609178    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609187    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609189    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 12:45:51.938451 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609192    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609196    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609199    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609203    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609205    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609208    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609211    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609215    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609219    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609223    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609226    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609228    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609231    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609233    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609236    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609305    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609312    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609324    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609328    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609332    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609335    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 10 12:45:51.939294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609340    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609344    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609347    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609349    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609353    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609356    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609359    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609361    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609364    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609367    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609376    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609379    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609386    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609388    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609393    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609396    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609399    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609402    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609406    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609409    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609412    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609415    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609418    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609421    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 10 12:45:51.939960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609424    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609427    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609431    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609434    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609437    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609439    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609442    2577 flags.go:64] FLAG: --enable-server="true"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609445    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609452    2577 flags.go:64] FLAG: --event-burst="100"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609455    2577 flags.go:64] FLAG: --event-qps="50"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609458    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609461    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609464    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609467    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609470    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609473    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609476    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609479    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609482    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609492    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609495    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609498    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609502    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609505    2577 flags.go:64] FLAG: --feature-gates=""
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609508    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 10 12:45:51.940594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609511    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609516    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609519    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609522    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609525    2577 flags.go:64] FLAG: --help="false"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609527    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-134-90.ec2.internal"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609531    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609533    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609536    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609539    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609543    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609546    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609548    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609551    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609554    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609557    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609559    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609562    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609565    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609568    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609571    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609574    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609577    2577 flags.go:64] FLAG: --lock-file=""
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609579    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 10 12:45:51.941439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609582    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609585    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609590    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609595    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609598    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609601    2577 flags.go:64] FLAG: --logging-format="text"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609604    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609608    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609610    2577 flags.go:64] FLAG: --manifest-url=""
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609614    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609619    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609622    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609626    2577 flags.go:64] FLAG: --max-pods="110"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609629    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609632    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609635    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609638    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609640    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609644    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609647    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609654    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609657    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609660    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 10 12:45:51.942274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609663    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609665    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609671    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609673    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609676    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609679    2577 flags.go:64] FLAG: --port="10250"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609682    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609685    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02fb550cd5fc8c7c4"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609688    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609691    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609694    2577 flags.go:64] FLAG: --register-node="true"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609697    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609700    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609703    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609706    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609710    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609713    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609716    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609720    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609723    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609726    2577 flags.go:64] FLAG: --runonce="false"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609729    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609732    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609735    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609738    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 10 12:45:51.943113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609740    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609743    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609746    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609749    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609752    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609755    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609758    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609761    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609763    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609766    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609769    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609774    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609777    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609780    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609786    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609789    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609792    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609794    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609797    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609800    2577 flags.go:64] FLAG: --v="2"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609804    2577 flags.go:64] FLAG: --version="false"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609808    2577 flags.go:64] FLAG: --vmodule=""
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609813    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.609816    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609935    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 12:45:51.944193 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609941    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609944    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609947    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609950    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609953    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609955    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609958    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609961    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609964    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609966    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609969    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609971    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609974    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609976    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609979    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609981    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.609984    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610002    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610007    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610011    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 12:45:51.944873 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610015    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610019    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610021    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610024    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610027    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610029    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610032    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610034    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610037    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610042    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610045    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610048    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610051    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610054    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610057    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610060    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610063    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610065    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610068    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610070    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 12:45:52.021682 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610073    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610075    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610078    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610081    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610083    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610086    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610088    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610091    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610093    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610096    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610098    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610101    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610103    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610107    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610111    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610114    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610118    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610121    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610124    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 12:45:52.022319 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610127    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610130    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610135    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610138    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610141    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610145    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610148    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610151    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610153    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610156    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610158    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610161    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610163    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610166    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610169    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610171    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610174    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610176    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610179    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610181    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 12:45:52.023051 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610184    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610186    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610190    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610193    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610196    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610199    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610202    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610204    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610207    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610210    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610212    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610215    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610217    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610219    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610223    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610226    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610229    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610233    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 12:45:52.023707 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.610236    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.611184    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.618562    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.618578    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.619484    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.619496    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619560    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619565    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619569    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619572    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619575    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619578    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619581    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619583    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619586    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 12:45:52.024372 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619589    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619591    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619594    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619596    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619599    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619601    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619604    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619607    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619609    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619612    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619614    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619617    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619619    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619622    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619624    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619628    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619630    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619633    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619635    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 12:45:52.024824 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619638    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619641    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619644    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619646    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619649    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619651    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619654    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619656    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619659    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619661    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619664    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619666    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619669    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619671    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619674    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619676    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619679    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619681    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619684    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619686    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 12:45:52.025466 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619689    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619692    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619695    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619697    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619700    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619703    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619706    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619709    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619711    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619717    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619720    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619723    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619725    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619728    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619730    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619733    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619735    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619738    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619741    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 12:45:52.026115 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619743    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619748    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619751    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619754    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619757    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619760    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619763    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619766    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619769    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619773    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619777    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619780    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619782    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619784    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619787    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619790    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619792    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619795    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619799    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 12:45:52.026751 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619802    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619805    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619808    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619811    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619814    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619817    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619820    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619823    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619826    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619828    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619831    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619834    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619837    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.619845    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619953    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 10 12:45:52.027390 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619957    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619962    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619965    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619967    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619970    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619973    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619975    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619978    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619982    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.619986    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620005    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620008    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620012    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620014    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620017    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620020    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620023    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620026    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620028    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 10 12:45:52.027838 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620030    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620033    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620036    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620039    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620042    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620044    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620047    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620050    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620053    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620055    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620058    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620060    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620065    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620067    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620072    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620074    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620077    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620079    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620082    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620085    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 10 12:45:52.028518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620087    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620090    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620092    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620095    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620098    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620100    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620103    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620105    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620108    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620110    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620113    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620116    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620118    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620121    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620123    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620126    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620129    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620132    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620135    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620137    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 10 12:45:52.029194 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620140    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620142    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620145    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620147    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620154    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620157    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620161    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620164    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620167    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620170    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620173    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620175    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620178    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620181    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620183    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620186    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620189    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620192    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620194    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 10 12:45:52.029835 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620197    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620199    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620202    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620204    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620207    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620211    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620214    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620217    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620219    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620222    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620225    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620228    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620230    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620233    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620235    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620238    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620240    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620244    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620247    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 10 12:45:52.030470 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:51.620251    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.620256    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.620355    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.622678    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.624334    2577 server.go:1019] "Starting client certificate rotation"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.624437    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.624469    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.627979    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.629942    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.638639    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.641872    2577 log.go:25] "Validated CRI v1 image API"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.643563    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 10 12:45:52.031358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.646057    2577 fs.go:135] Filesystem UUIDs: map[5cc5497f-4540-47ad-9c7a-363060d6e476:/dev/nvme0n1p3 7481e499-1408-4f6a-9b95-b84dc0bb6110:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 10 12:45:52.031798 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.646072    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 10 12:45:52.032255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.651476    2577 manager.go:216] Machine: {Timestamp:2026-07-10 12:45:51.650093052 +0000 UTC m=+0.367822923 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100575 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2612ba9326b86d0a5a6f07ae2170a3 SystemUUID:ec2612ba-9326-b86d-0a5a-6f07ae2170a3 BootID:dca5d779-0c3d-4fe1-ad43-560dd01787cd Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:11:01:f3:bf:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:11:01:f3:bf:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:fd:3f:06:cc:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 10 12:45:52.032255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.651570    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 10 12:45:52.032255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.651645    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 10 12:45:52.032255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.655278    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 10 12:45:52.032255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.655304    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-90.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 10 12:45:52.032255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.656160    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 10 12:45:52.032255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.656169    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 10 12:45:52.032255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.656176    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.657062    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.657464    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.658969    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.663624    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.663742    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.663768    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.663776    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.663790    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.663799    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.663808    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.664103    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.664118    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.666349    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.668795    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.668822    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.668960    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.668971    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.668979    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.668984    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.669008    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.669013    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.669622    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.669628    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.669634    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.669638    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.669652    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.669660    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.670464    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.670470    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.673543    2577 server.go:1268] "Started kubelet"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.673730    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.673729    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.673793    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.678572    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.678919    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nkqw5"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.680064    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-90.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.680354    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nkqw5"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.680675    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:51.680703    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.687522    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 10 12:45:52.032698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.687526    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:51.687635    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688281    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688281    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688310    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688390    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688399    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688666    2577 factory.go:153] Registering CRI-O factory
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688681    2577 factory.go:223] Registration of the crio container factory successfully
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688732    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688745    2577 factory.go:55] Registering systemd factory
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688753    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688775    2577 factory.go:103] Registering Raw factory
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.688792    2577 manager.go:1196] Started watching for new ooms in manager
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.689217    2577 manager.go:349] Starting recovery of all containers
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.689859    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.692264    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.699783    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:51.700132    2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-90.ec2.internal\" not found" node="ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.706688    2577 manager.go:354] Recovery completed
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.714047    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.716638    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.716662    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.716676    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.717197    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.717209    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.717229    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.717198    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.717968    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.718004    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.718015    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.719401    2577 policy_none.go:49] "None policy: Start"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.719418    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.719432    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.721393    2577 policy_none.go:47] "Start"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.759515    2577 manager.go:337] "Starting Device Plugin manager"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:51.759547    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.759556    2577 server.go:87] "Starting device plugin registration server"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.759758    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.759767    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.759889    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.759965    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.759973    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 10 12:45:52.033961 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:51.760449    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:51.760488    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.778061    2577 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2610 into the system container \"/system.slice\": <nil>"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.860668    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.861724    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientMemory"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.861760    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasNoDiskPressure"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.861771    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeHasSufficientPID"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.861798    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.870489    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:51.870511    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-90.ec2.internal\": node \"ip-10-0-134-90.ec2.internal\" not found"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.949370    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.950702    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.950737    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.950761    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:51.950802    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 10 12:45:52.037304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:51.960096    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.051179    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"]
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.054086    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.056092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.074484    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.077748    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.084585    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.088109    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.091341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2216e064274bc03d8f6db46798e4f858-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"2216e064274bc03d8f6db46798e4f858\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.091361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e10c79277ce0c29610fb7bb3c6edae1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"6e10c79277ce0c29610fb7bb3c6edae1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.166344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.091391    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e10c79277ce0c29610fb7bb3c6edae1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"6e10c79277ce0c29610fb7bb3c6edae1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.278186 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.192487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e10c79277ce0c29610fb7bb3c6edae1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"6e10c79277ce0c29610fb7bb3c6edae1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.278186 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.192508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2216e064274bc03d8f6db46798e4f858-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"2216e064274bc03d8f6db46798e4f858\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.278186 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.192524    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e10c79277ce0c29610fb7bb3c6edae1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"6e10c79277ce0c29610fb7bb3c6edae1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.278186 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.192563    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6e10c79277ce0c29610fb7bb3c6edae1-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"6e10c79277ce0c29610fb7bb3c6edae1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.278186 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.192578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e10c79277ce0c29610fb7bb3c6edae1-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal\" (UID: \"6e10c79277ce0c29610fb7bb3c6edae1\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.278186 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.192601    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2216e064274bc03d8f6db46798e4f858-config\") pod \"kube-apiserver-proxy-ip-10-0-134-90.ec2.internal\" (UID: \"2216e064274bc03d8f6db46798e4f858\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.399877 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.386699    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:52.399877 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:52.391508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal"
Jul 10 12:45:53.824336 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:53.823608    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 10 12:45:53.824336 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:53.823735    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 12:45:53.824336 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:53.823775    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 12:45:53.824336 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:53.823792    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 10 12:45:53.919411 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:53.864321    2577 apiserver.go:52] "Watching apiserver"
Jul 10 12:45:53.919411 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:53.886592    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 12:40:52 +0000 UTC" deadline="2028-03-02 15:38:24.004597293 +0000 UTC"
Jul 10 12:45:53.919411 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:53.886612    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14426h52m30.117988234s"
Jul 10 12:45:53.919411 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:53.887660    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 10 12:45:54.943421 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.943395    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 12:45:54.946236 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.946215    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 10 12:45:54.946511 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.946490    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-k7rxk","kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal","openshift-dns/node-resolver-mdmm5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal","openshift-multus/multus-additional-cni-plugins-l96bp","openshift-ovn-kubernetes/ovnkube-node-phvmp","kube-system/konnectivity-agent-6plxw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm","openshift-cluster-node-tuning-operator/tuned-csfrd","openshift-image-registry/node-ca-7ngx9","openshift-multus/multus-wpvrl","openshift-multus/network-metrics-daemon-z7qjm","openshift-network-diagnostics/network-check-target-kbrxg","openshift-network-operator/iptables-alerter-kzf77"]
Jul 10 12:45:54.949029 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.949011    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:54.949128 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:54.949090    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:45:54.949452 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.949436    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 10 12:45:54.951017 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.951004    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:54.953355 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.953336    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 10 12:45:54.953355 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.953352    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ps5h7\""
Jul 10 12:45:54.953491 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.953339    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 10 12:45:54.953491 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.953421    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:54.955635 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.955613    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.955904 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.955884    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p4blf\""
Jul 10 12:45:54.956430 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.956412    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 10 12:45:54.956510 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.956432    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 10 12:45:54.956680 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.956667    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 10 12:45:54.956742 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.956671    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 10 12:45:54.956742 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.956706    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 10 12:45:54.957684 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.957669    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:45:54.957902 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.957883    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 10 12:45:54.957971 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.957884    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 10 12:45:54.958304 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.958292    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k7w59\""
Jul 10 12:45:54.958541 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.958526    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 10 12:45:54.959704 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.959688    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 10 12:45:54.959780 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.959694    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 10 12:45:54.959780 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.959694    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 10 12:45:54.960018 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.960002    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:54.960455 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.960437    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 10 12:45:54.960524 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.960437    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-clqj7\""
Jul 10 12:45:54.960556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.960443    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 10 12:45:54.961954 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.961942    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 10 12:45:54.962392 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.962377    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:54.962552 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.962526    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-49zhw\""
Jul 10 12:45:54.962670 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.962555    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 10 12:45:54.962753 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.962741    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 10 12:45:54.964740 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.964725    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:54.965045 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.965030    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nqwr4\""
Jul 10 12:45:54.965120 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.965075    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 10 12:45:54.965120 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.965097    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 10 12:45:54.967280 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.967265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.967622 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.967428    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 10 12:45:54.967622 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.967562    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 10 12:45:54.967773 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.967702    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gbk2h\""
Jul 10 12:45:54.967773 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.967764    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 10 12:45:54.970406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.969907    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 10 12:45:54.970406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.970331    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-tpt8g\""
Jul 10 12:45:54.970704 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.970685    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:54.972187 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.970768    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjphv"
Jul 10 12:45:54.972187 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:54.970902    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:45:54.973184 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.973166    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:45:54.973260 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:54.973240    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:45:54.975337 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.975320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:54.977730 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.977715    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 10 12:45:54.977787 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.977749    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 10 12:45:54.977968 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.977953    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 10 12:45:54.978093 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.978081    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bdw9x\""
Jul 10 12:45:54.978439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.978427    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjphv"
Jul 10 12:45:54.988934 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.988921    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 10 12:45:54.990467 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.990455    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 12:45:54.998992 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.998976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-netns\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999057 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45552\" (UniqueName: \"kubernetes.io/projected/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-kube-api-access-45552\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:54.999057 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-sys-fs\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:54.999057 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999035    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-systemd-units\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999174 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovn-node-metrics-cert\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999174 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999078    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysctl-d\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:54.999174 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999092    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-host\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:54.999174 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999108    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnknv\" (UniqueName: \"kubernetes.io/projected/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-kube-api-access-gnknv\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:54.999174 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-systemd\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999174 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-cni-netd\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999174 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-run\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-lib-modules\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-tuned\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-cnibin\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999244    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-conf-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999258    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-multus-certs\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999274    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae5e1017-100f-4a1f-bdbc-19095d60dbca-konnectivity-ca\") pod \"konnectivity-agent-6plxw\" (UID: \"ae5e1017-100f-4a1f-bdbc-19095d60dbca\") " pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999327    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-kubelet-config\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-cni-bin\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-env-overrides\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999420    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovnkube-script-lib\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bjnh\" (UniqueName: \"kubernetes.io/projected/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-kube-api-access-6bjnh\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999469    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-tmp-dir\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-socket-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-cni-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-cni-bin\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999533    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-system-cni-dir\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999551    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvnbq\" (UniqueName: \"kubernetes.io/projected/45fd9958-6924-45b1-8e9a-c1bb4067094f-kube-api-access-mvnbq\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999566    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-ovn\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzgl8\" (UniqueName: \"kubernetes.io/projected/062f184f-688a-435f-be5c-f3ba8be4d9aa-kube-api-access-pzgl8\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999632    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-os-release\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-k8s-cni-cncf-io\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999672    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45fd9958-6924-45b1-8e9a-c1bb4067094f-serviceca\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:54.999768 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-slash\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999722    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-etc-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovnkube-config\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999766    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-systemd\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-etc-kubernetes\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-host-slash\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999911    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae5e1017-100f-4a1f-bdbc-19095d60dbca-agent-certs\") pod \"konnectivity-agent-6plxw\" (UID: \"ae5e1017-100f-4a1f-bdbc-19095d60dbca\") " pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999926    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-device-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4h24\" (UniqueName: \"kubernetes.io/projected/d433eb93-bab1-465f-b6e5-d849aa342f28-kube-api-access-j4h24\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-node-log\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:54.999987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-hosts-file\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-registration-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.000258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysctl-conf\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-cni-binary-copy\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000102    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45fd9958-6924-45b1-8e9a-c1bb4067094f-host\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000121    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-dbus\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-var-lib-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-socket-dir-parent\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-os-release\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhsxt\" (UniqueName: \"kubernetes.io/projected/f6510c54-bb9d-41b4-b3b2-03503728255f-kube-api-access-bhsxt\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysconfig\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-hostroot\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000356    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnfb7\" (UniqueName: \"kubernetes.io/projected/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-kube-api-access-jnfb7\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.000931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000380    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-kubelet\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000439    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-sys\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-var-lib-kubelet\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000486    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/608021c5-97df-48d2-910c-f5b55bce5a5e-tmp\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000530    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kzln\" (UniqueName: \"kubernetes.io/projected/608021c5-97df-48d2-910c-f5b55bce5a5e-kube-api-access-7kzln\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000553    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-system-cni-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-cni-multus\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000598    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-kubelet\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000623    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-cni-binary-copy\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000646    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000671    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-run-netns\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.001290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000716    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-log-socket\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.001642 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-daemon-config\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.001642 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-iptables-alerter-script\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.001642 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-cnibin\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.001642 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.001642 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-modprobe-d\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.001642 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.000875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-kubernetes\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.102846    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-host-slash\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.102995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae5e1017-100f-4a1f-bdbc-19095d60dbca-agent-certs\") pod \"konnectivity-agent-6plxw\" (UID: \"ae5e1017-100f-4a1f-bdbc-19095d60dbca\") " pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-device-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4h24\" (UniqueName: \"kubernetes.io/projected/d433eb93-bab1-465f-b6e5-d849aa342f28-kube-api-access-j4h24\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-node-log\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103115    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-hosts-file\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-registration-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103167    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysctl-conf\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103197    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-cni-binary-copy\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103223    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45fd9958-6924-45b1-8e9a-c1bb4067094f-host\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-dbus\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103295    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-var-lib-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.104406 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-socket-dir-parent\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-os-release\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103368    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhsxt\" (UniqueName: \"kubernetes.io/projected/f6510c54-bb9d-41b4-b3b2-03503728255f-kube-api-access-bhsxt\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysconfig\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-hostroot\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnfb7\" (UniqueName: \"kubernetes.io/projected/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-kube-api-access-jnfb7\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103542    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-kubelet\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-sys\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-var-lib-kubelet\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/608021c5-97df-48d2-910c-f5b55bce5a5e-tmp\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103639    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kzln\" (UniqueName: \"kubernetes.io/projected/608021c5-97df-48d2-910c-f5b55bce5a5e-kube-api-access-7kzln\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.105054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-system-cni-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-cni-multus\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-kubelet\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-cni-binary-copy\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103795    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103839    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-run-netns\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-log-socket\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103926    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-daemon-config\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103951    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-iptables-alerter-script\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.103978    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-cnibin\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-modprobe-d\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104059    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-kubernetes\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.105556 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104082    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-netns\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45552\" (UniqueName: \"kubernetes.io/projected/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-kube-api-access-45552\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-sys-fs\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-systemd-units\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovn-node-metrics-cert\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104243    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysctl-d\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-host\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104376    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-host-slash\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnknv\" (UniqueName: \"kubernetes.io/projected/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-kube-api-access-gnknv\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-kubelet\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104495    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-socket-dir-parent\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-netns\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104613    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-host\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104652    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-var-lib-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104656    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 10 12:45:55.106105 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-dbus\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.104755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-os-release\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysconfig\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105348    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-etc-selinux\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-daemon-config\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105465    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-device-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105498    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-hostroot\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105752    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-node-log\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-system-cni-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-hosts-file\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-kubelet\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105870    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-cni-multus\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-registration-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.105934    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-sys\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106009    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysctl-conf\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.106751 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-systemd\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106090    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-cni-netd\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-run\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-lib-modules\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106161    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-tuned\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106172    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-systemd\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106183    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-cnibin\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-conf-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106225    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106285    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-cnibin\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106286    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45fd9958-6924-45b1-8e9a-c1bb4067094f-host\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106316    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106335    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-conf-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106229    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-multus-certs\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106369    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae5e1017-100f-4a1f-bdbc-19095d60dbca-konnectivity-ca\") pod \"konnectivity-agent-6plxw\" (UID: \"ae5e1017-100f-4a1f-bdbc-19095d60dbca\") " pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:45:55.107444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106417    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-kubelet-config\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-cni-bin\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106443    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-cni-binary-copy\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-env-overrides\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovnkube-script-lib\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bjnh\" (UniqueName: \"kubernetes.io/projected/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-kube-api-access-6bjnh\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-tmp-dir\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-socket-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-cni-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-cni-bin\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-system-cni-dir\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106684    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvnbq\" (UniqueName: \"kubernetes.io/projected/45fd9958-6924-45b1-8e9a-c1bb4067094f-kube-api-access-mvnbq\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:55.108154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106736    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-kubelet-config\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106757    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-cni-binary-copy\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-ovn\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-iptables-alerter-script\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzgl8\" (UniqueName: \"kubernetes.io/projected/062f184f-688a-435f-be5c-f3ba8be4d9aa-kube-api-access-pzgl8\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106882    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-os-release\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-socket-dir\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106941    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-multus-cni-dir\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106947    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-os-release\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-k8s-cni-cncf-io\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-run\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45fd9958-6924-45b1-8e9a-c1bb4067094f-serviceca\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:55.108723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107390    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-env-overrides\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45fd9958-6924-45b1-8e9a-c1bb4067094f-serviceca\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107447    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-var-lib-kubelet\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae5e1017-100f-4a1f-bdbc-19095d60dbca-konnectivity-ca\") pod \"konnectivity-agent-6plxw\" (UID: \"ae5e1017-100f-4a1f-bdbc-19095d60dbca\") " pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107460    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-tmp-dir\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107482    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-cni-bin\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-var-lib-cni-bin\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106827    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-cnibin\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107544    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6510c54-bb9d-41b4-b3b2-03503728255f-system-cni-dir\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107568    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-modprobe-d\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-log-socket\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-multus-certs\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107622    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-systemd-units\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-host-run-k8s-cni-cncf-io\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-sysctl-d\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.109214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.106825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-lib-modules\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107692    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-cni-netd\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107755    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-run-ovn\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107765    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-sys-fs\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107829    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107873    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-kubernetes\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107907    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-run-netns\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.107942    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.107986    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovnkube-script-lib\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.108018    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret podName:0b926a5b-58aa-4b93-bec4-f0728adbdd7f nodeName:}" failed. No retries permitted until 2026-07-10 12:45:55.607979431 +0000 UTC m=+3.125899692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret") pod "global-pull-secret-syncer-k7rxk" (UID: "0b926a5b-58aa-4b93-bec4-f0728adbdd7f") : object "kube-system"/"original-pull-secret" not registered
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.108073    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-slash\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.108129    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs podName:d433eb93-bab1-465f-b6e5-d849aa342f28 nodeName:}" failed. No retries permitted until 2026-07-10 12:45:55.608113871 +0000 UTC m=+3.126034146 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs") pod "network-metrics-daemon-z7qjm" (UID: "d433eb93-bab1-465f-b6e5-d849aa342f28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108136    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-etc-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.109604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovnkube-config\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-systemd\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-etc-openvswitch\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-slash\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f6510c54-bb9d-41b4-b3b2-03503728255f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108508    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-systemd\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108838    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-etc-kubernetes\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108895    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/608021c5-97df-48d2-910c-f5b55bce5a5e-tmp\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-etc-kubernetes\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.108951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/062f184f-688a-435f-be5c-f3ba8be4d9aa-host-run-ovn-kubernetes\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.109182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae5e1017-100f-4a1f-bdbc-19095d60dbca-agent-certs\") pod \"konnectivity-agent-6plxw\" (UID: \"ae5e1017-100f-4a1f-bdbc-19095d60dbca\") " pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:45:55.110023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.109423    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovnkube-config\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.110357 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.110036    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/608021c5-97df-48d2-910c-f5b55bce5a5e-etc-tuned\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.110357 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.110311    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/062f184f-688a-435f-be5c-f3ba8be4d9aa-ovn-node-metrics-cert\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.113267 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.113242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhsxt\" (UniqueName: \"kubernetes.io/projected/f6510c54-bb9d-41b4-b3b2-03503728255f-kube-api-access-bhsxt\") pod \"multus-additional-cni-plugins-l96bp\" (UID: \"f6510c54-bb9d-41b4-b3b2-03503728255f\") " pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.113267 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.113252    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 12:45:55.113398 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.113273    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 12:45:55.113398 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.113289    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9ntt7 for pod openshift-network-diagnostics/network-check-target-kbrxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:45:55.113398 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.113348    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7 podName:34caebbf-a685-40e4-8570-d58689210d46 nodeName:}" failed. No retries permitted until 2026-07-10 12:45:55.613330716 +0000 UTC m=+3.131250988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9ntt7" (UniqueName: "kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7") pod "network-check-target-kbrxg" (UID: "34caebbf-a685-40e4-8570-d58689210d46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:45:55.113938 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.113915    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnknv\" (UniqueName: \"kubernetes.io/projected/5f4255f9-60ee-4436-8a2e-e2df835a9a0d-kube-api-access-gnknv\") pod \"aws-ebs-csi-driver-node-czrzm\" (UID: \"5f4255f9-60ee-4436-8a2e-e2df835a9a0d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.115626 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.115581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bjnh\" (UniqueName: \"kubernetes.io/projected/998dacb4-bbb4-485c-9b42-7bb2ebe05c29-kube-api-access-6bjnh\") pod \"multus-wpvrl\" (UID: \"998dacb4-bbb4-485c-9b42-7bb2ebe05c29\") " pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.115928 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.115862    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnfb7\" (UniqueName: \"kubernetes.io/projected/9c06dc3e-7d36-47dc-b85b-c30994fb9c0e-kube-api-access-jnfb7\") pod \"iptables-alerter-kzf77\" (UID: \"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e\") " pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.116016 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.115974    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvnbq\" (UniqueName: \"kubernetes.io/projected/45fd9958-6924-45b1-8e9a-c1bb4067094f-kube-api-access-mvnbq\") pod \"node-ca-7ngx9\" (UID: \"45fd9958-6924-45b1-8e9a-c1bb4067094f\") " pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:55.116323 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.116306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kzln\" (UniqueName: \"kubernetes.io/projected/608021c5-97df-48d2-910c-f5b55bce5a5e-kube-api-access-7kzln\") pod \"tuned-csfrd\" (UID: \"608021c5-97df-48d2-910c-f5b55bce5a5e\") " pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.116407 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.116320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4h24\" (UniqueName: \"kubernetes.io/projected/d433eb93-bab1-465f-b6e5-d849aa342f28-kube-api-access-j4h24\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:55.117078 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.117058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzgl8\" (UniqueName: \"kubernetes.io/projected/062f184f-688a-435f-be5c-f3ba8be4d9aa-kube-api-access-pzgl8\") pod \"ovnkube-node-phvmp\" (UID: \"062f184f-688a-435f-be5c-f3ba8be4d9aa\") " pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.119026 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.119007    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45552\" (UniqueName: \"kubernetes.io/projected/469f0fde-1dcd-4d2e-aee1-24a1a72c892f-kube-api-access-45552\") pod \"node-resolver-mdmm5\" (UID: \"469f0fde-1dcd-4d2e-aee1-24a1a72c892f\") " pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:55.275450 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.275381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mdmm5"
Jul 10 12:45:55.302502 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.302481    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l96bp"
Jul 10 12:45:55.324536 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.324515    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:45:55.337208 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.337188    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:45:55.353639 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.353622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm"
Jul 10 12:45:55.356027 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.356000    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-csfrd"
Jul 10 12:45:55.367237 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.367222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7ngx9"
Jul 10 12:45:55.383888 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.383870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wpvrl"
Jul 10 12:45:55.388763 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.388744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kzf77"
Jul 10 12:45:55.389240 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.389221    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 10 12:45:55.402564 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.402527    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod998dacb4_bbb4_485c_9b42_7bb2ebe05c29.slice/crio-ac1877cd6f2ededb2bde6c085d27235e55687d0fd6404dc6f41e1ce10eb8c40d WatchSource:0}: Error finding container ac1877cd6f2ededb2bde6c085d27235e55687d0fd6404dc6f41e1ce10eb8c40d: Status 404 returned error can't find the container with id ac1877cd6f2ededb2bde6c085d27235e55687d0fd6404dc6f41e1ce10eb8c40d
Jul 10 12:45:55.403096 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.403078    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c06dc3e_7d36_47dc_b85b_c30994fb9c0e.slice/crio-05a9dd4ebcaf38f4b9338d7e7bfa788bfa20ee13e227eac1de740c0a5b515926 WatchSource:0}: Error finding container 05a9dd4ebcaf38f4b9338d7e7bfa788bfa20ee13e227eac1de740c0a5b515926: Status 404 returned error can't find the container with id 05a9dd4ebcaf38f4b9338d7e7bfa788bfa20ee13e227eac1de740c0a5b515926
Jul 10 12:45:55.404257 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.404237    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e10c79277ce0c29610fb7bb3c6edae1.slice/crio-4ce84a7454c86257334a7c2151bd9ad560476f1c3c3b0c12e721f215794986d2 WatchSource:0}: Error finding container 4ce84a7454c86257334a7c2151bd9ad560476f1c3c3b0c12e721f215794986d2: Status 404 returned error can't find the container with id 4ce84a7454c86257334a7c2151bd9ad560476f1c3c3b0c12e721f215794986d2
Jul 10 12:45:55.404404 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.404387    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2216e064274bc03d8f6db46798e4f858.slice/crio-37e7660c0c665b30545b7669d40c9bf92ac06c93eb7bce7bf683d000ce6c75d5 WatchSource:0}: Error finding container 37e7660c0c665b30545b7669d40c9bf92ac06c93eb7bce7bf683d000ce6c75d5: Status 404 returned error can't find the container with id 37e7660c0c665b30545b7669d40c9bf92ac06c93eb7bce7bf683d000ce6c75d5
Jul 10 12:45:55.408083 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.407957    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 12:45:55.613052 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.612970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:55.613052 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.613013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:55.613229 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.613107    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 12:45:55.613229 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.613110    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:45:55.613229 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.613155    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret podName:0b926a5b-58aa-4b93-bec4-f0728adbdd7f nodeName:}" failed. No retries permitted until 2026-07-10 12:45:56.613140981 +0000 UTC m=+4.131061225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret") pod "global-pull-secret-syncer-k7rxk" (UID: "0b926a5b-58aa-4b93-bec4-f0728adbdd7f") : object "kube-system"/"original-pull-secret" not registered
Jul 10 12:45:55.613229 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.613168    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs podName:d433eb93-bab1-465f-b6e5-d849aa342f28 nodeName:}" failed. No retries permitted until 2026-07-10 12:45:56.613161291 +0000 UTC m=+4.131081537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs") pod "network-metrics-daemon-z7qjm" (UID: "d433eb93-bab1-465f-b6e5-d849aa342f28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:45:55.679174 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.679140    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod062f184f_688a_435f_be5c_f3ba8be4d9aa.slice/crio-2d75a3e2619f0fe53fa3c28d28d216d4fc7dc9b4ec4c65f77c79f762feb37f36 WatchSource:0}: Error finding container 2d75a3e2619f0fe53fa3c28d28d216d4fc7dc9b4ec4c65f77c79f762feb37f36: Status 404 returned error can't find the container with id 2d75a3e2619f0fe53fa3c28d28d216d4fc7dc9b4ec4c65f77c79f762feb37f36
Jul 10 12:45:55.713322 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.713296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:45:55.713439 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.713426    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 12:45:55.713502 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.713441    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 12:45:55.713502 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.713450    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9ntt7 for pod openshift-network-diagnostics/network-check-target-kbrxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:45:55.713502 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:55.713491    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7 podName:34caebbf-a685-40e4-8570-d58689210d46 nodeName:}" failed. No retries permitted until 2026-07-10 12:45:56.713478736 +0000 UTC m=+4.231398982 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ntt7" (UniqueName: "kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7") pod "network-check-target-kbrxg" (UID: "34caebbf-a685-40e4-8570-d58689210d46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:45:55.714531 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.714510    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6510c54_bb9d_41b4_b3b2_03503728255f.slice/crio-2fb3fdd12f747d42a61ac1a0fa2fa078bafd09a42a3076eee931369134312391 WatchSource:0}: Error finding container 2fb3fdd12f747d42a61ac1a0fa2fa078bafd09a42a3076eee931369134312391: Status 404 returned error can't find the container with id 2fb3fdd12f747d42a61ac1a0fa2fa078bafd09a42a3076eee931369134312391
Jul 10 12:45:55.769921 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.769901    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fd9958_6924_45b1_8e9a_c1bb4067094f.slice/crio-f5457ada0acd01caa3e2421020dc0f318730161d792d0a16ab9a4bcafcb19c65 WatchSource:0}: Error finding container f5457ada0acd01caa3e2421020dc0f318730161d792d0a16ab9a4bcafcb19c65: Status 404 returned error can't find the container with id f5457ada0acd01caa3e2421020dc0f318730161d792d0a16ab9a4bcafcb19c65
Jul 10 12:45:55.796490 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.796471    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4255f9_60ee_4436_8a2e_e2df835a9a0d.slice/crio-ce28aef65146719c4ccc8502a0113793fc4b44231aabca115391c631748b6fd6 WatchSource:0}: Error finding container ce28aef65146719c4ccc8502a0113793fc4b44231aabca115391c631748b6fd6: Status 404 returned error can't find the container with id ce28aef65146719c4ccc8502a0113793fc4b44231aabca115391c631748b6fd6
Jul 10 12:45:55.812581 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.812557    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469f0fde_1dcd_4d2e_aee1_24a1a72c892f.slice/crio-bcd0c8fd936304e1366b58061660c93550e5994e9c1f898ad457f8747b0df5a4 WatchSource:0}: Error finding container bcd0c8fd936304e1366b58061660c93550e5994e9c1f898ad457f8747b0df5a4: Status 404 returned error can't find the container with id bcd0c8fd936304e1366b58061660c93550e5994e9c1f898ad457f8747b0df5a4
Jul 10 12:45:55.838836 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:55.838815    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae5e1017_100f_4a1f_bdbc_19095d60dbca.slice/crio-7dcf885392311e348d25d3b4a26896d2be90de328559a7c9e60f972c66517f4a WatchSource:0}: Error finding container 7dcf885392311e348d25d3b4a26896d2be90de328559a7c9e60f972c66517f4a: Status 404 returned error can't find the container with id 7dcf885392311e348d25d3b4a26896d2be90de328559a7c9e60f972c66517f4a
Jul 10 12:45:55.930653 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.930595    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"2d75a3e2619f0fe53fa3c28d28d216d4fc7dc9b4ec4c65f77c79f762feb37f36"}
Jul 10 12:45:55.931913 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.931887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wpvrl" event={"ID":"998dacb4-bbb4-485c-9b42-7bb2ebe05c29","Type":"ContainerStarted","Data":"ac1877cd6f2ededb2bde6c085d27235e55687d0fd6404dc6f41e1ce10eb8c40d"}
Jul 10 12:45:55.933118 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.933095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"6e10c79277ce0c29610fb7bb3c6edae1","Type":"ContainerStarted","Data":"4ce84a7454c86257334a7c2151bd9ad560476f1c3c3b0c12e721f215794986d2"}
Jul 10 12:45:55.934228 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.934204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" event={"ID":"2216e064274bc03d8f6db46798e4f858","Type":"ContainerStarted","Data":"37e7660c0c665b30545b7669d40c9bf92ac06c93eb7bce7bf683d000ce6c75d5"}
Jul 10 12:45:55.935659 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.935624    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm" event={"ID":"5f4255f9-60ee-4436-8a2e-e2df835a9a0d","Type":"ContainerStarted","Data":"ce28aef65146719c4ccc8502a0113793fc4b44231aabca115391c631748b6fd6"}
Jul 10 12:45:55.936840 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.936819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7ngx9" event={"ID":"45fd9958-6924-45b1-8e9a-c1bb4067094f","Type":"ContainerStarted","Data":"f5457ada0acd01caa3e2421020dc0f318730161d792d0a16ab9a4bcafcb19c65"}
Jul 10 12:45:55.938072 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.938049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kzf77" event={"ID":"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e","Type":"ContainerStarted","Data":"05a9dd4ebcaf38f4b9338d7e7bfa788bfa20ee13e227eac1de740c0a5b515926"}
Jul 10 12:45:55.939265 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.939244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6plxw" event={"ID":"ae5e1017-100f-4a1f-bdbc-19095d60dbca","Type":"ContainerStarted","Data":"7dcf885392311e348d25d3b4a26896d2be90de328559a7c9e60f972c66517f4a"}
Jul 10 12:45:55.940358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.940337    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mdmm5" event={"ID":"469f0fde-1dcd-4d2e-aee1-24a1a72c892f","Type":"ContainerStarted","Data":"bcd0c8fd936304e1366b58061660c93550e5994e9c1f898ad457f8747b0df5a4"}
Jul 10 12:45:55.941408 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.941387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerStarted","Data":"2fb3fdd12f747d42a61ac1a0fa2fa078bafd09a42a3076eee931369134312391"}
Jul 10 12:45:55.981502 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.981440    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 12:40:54 +0000 UTC" deadline="2028-03-07 23:41:58.239543111 +0000 UTC"
Jul 10 12:45:55.981502 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:55.981496    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14554h56m2.258050633s"
Jul 10 12:45:56.041559 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:45:56.041525    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod608021c5_97df_48d2_910c_f5b55bce5a5e.slice/crio-3605574cd39fd145b2ad6243b55b33917b66b8d4c0c96bf3b275420070087889 WatchSource:0}: Error finding container 3605574cd39fd145b2ad6243b55b33917b66b8d4c0c96bf3b275420070087889: Status 404 returned error can't find the container with id 3605574cd39fd145b2ad6243b55b33917b66b8d4c0c96bf3b275420070087889
Jul 10 12:45:56.150872 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:56.150839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:56.151003 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.150957    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:45:56.151238 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:56.151216    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:45:56.151346 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.151323    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:45:56.619007 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:56.618520    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:56.619007 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:56.618588    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:56.619007 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.618787    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 12:45:56.619007 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.618859    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret podName:0b926a5b-58aa-4b93-bec4-f0728adbdd7f nodeName:}" failed. No retries permitted until 2026-07-10 12:45:58.618843056 +0000 UTC m=+6.136763315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret") pod "global-pull-secret-syncer-k7rxk" (UID: "0b926a5b-58aa-4b93-bec4-f0728adbdd7f") : object "kube-system"/"original-pull-secret" not registered
Jul 10 12:45:56.619341 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.619265    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:45:56.619341 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.619304    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs podName:d433eb93-bab1-465f-b6e5-d849aa342f28 nodeName:}" failed. No retries permitted until 2026-07-10 12:45:58.619291543 +0000 UTC m=+6.137211787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs") pod "network-metrics-daemon-z7qjm" (UID: "d433eb93-bab1-465f-b6e5-d849aa342f28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:45:56.719778 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:56.719130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:45:56.719778 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.719338    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 12:45:56.719778 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.719361    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 12:45:56.719778 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.719374    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9ntt7 for pod openshift-network-diagnostics/network-check-target-kbrxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:45:56.719778 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:56.719430    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7 podName:34caebbf-a685-40e4-8570-d58689210d46 nodeName:}" failed. No retries permitted until 2026-07-10 12:45:58.719411455 +0000 UTC m=+6.237331701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ntt7" (UniqueName: "kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7") pod "network-check-target-kbrxg" (UID: "34caebbf-a685-40e4-8570-d58689210d46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:45:56.968394 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:56.968354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-csfrd" event={"ID":"608021c5-97df-48d2-910c-f5b55bce5a5e","Type":"ContainerStarted","Data":"3605574cd39fd145b2ad6243b55b33917b66b8d4c0c96bf3b275420070087889"}
Jul 10 12:45:56.981875 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:56.981834    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 12:40:54 +0000 UTC" deadline="2028-01-30 01:54:02.52479527 +0000 UTC"
Jul 10 12:45:56.981875 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:56.981873    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13645h8m5.542927088s"
Jul 10 12:45:57.154635 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:57.153773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:57.154635 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:57.153927    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:45:58.150791 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:58.150757    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:45:58.151208 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.150907    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:45:58.151312 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:58.151272    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:58.151818 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.151369    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:45:58.637709 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:58.636995    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:45:58.637709 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:58.637112    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:58.637709 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.637219    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:45:58.637709 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.637277    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs podName:d433eb93-bab1-465f-b6e5-d849aa342f28 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:02.637258879 +0000 UTC m=+10.155179137 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs") pod "network-metrics-daemon-z7qjm" (UID: "d433eb93-bab1-465f-b6e5-d849aa342f28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:45:58.637709 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.637637    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 12:45:58.637709 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.637681    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret podName:0b926a5b-58aa-4b93-bec4-f0728adbdd7f nodeName:}" failed. No retries permitted until 2026-07-10 12:46:02.637666884 +0000 UTC m=+10.155587133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret") pod "global-pull-secret-syncer-k7rxk" (UID: "0b926a5b-58aa-4b93-bec4-f0728adbdd7f") : object "kube-system"/"original-pull-secret" not registered
Jul 10 12:45:58.737887 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:58.737812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:45:58.738055 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.737967    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 12:45:58.738055 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.737988    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 12:45:58.738055 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.738001    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9ntt7 for pod openshift-network-diagnostics/network-check-target-kbrxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:45:58.738055 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:58.738054    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7 podName:34caebbf-a685-40e4-8570-d58689210d46 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:02.738037134 +0000 UTC m=+10.255957394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ntt7" (UniqueName: "kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7") pod "network-check-target-kbrxg" (UID: "34caebbf-a685-40e4-8570-d58689210d46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:45:59.151717 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:45:59.151687    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:45:59.152175 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:45:59.151859    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:00.151115 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:00.151072    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:00.151115 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:00.151106    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:00.151346 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:00.151213    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:00.151400 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:00.151338    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:01.150898 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:01.150868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:01.151339 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:01.151015    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:02.151496 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:02.151400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:02.151979 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.151532    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:02.151979 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:02.151400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:02.152091 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.152012    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:02.672489 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:02.672315    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:02.672489 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:02.672401    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:02.672743 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.672528    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 12:46:02.672743 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.672608    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret podName:0b926a5b-58aa-4b93-bec4-f0728adbdd7f nodeName:}" failed. No retries permitted until 2026-07-10 12:46:10.672588433 +0000 UTC m=+18.190508692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret") pod "global-pull-secret-syncer-k7rxk" (UID: "0b926a5b-58aa-4b93-bec4-f0728adbdd7f") : object "kube-system"/"original-pull-secret" not registered
Jul 10 12:46:02.673067 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.672974    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:46:02.673067 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.673039    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs podName:d433eb93-bab1-465f-b6e5-d849aa342f28 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:10.673021026 +0000 UTC m=+18.190941274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs") pod "network-metrics-daemon-z7qjm" (UID: "d433eb93-bab1-465f-b6e5-d849aa342f28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:46:02.773243 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:02.772906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:02.773243 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.773081    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 12:46:02.773243 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.773105    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 12:46:02.773243 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.773117    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9ntt7 for pod openshift-network-diagnostics/network-check-target-kbrxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:46:02.773243 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:02.773182    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7 podName:34caebbf-a685-40e4-8570-d58689210d46 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:10.773164933 +0000 UTC m=+18.291085193 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ntt7" (UniqueName: "kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7") pod "network-check-target-kbrxg" (UID: "34caebbf-a685-40e4-8570-d58689210d46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:46:03.151728 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:03.151656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:03.152163 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:03.151777    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:04.151031 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:04.150990    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:04.151213 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:04.151144    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:04.151213 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:04.151194    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:04.151330 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:04.151297    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:05.150902 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:05.150868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:05.151340 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:05.151019    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:06.151410 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:06.151384    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:06.151865 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:06.151385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:06.151865 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:06.151482    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:06.151865 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:06.151586    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:07.151407 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:07.151218    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:07.151528 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:07.151488    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:08.151017 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:08.150984    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:08.151191 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:08.151125    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:08.151191 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:08.151175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:08.151304 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:08.151280    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:09.151077 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:09.151044    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:09.151486 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:09.151180    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:10.151583 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:10.151552    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:10.151583 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:10.151567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:10.152088 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.151660    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:10.152088 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.151784    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:10.737624 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:10.737574    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:10.737793 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:10.737668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:10.737793 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.737757    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 12:46:10.737793 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.737774    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:46:10.737963 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.737844    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret podName:0b926a5b-58aa-4b93-bec4-f0728adbdd7f nodeName:}" failed. No retries permitted until 2026-07-10 12:46:26.737827743 +0000 UTC m=+34.255747989 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret") pod "global-pull-secret-syncer-k7rxk" (UID: "0b926a5b-58aa-4b93-bec4-f0728adbdd7f") : object "kube-system"/"original-pull-secret" not registered
Jul 10 12:46:10.737963 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.737863    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs podName:d433eb93-bab1-465f-b6e5-d849aa342f28 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:26.737852939 +0000 UTC m=+34.255773184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs") pod "network-metrics-daemon-z7qjm" (UID: "d433eb93-bab1-465f-b6e5-d849aa342f28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:46:10.838507 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:10.838469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:10.838685 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.838638    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 12:46:10.838685 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.838659    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 12:46:10.838685 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.838670    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9ntt7 for pod openshift-network-diagnostics/network-check-target-kbrxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:46:10.838849 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:10.838725    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7 podName:34caebbf-a685-40e4-8570-d58689210d46 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:26.838711605 +0000 UTC m=+34.356631850 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ntt7" (UniqueName: "kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7") pod "network-check-target-kbrxg" (UID: "34caebbf-a685-40e4-8570-d58689210d46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:46:11.150911 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:11.150878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:11.151071 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:11.151046    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:12.150784 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:12.150748    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:12.150784 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:12.150766    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:12.151241 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:12.150882    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:12.151241 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:12.150979    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:13.151839 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:13.151777    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:13.152189 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:13.151951    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:14.151276 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:14.151243    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:14.151449 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:14.151357    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:14.151449 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:14.151423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:14.151539 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:14.151519    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:15.150966 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:15.150936    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:15.151397 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:15.151047    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:16.015521 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:16.015406    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wpvrl" event={"ID":"998dacb4-bbb4-485c-9b42-7bb2ebe05c29","Type":"ContainerStarted","Data":"87ce6f517ae0ee098c37c18dd617fa1f08cb49a2ac4140f42dd9a0f3d5e947ff"}
Jul 10 12:46:16.016745 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:16.016708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" event={"ID":"2216e064274bc03d8f6db46798e4f858","Type":"ContainerStarted","Data":"30d44ecd6e99801dc80b17d12567817dadded86879cec4900d17109ba8da981f"}
Jul 10 12:46:16.018229 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:16.018199    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-csfrd" event={"ID":"608021c5-97df-48d2-910c-f5b55bce5a5e","Type":"ContainerStarted","Data":"c9002d1814479432cfb5b1bc7a1ea26014846b8b92c07efca1110d08921c31f9"}
Jul 10 12:46:16.031997 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:16.031959    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wpvrl" podStartSLOduration=2.7497882970000003 podStartE2EDuration="23.031941582s" totalImagesPullingTime="20.282153285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:16.031844405 +0000 UTC m=+23.549764672" watchObservedRunningTime="2026-07-10 12:46:16.031941582 +0000 UTC m=+23.549861850"
Jul 10 12:46:16.047736 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:16.047697    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-csfrd" podStartSLOduration=3.415199979 podStartE2EDuration="23.047684275s" totalImagesPullingTime="19.632484296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:16.047434732 +0000 UTC m=+23.565355009" watchObservedRunningTime="2026-07-10 12:46:16.047684275 +0000 UTC m=+23.565604541"
Jul 10 12:46:16.060432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:16.060389    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-90.ec2.internal" podStartSLOduration=23.060376854 podStartE2EDuration="23.060376854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:16.060049219 +0000 UTC m=+23.577969486" watchObservedRunningTime="2026-07-10 12:46:16.060376854 +0000 UTC m=+23.578297121"
Jul 10 12:46:16.150958 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:16.150929    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:16.151096 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:16.150939    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:16.151096 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:16.151025    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:16.151413 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:16.151091    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:17.022911 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.022645    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6plxw" event={"ID":"ae5e1017-100f-4a1f-bdbc-19095d60dbca","Type":"ContainerStarted","Data":"bcc5688e4825b62fc0f2cfcc0b2d4b0901cc4a17229aec31fc3c6d75be05fe51"}
Jul 10 12:46:17.024365 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.024313    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mdmm5" event={"ID":"469f0fde-1dcd-4d2e-aee1-24a1a72c892f","Type":"ContainerStarted","Data":"e783ed2dacbe9f5ba2fdc6d6310a0303eed1322398c03ec2e950b9dbdc1d911d"}
Jul 10 12:46:17.026011 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.025983    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6510c54-bb9d-41b4-b3b2-03503728255f" containerID="276839435d8cf22149c23bdaff988f2d98d4833853c657b8782328ca93ec6713" exitCode=0
Jul 10 12:46:17.026096 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.026068    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerDied","Data":"276839435d8cf22149c23bdaff988f2d98d4833853c657b8782328ca93ec6713"}
Jul 10 12:46:17.030382 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.030255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"a98f3d3a0221745152235f74b8599dc93eae9095417db62850a5eaab9d86e1cb"}
Jul 10 12:46:17.030382 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.030331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"97b2f8e12c39c5d7bd48fdf703aaf8f242da40b21e0d6321f23b8ea204fcb58c"}
Jul 10 12:46:17.030606 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.030582    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"03591c937049c1e1318c409f291f4d4a6d9759493faff89a71784a7ff35107a7"}
Jul 10 12:46:17.030720 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.030643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"de710c3b10171e817f0591a20ce6b488370e5a68927134251925b4515e48d487"}
Jul 10 12:46:17.030720 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.030691    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"b056cca9dbbf527993396ef20316ab6112ae3cd37df4848b3c415a55601bc7c1"}
Jul 10 12:46:17.030846 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.030779    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"416eaa48ecbb385864feb935885f0b3c58878b583508c11a9da90572d2b203b4"}
Jul 10 12:46:17.032274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.032002    2577 generic.go:356] "Generic (PLEG): container finished" podID="6e10c79277ce0c29610fb7bb3c6edae1" containerID="3c98a26fba2cb25385ef0f0eb46e55aa3b3d7e62506ff72706ec294bc9c1f96c" exitCode=0
Jul 10 12:46:17.032274 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.032084    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"6e10c79277ce0c29610fb7bb3c6edae1","Type":"ContainerDied","Data":"3c98a26fba2cb25385ef0f0eb46e55aa3b3d7e62506ff72706ec294bc9c1f96c"}
Jul 10 12:46:17.033845 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.033825    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm" event={"ID":"5f4255f9-60ee-4436-8a2e-e2df835a9a0d","Type":"ContainerStarted","Data":"9201448453fc6489321b8991ed78cb6cb173cb6e5cdb2b6d4fd638f950588fe7"}
Jul 10 12:46:17.035263 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.035241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7ngx9" event={"ID":"45fd9958-6924-45b1-8e9a-c1bb4067094f","Type":"ContainerStarted","Data":"721c9b200931dfc1b32941761309694f6b1d11ddcee6835d90fe6fa7ab0368ff"}
Jul 10 12:46:17.038014 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.037980    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6plxw" podStartSLOduration=8.828532266 podStartE2EDuration="24.0379677s" totalImagesPullingTime="15.209435434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:17.037772078 +0000 UTC m=+24.555692356" watchObservedRunningTime="2026-07-10 12:46:17.0379677 +0000 UTC m=+24.555887968"
Jul 10 12:46:17.090216 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.089999    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mdmm5" podStartSLOduration=4.229778208 podStartE2EDuration="24.089979294s" totalImagesPullingTime="19.860201086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:17.069319826 +0000 UTC m=+24.587240093" watchObservedRunningTime="2026-07-10 12:46:17.089979294 +0000 UTC m=+24.607899562"
Jul 10 12:46:17.150956 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.150900    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:17.151064 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:17.151035    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:17.663973 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.663943    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 10 12:46:17.970297 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.970221    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T12:46:17.663970984Z","UUID":"5d3bc0ab-6884-4198-a938-ac07ccfba9a6","Handler":null,"Name":"","Endpoint":""}
Jul 10 12:46:17.971571 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.971556    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 10 12:46:17.971643 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:17.971587    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 10 12:46:18.039383 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.039354    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" event={"ID":"6e10c79277ce0c29610fb7bb3c6edae1","Type":"ContainerStarted","Data":"e4fd7ca70b2b198dc49cb7243b3b10f1706301d1211448c2b16341c4a36a70bd"}
Jul 10 12:46:18.041465 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.041438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm" event={"ID":"5f4255f9-60ee-4436-8a2e-e2df835a9a0d","Type":"ContainerStarted","Data":"ea73228d479d4d81e7a956060402cba45495e52afafdce91447d47131fc73b80"}
Jul 10 12:46:18.043181 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.043106    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kzf77" event={"ID":"9c06dc3e-7d36-47dc-b85b-c30994fb9c0e","Type":"ContainerStarted","Data":"38d2309a32473e8b2476e2bea40ee0d6c9364505b559ae0e6c3c035083548469"}
Jul 10 12:46:18.054018 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.053970    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7ngx9" podStartSLOduration=5.147211424 podStartE2EDuration="25.053944804s" totalImagesPullingTime="19.90673338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:17.102732461 +0000 UTC m=+24.620652727" watchObservedRunningTime="2026-07-10 12:46:18.053944804 +0000 UTC m=+25.571865072"
Jul 10 12:46:18.067154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.067110    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kzf77" podStartSLOduration=4.800701366 podStartE2EDuration="25.067094129s" totalImagesPullingTime="20.266392763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:18.067030227 +0000 UTC m=+25.584950495" watchObservedRunningTime="2026-07-10 12:46:18.067094129 +0000 UTC m=+25.585014397"
Jul 10 12:46:18.067339 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.067312    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-90.ec2.internal" podStartSLOduration=25.067303702 podStartE2EDuration="25.067303702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:18.05384683 +0000 UTC m=+25.571767096" watchObservedRunningTime="2026-07-10 12:46:18.067303702 +0000 UTC m=+25.585223973"
Jul 10 12:46:18.100483 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.100455    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:46:18.101054 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.101037    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:46:18.150963 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.150938    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:18.151109 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:18.151055    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:18.151242 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:18.151224    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:18.151354 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:18.151330    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:19.045389 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:19.045363    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:46:19.045834 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:19.045812    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6plxw"
Jul 10 12:46:19.151368 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:19.151339    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:19.151528 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:19.151482    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:20.050118 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:20.049903    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm" event={"ID":"5f4255f9-60ee-4436-8a2e-e2df835a9a0d","Type":"ContainerStarted","Data":"aa1d2ceb8763a1f3cdc5992a25129cfe9ed925403465c915d480629b1016ab7b"}
Jul 10 12:46:20.053658 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:20.053633    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"077f8e722c180985299c64b9a3fc8b97d73581e686180e80de5ec7996a838d3f"}
Jul 10 12:46:20.070610 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:20.070569    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-czrzm" podStartSLOduration=4.798146363 podStartE2EDuration="27.070554575s" totalImagesPullingTime="22.272408212s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:20.069983602 +0000 UTC m=+27.587903874" watchObservedRunningTime="2026-07-10 12:46:20.070554575 +0000 UTC m=+27.588474841"
Jul 10 12:46:20.151297 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:20.151258    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:20.151454 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:20.151257    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:20.151454 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:20.151405    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:20.151454 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:20.151444    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:21.151258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:21.151226    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:21.151651 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:21.151369    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:22.062078 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:22.062002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" event={"ID":"062f184f-688a-435f-be5c-f3ba8be4d9aa","Type":"ContainerStarted","Data":"21bde0815a5c087532bac1c1c1c91d0404b75fafb6ec8c69f82672f9acac8534"}
Jul 10 12:46:22.150848 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:22.150821    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:22.150967 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:22.150933    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:22.151037 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:22.150981    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:22.151086 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:22.151066    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:23.065871 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.065678    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6510c54-bb9d-41b4-b3b2-03503728255f" containerID="5085ec01a29601172fc7e200f90b3a66194231b130cc8f8c7e61e48e96e9e74b" exitCode=0
Jul 10 12:46:23.065871 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.065756    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerDied","Data":"5085ec01a29601172fc7e200f90b3a66194231b130cc8f8c7e61e48e96e9e74b"}
Jul 10 12:46:23.066729 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.066133    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:46:23.066729 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.066201    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:46:23.081317 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.081298    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:46:23.116462 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.116423    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp" podStartSLOduration=9.527541397 podStartE2EDuration="30.116412505s" totalImagesPullingTime="20.588871108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:23.115970612 +0000 UTC m=+30.633890878" watchObservedRunningTime="2026-07-10 12:46:23.116412505 +0000 UTC m=+30.634332772"
Jul 10 12:46:23.154202 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.153367    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:23.154345 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:23.154308    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:23.685822 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.685768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:23.798668 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:23.798613    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:24.068254 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:24.068222    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:46:24.083577 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:24.083555    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:46:24.151547 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:24.151526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:24.151640 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:24.151526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:24.151712 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:24.151696    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:24.151748 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:24.151617    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:24.244771 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:24.244745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kbrxg"]
Jul 10 12:46:24.247965 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:24.247930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k7rxk"]
Jul 10 12:46:24.248557 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:24.248536    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z7qjm"]
Jul 10 12:46:24.248646 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:24.248628    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:24.248757 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:24.248739    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:25.071575 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:25.071546    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6510c54-bb9d-41b4-b3b2-03503728255f" containerID="76ea7720dde63e2bb9528f836ac55e75daae04950f6732307d773be9f0b4c3f9" exitCode=0
Jul 10 12:46:25.072025 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:25.071615    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:25.072025 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:25.071644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerDied","Data":"76ea7720dde63e2bb9528f836ac55e75daae04950f6732307d773be9f0b4c3f9"}
Jul 10 12:46:25.072025 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:25.071849    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:25.072233 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:25.072218    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:25.072304 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:25.072289    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:26.077152 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:26.076951    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerStarted","Data":"6a842664cc582f256d0784cadb8af8c4b08515202c80c0bf4ea26fcf0dfc92a2"}
Jul 10 12:46:26.151209 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:26.151185    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:26.151321 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.151276    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:26.756628 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:26.756595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:26.756777 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:26.756642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:26.756777 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.756734    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:46:26.756777 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.756735    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 10 12:46:26.756903 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.756785    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs podName:d433eb93-bab1-465f-b6e5-d849aa342f28 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:58.756764293 +0000 UTC m=+66.274684538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs") pod "network-metrics-daemon-z7qjm" (UID: "d433eb93-bab1-465f-b6e5-d849aa342f28") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 10 12:46:26.756903 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.756814    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret podName:0b926a5b-58aa-4b93-bec4-f0728adbdd7f nodeName:}" failed. No retries permitted until 2026-07-10 12:46:58.75679123 +0000 UTC m=+66.274711474 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret") pod "global-pull-secret-syncer-k7rxk" (UID: "0b926a5b-58aa-4b93-bec4-f0728adbdd7f") : object "kube-system"/"original-pull-secret" not registered
Jul 10 12:46:26.856993 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:26.856967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:26.857137 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.857079    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 10 12:46:26.857137 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.857091    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 10 12:46:26.857137 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.857099    2577 projected.go:196] Error preparing data for projected volume kube-api-access-9ntt7 for pod openshift-network-diagnostics/network-check-target-kbrxg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:46:26.857236 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:26.857144    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7 podName:34caebbf-a685-40e4-8570-d58689210d46 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:58.857129726 +0000 UTC m=+66.375049971 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9ntt7" (UniqueName: "kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7") pod "network-check-target-kbrxg" (UID: "34caebbf-a685-40e4-8570-d58689210d46") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 10 12:46:27.080795 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:27.080719    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6510c54-bb9d-41b4-b3b2-03503728255f" containerID="6a842664cc582f256d0784cadb8af8c4b08515202c80c0bf4ea26fcf0dfc92a2" exitCode=0
Jul 10 12:46:27.080795 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:27.080777    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerDied","Data":"6a842664cc582f256d0784cadb8af8c4b08515202c80c0bf4ea26fcf0dfc92a2"}
Jul 10 12:46:27.150893 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:27.150866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:27.151000 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:27.150975    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kbrxg" podUID="34caebbf-a685-40e4-8570-d58689210d46"
Jul 10 12:46:27.151056 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:27.151023    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:27.151124 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:27.151108    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k7rxk" podUID="0b926a5b-58aa-4b93-bec4-f0728adbdd7f"
Jul 10 12:46:27.323755 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:27.323726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:27.425295 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:27.425264    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:27.879389 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:27.879313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:27.944057 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:27.944022    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:28.151368 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.151295    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:28.151783 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:28.151419    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z7qjm" podUID="d433eb93-bab1-465f-b6e5-d849aa342f28"
Jul 10 12:46:28.342910 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.342864    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:28.407012 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.406928    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:28.721496 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.721471    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-90.ec2.internal" event="NodeReady"
Jul 10 12:46:28.721674 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.721623    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 10 12:46:28.775352 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.775146    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m8qvp"]
Jul 10 12:46:28.778883 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.778863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.781623 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.781601    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 10 12:46:28.781623 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.781613    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qfssw\""
Jul 10 12:46:28.781788 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.781633    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 10 12:46:28.781788 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.781654    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8tb5d"]
Jul 10 12:46:28.785673 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.785656    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8tb5d"
Jul 10 12:46:28.788064 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.788043    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8qvp"]
Jul 10 12:46:28.788161 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.788084    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 10 12:46:28.788671 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.788652    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 10 12:46:28.788765 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.788712    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 10 12:46:28.788994 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.788974    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8vh7j\""
Jul 10 12:46:28.793340 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.793320    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8tb5d"]
Jul 10 12:46:28.870940 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.870913    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a89af1cd-d7aa-4849-82a5-b0917e58f819-cert\") pod \"ingress-canary-8tb5d\" (UID: \"a89af1cd-d7aa-4849-82a5-b0917e58f819\") " pod="openshift-ingress-canary/ingress-canary-8tb5d"
Jul 10 12:46:28.871114 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.870963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkzg8\" (UniqueName: \"kubernetes.io/projected/a89af1cd-d7aa-4849-82a5-b0917e58f819-kube-api-access-hkzg8\") pod \"ingress-canary-8tb5d\" (UID: \"a89af1cd-d7aa-4849-82a5-b0917e58f819\") " pod="openshift-ingress-canary/ingress-canary-8tb5d"
Jul 10 12:46:28.871114 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.870994    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9643749b-477e-4002-9e90-589c3afb740c-config-volume\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.871114 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.871025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ptvp\" (UniqueName: \"kubernetes.io/projected/9643749b-477e-4002-9e90-589c3afb740c-kube-api-access-6ptvp\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.871114 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.871057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.871266 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.871118    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9643749b-477e-4002-9e90-589c3afb740c-tmp-dir\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.888525 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.888483    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:28.958831 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.958787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:28.971674 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.971606    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a89af1cd-d7aa-4849-82a5-b0917e58f819-cert\") pod \"ingress-canary-8tb5d\" (UID: \"a89af1cd-d7aa-4849-82a5-b0917e58f819\") " pod="openshift-ingress-canary/ingress-canary-8tb5d"
Jul 10 12:46:28.971674 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.971651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkzg8\" (UniqueName: \"kubernetes.io/projected/a89af1cd-d7aa-4849-82a5-b0917e58f819-kube-api-access-hkzg8\") pod \"ingress-canary-8tb5d\" (UID: \"a89af1cd-d7aa-4849-82a5-b0917e58f819\") " pod="openshift-ingress-canary/ingress-canary-8tb5d"
Jul 10 12:46:28.971878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.971680    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9643749b-477e-4002-9e90-589c3afb740c-config-volume\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.971878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.971718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ptvp\" (UniqueName: \"kubernetes.io/projected/9643749b-477e-4002-9e90-589c3afb740c-kube-api-access-6ptvp\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.971878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.971741    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.971878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.971763    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9643749b-477e-4002-9e90-589c3afb740c-tmp-dir\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.972058 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:28.972029    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 12:46:28.972115 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.972096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9643749b-477e-4002-9e90-589c3afb740c-tmp-dir\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.972160 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:28.972103    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls podName:9643749b-477e-4002-9e90-589c3afb740c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:29.472081956 +0000 UTC m=+36.990002204 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls") pod "dns-default-m8qvp" (UID: "9643749b-477e-4002-9e90-589c3afb740c") : secret "dns-default-metrics-tls" not found
Jul 10 12:46:28.972460 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.972432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9643749b-477e-4002-9e90-589c3afb740c-config-volume\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.976604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.976583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a89af1cd-d7aa-4849-82a5-b0917e58f819-cert\") pod \"ingress-canary-8tb5d\" (UID: \"a89af1cd-d7aa-4849-82a5-b0917e58f819\") " pod="openshift-ingress-canary/ingress-canary-8tb5d"
Jul 10 12:46:28.983118 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.983086    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ptvp\" (UniqueName: \"kubernetes.io/projected/9643749b-477e-4002-9e90-589c3afb740c-kube-api-access-6ptvp\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:28.983251 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:28.983230    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkzg8\" (UniqueName: \"kubernetes.io/projected/a89af1cd-d7aa-4849-82a5-b0917e58f819-kube-api-access-hkzg8\") pod \"ingress-canary-8tb5d\" (UID: \"a89af1cd-d7aa-4849-82a5-b0917e58f819\") " pod="openshift-ingress-canary/ingress-canary-8tb5d"
Jul 10 12:46:29.098821 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.098774    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8tb5d"
Jul 10 12:46:29.151125 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.151093    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:29.151287 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.151103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:29.154414 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.154153    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 12:46:29.154414 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.154247    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 12:46:29.154957 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.154720    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-99bwq\""
Jul 10 12:46:29.155044 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.155006    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 12:46:29.248577 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.248509    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8tb5d"]
Jul 10 12:46:29.253407 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:46:29.253368    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89af1cd_d7aa_4849_82a5_b0917e58f819.slice/crio-6986bea4fbb268b913eaa9197a28c7b18e21680be0185e86c2ed8d9567240bf1 WatchSource:0}: Error finding container 6986bea4fbb268b913eaa9197a28c7b18e21680be0185e86c2ed8d9567240bf1: Status 404 returned error can't find the container with id 6986bea4fbb268b913eaa9197a28c7b18e21680be0185e86c2ed8d9567240bf1
Jul 10 12:46:29.480704 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:29.480591    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:29.480865 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:29.480748    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 12:46:29.480865 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:29.480836    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls podName:9643749b-477e-4002-9e90-589c3afb740c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:30.480819701 +0000 UTC m=+37.998739947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls") pod "dns-default-m8qvp" (UID: "9643749b-477e-4002-9e90-589c3afb740c") : secret "dns-default-metrics-tls" not found
Jul 10 12:46:30.089505 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:30.089300    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8tb5d" event={"ID":"a89af1cd-d7aa-4849-82a5-b0917e58f819","Type":"ContainerStarted","Data":"6986bea4fbb268b913eaa9197a28c7b18e21680be0185e86c2ed8d9567240bf1"}
Jul 10 12:46:30.151747 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:30.151716    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:30.154376 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:30.154331    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pmvx9\""
Jul 10 12:46:30.154376 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:30.154360    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 12:46:30.488112 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:30.488080    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:30.488255 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:30.488238    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 12:46:30.488324 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:30.488311    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls podName:9643749b-477e-4002-9e90-589c3afb740c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:32.488292009 +0000 UTC m=+40.006212255 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls") pod "dns-default-m8qvp" (UID: "9643749b-477e-4002-9e90-589c3afb740c") : secret "dns-default-metrics-tls" not found
Jul 10 12:46:32.097980 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:32.097945    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6510c54-bb9d-41b4-b3b2-03503728255f" containerID="0e800aeb5c2a76dae2694fbea73815f274b1aef5615dfb985fec52d737e9f031" exitCode=0
Jul 10 12:46:32.098375 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:32.098003    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerDied","Data":"0e800aeb5c2a76dae2694fbea73815f274b1aef5615dfb985fec52d737e9f031"}
Jul 10 12:46:32.503006 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:32.502972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:32.503171 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:32.503108    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 12:46:32.503171 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:32.503165    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls podName:9643749b-477e-4002-9e90-589c3afb740c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:36.503149722 +0000 UTC m=+44.021069982 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls") pod "dns-default-m8qvp" (UID: "9643749b-477e-4002-9e90-589c3afb740c") : secret "dns-default-metrics-tls" not found
Jul 10 12:46:33.102271 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:33.102230    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8tb5d" event={"ID":"a89af1cd-d7aa-4849-82a5-b0917e58f819","Type":"ContainerStarted","Data":"b7cb22bc74857cc42296131309125a8650d06735f405c438e7acfb099790ad8e"}
Jul 10 12:46:33.105542 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:33.105513    2577 generic.go:356] "Generic (PLEG): container finished" podID="f6510c54-bb9d-41b4-b3b2-03503728255f" containerID="a48adde68b6de74f1f6240604459e535a68804549f00fa0ca5add96413f04df8" exitCode=0
Jul 10 12:46:33.105655 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:33.105566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerDied","Data":"a48adde68b6de74f1f6240604459e535a68804549f00fa0ca5add96413f04df8"}
Jul 10 12:46:33.142814 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:33.142550    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8tb5d" podStartSLOduration=1.422090039 podStartE2EDuration="5.142524462s" totalImagesPullingTime="3.720434423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:33.118189489 +0000 UTC m=+40.636109757" watchObservedRunningTime="2026-07-10 12:46:33.142524462 +0000 UTC m=+40.660444761"
Jul 10 12:46:33.450197 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:33.450168    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:34.111013 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:34.110975    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l96bp" event={"ID":"f6510c54-bb9d-41b4-b3b2-03503728255f","Type":"ContainerStarted","Data":"98fa1a24a127aa21d5488e2c022903a7660fdd1ed14373af039d93e87deb6ea4"}
Jul 10 12:46:34.134537 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:34.134483    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l96bp" podStartSLOduration=10.155599768 podStartE2EDuration="41.134469384s" totalImagesPullingTime="30.978869616s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:46:34.132455522 +0000 UTC m=+41.650375788" watchObservedRunningTime="2026-07-10 12:46:34.134469384 +0000 UTC m=+41.652389650"
Jul 10 12:46:34.374385 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:34.374309    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:34.446212 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:34.446160    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:35.577009 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:35.576978    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:35.677114 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:35.677079    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:36.530178 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:36.530141    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:36.530338 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:36.530270    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 12:46:36.530338 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:36.530321    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls podName:9643749b-477e-4002-9e90-589c3afb740c nodeName:}" failed. No retries permitted until 2026-07-10 12:46:44.530307013 +0000 UTC m=+52.048227258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls") pod "dns-default-m8qvp" (UID: "9643749b-477e-4002-9e90-589c3afb740c") : secret "dns-default-metrics-tls" not found
Jul 10 12:46:36.540816 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:36.540780    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:36.640145 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:36.640119    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:39.487980 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:39.487948    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:44.580413 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:44.580375    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:46:44.580785 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:44.580531    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 12:46:44.580785 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:44.580620    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls podName:9643749b-477e-4002-9e90-589c3afb740c nodeName:}" failed. No retries permitted until 2026-07-10 12:47:00.580605693 +0000 UTC m=+68.098525937 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls") pod "dns-default-m8qvp" (UID: "9643749b-477e-4002-9e90-589c3afb740c") : secret "dns-default-metrics-tls" not found
Jul 10 12:46:49.243163 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:49.243123    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:49.319146 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:49.319118    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:49.889084 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:49.889044    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:49.989008 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:49.988980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:53.630122 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:53.630086    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:53.686858 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:53.686825    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:55.146146 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.146114    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"]
Jul 10 12:46:55.175698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.175673    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.178476 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.178451    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 10 12:46:55.178618 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.178495    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 10 12:46:55.178618 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.178573    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gthq9\""
Jul 10 12:46:55.178969 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.178949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"]
Jul 10 12:46:55.179527 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.179511    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 10 12:46:55.181027 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.180965    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 10 12:46:55.252595 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.252570    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzg62\" (UniqueName: \"kubernetes.io/projected/92aea24c-593a-4d02-b2bc-da3cf03686a5-kube-api-access-hzg62\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.252694 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.252604    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92aea24c-593a-4d02-b2bc-da3cf03686a5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.252694 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.252649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.269956 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.269924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:55.324334 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.324308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:55.353441 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.353419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92aea24c-593a-4d02-b2bc-da3cf03686a5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.353535 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.353480    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.353606 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:55.353589    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 12:46:55.353776 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.353640    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzg62\" (UniqueName: \"kubernetes.io/projected/92aea24c-593a-4d02-b2bc-da3cf03686a5-kube-api-access-hzg62\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.353776 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:55.353649    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls podName:92aea24c-593a-4d02-b2bc-da3cf03686a5 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:55.853633748 +0000 UTC m=+63.371553994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9qxrz" (UID: "92aea24c-593a-4d02-b2bc-da3cf03686a5") : secret "cluster-monitoring-operator-tls" not found
Jul 10 12:46:55.354088 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.354071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/92aea24c-593a-4d02-b2bc-da3cf03686a5-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.363781 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.363763    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzg62\" (UniqueName: \"kubernetes.io/projected/92aea24c-593a-4d02-b2bc-da3cf03686a5-kube-api-access-hzg62\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.857544 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:55.857496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:55.857725 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:55.857618    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 12:46:55.857725 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:55.857680    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls podName:92aea24c-593a-4d02-b2bc-da3cf03686a5 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:56.857665466 +0000 UTC m=+64.375585716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9qxrz" (UID: "92aea24c-593a-4d02-b2bc-da3cf03686a5") : secret "cluster-monitoring-operator-tls" not found
Jul 10 12:46:56.087312 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:56.087283    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-phvmp"
Jul 10 12:46:56.240367 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:56.240334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:56.304988 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:56.304957    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:56.864476 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:56.864440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:56.864673 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:56.864579    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 12:46:56.864673 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:56.864643    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls podName:92aea24c-593a-4d02-b2bc-da3cf03686a5 nodeName:}" failed. No retries permitted until 2026-07-10 12:46:58.864627601 +0000 UTC m=+66.382547846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9qxrz" (UID: "92aea24c-593a-4d02-b2bc-da3cf03686a5") : secret "cluster-monitoring-operator-tls" not found
Jul 10 12:46:58.776653 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.776609    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:46:58.776653 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.776664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:58.779360 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.779339    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 10 12:46:58.779509 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.779492    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 10 12:46:58.787581 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:58.787562    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 10 12:46:58.787674 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:58.787638    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs podName:d433eb93-bab1-465f-b6e5-d849aa342f28 nodeName:}" failed. No retries permitted until 2026-07-10 12:48:02.787616433 +0000 UTC m=+130.305536692 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs") pod "network-metrics-daemon-z7qjm" (UID: "d433eb93-bab1-465f-b6e5-d849aa342f28") : secret "metrics-daemon-secret" not found
Jul 10 12:46:58.789652 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.789636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b926a5b-58aa-4b93-bec4-f0728adbdd7f-original-pull-secret\") pod \"global-pull-secret-syncer-k7rxk\" (UID: \"0b926a5b-58aa-4b93-bec4-f0728adbdd7f\") " pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:58.863380 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.863340    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k7rxk"
Jul 10 12:46:58.877540 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.877516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:58.877653 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.877582    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:46:58.877752 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:58.877733    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 12:46:58.877851 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:58.877796    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls podName:92aea24c-593a-4d02-b2bc-da3cf03686a5 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:02.87777715 +0000 UTC m=+70.395697411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9qxrz" (UID: "92aea24c-593a-4d02-b2bc-da3cf03686a5") : secret "cluster-monitoring-operator-tls" not found
Jul 10 12:46:58.880717 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.880701    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 10 12:46:58.891136 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.891115    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 10 12:46:58.902310 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.902290    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ntt7\" (UniqueName: \"kubernetes.io/projected/34caebbf-a685-40e4-8570-d58689210d46-kube-api-access-9ntt7\") pod \"network-check-target-kbrxg\" (UID: \"34caebbf-a685-40e4-8570-d58689210d46\") " pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:58.981957 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:58.981928    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k7rxk"]
Jul 10 12:46:58.985059 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:46:58.985034    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b926a5b_58aa_4b93_bec4_f0728adbdd7f.slice/crio-53099615409b68adb9d7f21535b14ebb728803121886ac3a8a641cdc83ed13d8 WatchSource:0}: Error finding container 53099615409b68adb9d7f21535b14ebb728803121886ac3a8a641cdc83ed13d8: Status 404 returned error can't find the container with id 53099615409b68adb9d7f21535b14ebb728803121886ac3a8a641cdc83ed13d8
Jul 10 12:46:59.171765 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.171682    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k7rxk" event={"ID":"0b926a5b-58aa-4b93-bec4-f0728adbdd7f","Type":"ContainerStarted","Data":"53099615409b68adb9d7f21535b14ebb728803121886ac3a8a641cdc83ed13d8"}
Jul 10 12:46:59.177338 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.177323    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-99bwq\""
Jul 10 12:46:59.185296 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.185277    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:46:59.317076 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.317046    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kbrxg"]
Jul 10 12:46:59.319730 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:46:59.319707    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34caebbf_a685_40e4_8570_d58689210d46.slice/crio-b2f3e08b439cf102b14bcba420aaea347a45bd41b55178a2a7d2b27c8e1e19be WatchSource:0}: Error finding container b2f3e08b439cf102b14bcba420aaea347a45bd41b55178a2a7d2b27c8e1e19be: Status 404 returned error can't find the container with id b2f3e08b439cf102b14bcba420aaea347a45bd41b55178a2a7d2b27c8e1e19be
Jul 10 12:46:59.593984 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.593950    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-44mnv"]
Jul 10 12:46:59.596782 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.596759    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.599498 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.599313    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 10 12:46:59.599498 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.599334    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cc7d5\""
Jul 10 12:46:59.599498 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.599379    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 10 12:46:59.600481 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.600460    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 10 12:46:59.600557 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.600549    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 10 12:46:59.607172 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.607151    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44mnv"]
Jul 10 12:46:59.620095 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.620076    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:59.675268 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.675216    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:46:59.684026 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.684005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kncw\" (UniqueName: \"kubernetes.io/projected/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-api-access-2kncw\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.684122 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.684084    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e070fe7-3e7c-479f-aa6e-0015db407326-crio-socket\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.684221 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.684203    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e070fe7-3e7c-479f-aa6e-0015db407326-data-volume\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.684275 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.684238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.684316 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.684296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.785103 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.785067    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.785127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kncw\" (UniqueName: \"kubernetes.io/projected/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-api-access-2kncw\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.785157    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e070fe7-3e7c-479f-aa6e-0015db407326-crio-socket\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:59.785207    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.785237    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e070fe7-3e7c-479f-aa6e-0015db407326-data-volume\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.785263    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:59.785291    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:00.285272484 +0000 UTC m=+67.803192758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : configmap "kube-rbac-proxy" not found
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.785306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e070fe7-3e7c-479f-aa6e-0015db407326-crio-socket\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:59.785353    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 12:46:59.785525 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:46:59.785398    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:00.285383948 +0000 UTC m=+67.803304198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : secret "insights-runtime-extractor-tls" not found
Jul 10 12:46:59.785852 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.785636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e070fe7-3e7c-479f-aa6e-0015db407326-data-volume\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:46:59.796166 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:46:59.796142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kncw\" (UniqueName: \"kubernetes.io/projected/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-api-access-2kncw\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:00.177622 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:00.177547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kbrxg" event={"ID":"34caebbf-a685-40e4-8570-d58689210d46","Type":"ContainerStarted","Data":"b2f3e08b439cf102b14bcba420aaea347a45bd41b55178a2a7d2b27c8e1e19be"}
Jul 10 12:47:00.289811 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:00.289673    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:00.289811 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:00.289737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:00.290084 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:00.289856    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 12:47:00.290084 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:00.289863    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:00.290084 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:00.289910    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:01.289896262 +0000 UTC m=+68.807816507 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : configmap "kube-rbac-proxy" not found
Jul 10 12:47:00.290084 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:00.289923    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:01.289917279 +0000 UTC m=+68.807837523 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:00.591730 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:00.591626    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:47:00.591916 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:00.591760    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 10 12:47:00.591916 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:00.591847    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls podName:9643749b-477e-4002-9e90-589c3afb740c nodeName:}" failed. No retries permitted until 2026-07-10 12:47:32.59182526 +0000 UTC m=+100.109745508 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls") pod "dns-default-m8qvp" (UID: "9643749b-477e-4002-9e90-589c3afb740c") : secret "dns-default-metrics-tls" not found
Jul 10 12:47:01.297272 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:01.297234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:01.297762 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:01.297304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:01.297762 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:01.297420    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 12:47:01.297762 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:01.297481    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:03.297462086 +0000 UTC m=+70.815382336 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : configmap "kube-rbac-proxy" not found
Jul 10 12:47:01.297986 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:01.297885    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:01.297986 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:01.297941    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:03.297924831 +0000 UTC m=+70.815845091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:01.564717 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:01.564645    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mdmm5_469f0fde-1dcd-4d2e-aee1-24a1a72c892f/dns-node-resolver/0.log"
Jul 10 12:47:02.164633 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:02.164602    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7ngx9_45fd9958-6924-45b1-8e9a-c1bb4067094f/node-ca/0.log"
Jul 10 12:47:02.911315 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:02.911274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:47:02.911738 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:02.911443    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 12:47:02.911738 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:02.911518    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls podName:92aea24c-593a-4d02-b2bc-da3cf03686a5 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:10.911497008 +0000 UTC m=+78.429417256 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9qxrz" (UID: "92aea24c-593a-4d02-b2bc-da3cf03686a5") : secret "cluster-monitoring-operator-tls" not found
Jul 10 12:47:02.964587 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:02.964561    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8tb5d_a89af1cd-d7aa-4849-82a5-b0917e58f819/serve-healthcheck-canary/0.log"
Jul 10 12:47:03.315636 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:03.315602    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:03.315840 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:03.315659    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:03.315840 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:03.315780    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:03.315840 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:03.315787    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 12:47:03.315979 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:03.315867    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:07.315849528 +0000 UTC m=+74.833769788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:03.315979 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:03.315884    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:07.315877535 +0000 UTC m=+74.833797779 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : configmap "kube-rbac-proxy" not found
Jul 10 12:47:04.189559 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:04.189519    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k7rxk" event={"ID":"0b926a5b-58aa-4b93-bec4-f0728adbdd7f","Type":"ContainerStarted","Data":"ad9bc8313ec57cbd6ea4ee5ec70bb62ae81cb6f56046a6f7f8cfe44ce218ee11"}
Jul 10 12:47:04.191010 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:04.190988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kbrxg" event={"ID":"34caebbf-a685-40e4-8570-d58689210d46","Type":"ContainerStarted","Data":"d1516239b67872d79537b5603baaf447b3aa582cec6703f0930e3ffb80c47789"}
Jul 10 12:47:04.191122 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:04.191112    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:47:04.203716 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:04.203632    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k7rxk" podStartSLOduration=66.242065578 podStartE2EDuration="1m11.203619393s" totalImagesPullingTime="4.961553815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:04.203032045 +0000 UTC m=+71.720952312" watchObservedRunningTime="2026-07-10 12:47:04.203619393 +0000 UTC m=+71.721539659"
Jul 10 12:47:04.225774 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:04.225735    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kbrxg" podStartSLOduration=66.602366564 podStartE2EDuration="1m11.225724435s" totalImagesPullingTime="4.623357871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:04.225211214 +0000 UTC m=+71.743131481" watchObservedRunningTime="2026-07-10 12:47:04.225724435 +0000 UTC m=+71.743644679"
Jul 10 12:47:05.163482 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.163439    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv"]
Jul 10 12:47:05.166338 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.166320    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv"
Jul 10 12:47:05.168836 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.168794    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7qh2j\""
Jul 10 12:47:05.168956 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.168794    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 10 12:47:05.169965 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.169946    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 10 12:47:05.177451 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.177425    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv"]
Jul 10 12:47:05.228361 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.228330    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmr2x\" (UniqueName: \"kubernetes.io/projected/ec3569b1-bfbe-4cb1-823e-6b468c59632e-kube-api-access-nmr2x\") pod \"volume-data-source-validator-78495597f6-h7rjv\" (UID: \"ec3569b1-bfbe-4cb1-823e-6b468c59632e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv"
Jul 10 12:47:05.328903 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.328855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmr2x\" (UniqueName: \"kubernetes.io/projected/ec3569b1-bfbe-4cb1-823e-6b468c59632e-kube-api-access-nmr2x\") pod \"volume-data-source-validator-78495597f6-h7rjv\" (UID: \"ec3569b1-bfbe-4cb1-823e-6b468c59632e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv"
Jul 10 12:47:05.337639 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.337610    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmr2x\" (UniqueName: \"kubernetes.io/projected/ec3569b1-bfbe-4cb1-823e-6b468c59632e-kube-api-access-nmr2x\") pod \"volume-data-source-validator-78495597f6-h7rjv\" (UID: \"ec3569b1-bfbe-4cb1-823e-6b468c59632e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv"
Jul 10 12:47:05.475118 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.475092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv"
Jul 10 12:47:05.590600 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:05.590570    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv"]
Jul 10 12:47:05.593597 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:05.593558    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3569b1_bfbe_4cb1_823e_6b468c59632e.slice/crio-44ac948f4852f77d60bafedde89f2752a0d463de8bfdfdbec645cef7c8705c14 WatchSource:0}: Error finding container 44ac948f4852f77d60bafedde89f2752a0d463de8bfdfdbec645cef7c8705c14: Status 404 returned error can't find the container with id 44ac948f4852f77d60bafedde89f2752a0d463de8bfdfdbec645cef7c8705c14
Jul 10 12:47:06.196624 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:06.196586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv" event={"ID":"ec3569b1-bfbe-4cb1-823e-6b468c59632e","Type":"ContainerStarted","Data":"44ac948f4852f77d60bafedde89f2752a0d463de8bfdfdbec645cef7c8705c14"}
Jul 10 12:47:07.200100 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:07.200066    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv" event={"ID":"ec3569b1-bfbe-4cb1-823e-6b468c59632e","Type":"ContainerStarted","Data":"ad0ec1938301bf869ea7280970cbdca785bc52212de4d8a09381d03f028460fe"}
Jul 10 12:47:07.217067 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:07.216923    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-h7rjv" podStartSLOduration=0.999871925 podStartE2EDuration="2.21690616s" totalImagesPullingTime="1.217034235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:07.21663237 +0000 UTC m=+74.734552638" watchObservedRunningTime="2026-07-10 12:47:07.21690616 +0000 UTC m=+74.734826422"
Jul 10 12:47:07.292512 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:07.292480    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:07.344753 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:07.344730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:07.344856 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:07.344769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:07.344912 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:07.344897    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 10 12:47:07.344964 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:07.344955    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:15.344941146 +0000 UTC m=+82.862861391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : configmap "kube-rbac-proxy" not found
Jul 10 12:47:07.345005 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:07.344897    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:07.345036 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:07.345030    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:15.345018278 +0000 UTC m=+82.862938528 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:07.393980 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:07.393924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:09.200390 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.200361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:09.219453 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.219431    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr"]
Jul 10 12:47:09.222431 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.222416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr"
Jul 10 12:47:09.225211 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.225190    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 10 12:47:09.225473 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.225458    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 10 12:47:09.226369 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.226351    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2vp2s\""
Jul 10 12:47:09.231970 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.231949    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr"]
Jul 10 12:47:09.256977 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.256955    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-958mb\" (UniqueName: \"kubernetes.io/projected/d55714b6-b762-4a5f-b5e1-cd28150a65fe-kube-api-access-958mb\") pod \"migrator-7f59b54f6c-27gkr\" (UID: \"d55714b6-b762-4a5f-b5e1-cd28150a65fe\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr"
Jul 10 12:47:09.306030 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.306003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:09.357710 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.357687    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-958mb\" (UniqueName: \"kubernetes.io/projected/d55714b6-b762-4a5f-b5e1-cd28150a65fe-kube-api-access-958mb\") pod \"migrator-7f59b54f6c-27gkr\" (UID: \"d55714b6-b762-4a5f-b5e1-cd28150a65fe\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr"
Jul 10 12:47:09.367143 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.367121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-958mb\" (UniqueName: \"kubernetes.io/projected/d55714b6-b762-4a5f-b5e1-cd28150a65fe-kube-api-access-958mb\") pod \"migrator-7f59b54f6c-27gkr\" (UID: \"d55714b6-b762-4a5f-b5e1-cd28150a65fe\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr"
Jul 10 12:47:09.407473 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.407445    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:09.531415 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.531362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr"
Jul 10 12:47:09.651261 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:09.651233    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr"]
Jul 10 12:47:09.653922 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:09.653881    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd55714b6_b762_4a5f_b5e1_cd28150a65fe.slice/crio-50707c1bae959eaa4f3acb9eae489548c36ae7719dd48f2212c2b5d269db0481 WatchSource:0}: Error finding container 50707c1bae959eaa4f3acb9eae489548c36ae7719dd48f2212c2b5d269db0481: Status 404 returned error can't find the container with id 50707c1bae959eaa4f3acb9eae489548c36ae7719dd48f2212c2b5d269db0481
Jul 10 12:47:10.155248 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:10.155190    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:10.209005 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:10.208968    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr" event={"ID":"d55714b6-b762-4a5f-b5e1-cd28150a65fe","Type":"ContainerStarted","Data":"50707c1bae959eaa4f3acb9eae489548c36ae7719dd48f2212c2b5d269db0481"}
Jul 10 12:47:10.255527 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:10.255498    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:10.596971 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:10.596936    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:10.649889 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:10.649854    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:10.879424 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:10.879394    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:10.969713 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:10.969691    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:47:10.969825 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:10.969816    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 10 12:47:10.969877 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:10.969865    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls podName:92aea24c-593a-4d02-b2bc-da3cf03686a5 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:26.969852211 +0000 UTC m=+94.487772455 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9qxrz" (UID: "92aea24c-593a-4d02-b2bc-da3cf03686a5") : secret "cluster-monitoring-operator-tls" not found
Jul 10 12:47:10.981931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:10.981904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:11.212962 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:11.212932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr" event={"ID":"d55714b6-b762-4a5f-b5e1-cd28150a65fe","Type":"ContainerStarted","Data":"afdb58b83b1c2d36db5dab0a090b7b6af3105f9c06eac16740321d341a0469c6"}
Jul 10 12:47:11.213300 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:11.212978    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr" event={"ID":"d55714b6-b762-4a5f-b5e1-cd28150a65fe","Type":"ContainerStarted","Data":"02be9c6e94a19ac4942516a01e249315fcff41c33e1163e0f9f3669ed7a242a2"}
Jul 10 12:47:11.234177 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:11.234128    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-27gkr" podStartSLOduration=1.028137842 podStartE2EDuration="2.234112514s" totalImagesPullingTime="1.205974672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:11.229027027 +0000 UTC m=+78.746947295" watchObservedRunningTime="2026-07-10 12:47:11.234112514 +0000 UTC m=+78.752032780"
Jul 10 12:47:11.307137 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:11.307111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:12.461623 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.461596    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-22drs"]
Jul 10 12:47:12.464597 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.464582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.467221 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.467201    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 10 12:47:12.467364 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.467346    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 10 12:47:12.467432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.467366    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 10 12:47:12.467432 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.467393    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 10 12:47:12.468496 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.468481    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xsk9n\""
Jul 10 12:47:12.475348 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.475326    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-22drs"]
Jul 10 12:47:12.496459 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.496433    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:12.554811 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.554776    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:12.580869 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.580847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00786901-6e7c-4269-aa2a-77aee9d55c59-signing-cabundle\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.580926 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.580902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvsxg\" (UniqueName: \"kubernetes.io/projected/00786901-6e7c-4269-aa2a-77aee9d55c59-kube-api-access-pvsxg\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.580966 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.580944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00786901-6e7c-4269-aa2a-77aee9d55c59-signing-key\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.682031 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.682004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00786901-6e7c-4269-aa2a-77aee9d55c59-signing-cabundle\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.682089 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.682062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvsxg\" (UniqueName: \"kubernetes.io/projected/00786901-6e7c-4269-aa2a-77aee9d55c59-kube-api-access-pvsxg\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.682130 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.682097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00786901-6e7c-4269-aa2a-77aee9d55c59-signing-key\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.682642 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.682615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/00786901-6e7c-4269-aa2a-77aee9d55c59-signing-cabundle\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.684361 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.684345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/00786901-6e7c-4269-aa2a-77aee9d55c59-signing-key\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.689902 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.689881    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvsxg\" (UniqueName: \"kubernetes.io/projected/00786901-6e7c-4269-aa2a-77aee9d55c59-kube-api-access-pvsxg\") pod \"service-ca-79f68b9f4f-22drs\" (UID: \"00786901-6e7c-4269-aa2a-77aee9d55c59\") " pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.748668 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.748611    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:12.773553 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.773532    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-22drs"
Jul 10 12:47:12.889163 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:12.889138    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-22drs"]
Jul 10 12:47:12.892093 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:12.892068    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00786901_6e7c_4269_aa2a_77aee9d55c59.slice/crio-94917bcc28154df7cc5eccb547b246c64f5a8b6f680284b3d1fceef4a6cf82b7 WatchSource:0}: Error finding container 94917bcc28154df7cc5eccb547b246c64f5a8b6f680284b3d1fceef4a6cf82b7: Status 404 returned error can't find the container with id 94917bcc28154df7cc5eccb547b246c64f5a8b6f680284b3d1fceef4a6cf82b7
Jul 10 12:47:13.219540 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:13.219508    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-22drs" event={"ID":"00786901-6e7c-4269-aa2a-77aee9d55c59","Type":"ContainerStarted","Data":"94917bcc28154df7cc5eccb547b246c64f5a8b6f680284b3d1fceef4a6cf82b7"}
Jul 10 12:47:13.341025 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:13.340997    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:15.227602 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:15.227567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-22drs" event={"ID":"00786901-6e7c-4269-aa2a-77aee9d55c59","Type":"ContainerStarted","Data":"3f981a6c7268f46db7bab660302f977c6a3fd7a72e1699d54db4c470f0ca6c22"}
Jul 10 12:47:15.244981 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:15.244935    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-22drs" podStartSLOduration=1.104299836 podStartE2EDuration="3.244920894s" totalImagesPullingTime="2.140621058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:15.244235101 +0000 UTC m=+82.762155367" watchObservedRunningTime="2026-07-10 12:47:15.244920894 +0000 UTC m=+82.762841161"
Jul 10 12:47:15.404628 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:15.404467    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:15.404628 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:15.404516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:15.404628 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:15.404606    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:15.404907 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:47:15.404714    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls podName:9e070fe7-3e7c-479f-aa6e-0015db407326 nodeName:}" failed. No retries permitted until 2026-07-10 12:47:31.404659984 +0000 UTC m=+98.922580244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-44mnv" (UID: "9e070fe7-3e7c-479f-aa6e-0015db407326") : secret "insights-runtime-extractor-tls" not found
Jul 10 12:47:15.405018 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:15.405001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e070fe7-3e7c-479f-aa6e-0015db407326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:16.092325 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:16.092286    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:16.299302 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:16.299262    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:16.429945 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:16.429859    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:16.641924 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:16.641868    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:16.803530 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:16.803449    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:16.871438 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:16.871396    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:17.101269 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:17.101167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:17.406841 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:17.406739    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:17.990465 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:17.990423    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:18.385336 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:18.385253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:18.789048 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:18.789016    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:19.195089 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:19.195044    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:19.586340 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:19.586254    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:19.785013 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:19.784980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:19.838971 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:19.838894    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:20.105871 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:20.105775    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:20.208075 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:20.208047    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:20.606027 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:20.605985    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:21.396640 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:21.396602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:21.795611 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:21.795585    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:21.979959 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:21.979928    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:22.030125 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:22.030097    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:22.195865 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:22.195837    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:22.305531 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:22.305500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:22.406904 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:22.406871    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:23.387512 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:23.387477    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:23.612002 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:23.611965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:23.988160 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:23.988129    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:24.188096 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:24.188057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:24.386931 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:24.386842    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:24.933387 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:24.933352    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:25.393133 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:25.393035    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:25.589677 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:25.589629    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:25.986630 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:25.986596    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:26.195143 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:26.195109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:26.396554 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:26.396457    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:26.792720 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:26.792671    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:26.985747 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:26.985716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:47:26.988028 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:26.987993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/92aea24c-593a-4d02-b2bc-da3cf03686a5-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9qxrz\" (UID: \"92aea24c-593a-4d02-b2bc-da3cf03686a5\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:47:27.284420 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:27.284394    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"
Jul 10 12:47:27.403633 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:27.403602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz"]
Jul 10 12:47:27.406509 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:27.406487    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92aea24c_593a_4d02_b2bc_da3cf03686a5.slice/crio-41ed5c42657caa6798bd3eacead5ee84ac3ee0b0479be647cb1a077b420d3f4a WatchSource:0}: Error finding container 41ed5c42657caa6798bd3eacead5ee84ac3ee0b0479be647cb1a077b420d3f4a: Status 404 returned error can't find the container with id 41ed5c42657caa6798bd3eacead5ee84ac3ee0b0479be647cb1a077b420d3f4a
Jul 10 12:47:28.264588 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:28.264547    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz" event={"ID":"92aea24c-593a-4d02-b2bc-da3cf03686a5","Type":"ContainerStarted","Data":"41ed5c42657caa6798bd3eacead5ee84ac3ee0b0479be647cb1a077b420d3f4a"}
Jul 10 12:47:29.991235 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:29.991159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:30.089078 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:30.089050    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:30.190311 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:30.190284    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:30.272296 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:30.272236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz" event={"ID":"92aea24c-593a-4d02-b2bc-da3cf03686a5","Type":"ContainerStarted","Data":"4a370149f50cef7c8838568af205025e45f17d29718e09cfdb7a9c9da7783c0d"}
Jul 10 12:47:30.290249 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:30.290205    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9qxrz" podStartSLOduration=33.016413359 podStartE2EDuration="35.290189402s" totalImagesPullingTime="2.273776043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:30.287903439 +0000 UTC m=+97.805823707" watchObservedRunningTime="2026-07-10 12:47:30.290189402 +0000 UTC m=+97.808109668"
Jul 10 12:47:30.510991 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:30.510959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:31.421743 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:31.421699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:31.423989 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:31.423968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e070fe7-3e7c-479f-aa6e-0015db407326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-44mnv\" (UID: \"9e070fe7-3e7c-479f-aa6e-0015db407326\") " pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:31.449855 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:31.449823    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:31.544684 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:31.544654    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:31.601627 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:31.601606    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:31.706885 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:31.706866    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-44mnv"
Jul 10 12:47:31.731966 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:31.731925    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:31.827732 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:31.827701    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-44mnv"]
Jul 10 12:47:31.830898 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:31.830866    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e070fe7_3e7c_479f_aa6e_0015db407326.slice/crio-0cb42a7bcd3981c73c90e8076e95a25ffb1ef6155e62c78468c0db3aded30166 WatchSource:0}: Error finding container 0cb42a7bcd3981c73c90e8076e95a25ffb1ef6155e62c78468c0db3aded30166: Status 404 returned error can't find the container with id 0cb42a7bcd3981c73c90e8076e95a25ffb1ef6155e62c78468c0db3aded30166
Jul 10 12:47:32.116940 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.116845    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:32.217529 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.217496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:32.278459 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.278433    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44mnv" event={"ID":"9e070fe7-3e7c-479f-aa6e-0015db407326","Type":"ContainerStarted","Data":"0cb42a7bcd3981c73c90e8076e95a25ffb1ef6155e62c78468c0db3aded30166"}
Jul 10 12:47:32.316893 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.316846    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:32.516058 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.516023    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:32.617307 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.617260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:32.631329 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.631296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:47:32.641455 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.641383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9643749b-477e-4002-9e90-589c3afb740c-metrics-tls\") pod \"dns-default-m8qvp\" (UID: \"9643749b-477e-4002-9e90-589c3afb740c\") " pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:47:32.693392 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.693205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qfssw\""
Jul 10 12:47:32.701637 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.701420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:47:32.866363 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.866238    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m8qvp"]
Jul 10 12:47:32.870756 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:32.870717    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9643749b_477e_4002_9e90_589c3afb740c.slice/crio-0ac931ca2365b08a1a7cb3228b34cf5028f3849339033effb3c531fe5ef7b5d0 WatchSource:0}: Error finding container 0ac931ca2365b08a1a7cb3228b34cf5028f3849339033effb3c531fe5ef7b5d0: Status 404 returned error can't find the container with id 0ac931ca2365b08a1a7cb3228b34cf5028f3849339033effb3c531fe5ef7b5d0
Jul 10 12:47:32.943450 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.943420    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb"]
Jul 10 12:47:32.946453 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.946429    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb"
Jul 10 12:47:32.949830 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.949778    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t88ln\""
Jul 10 12:47:32.959516 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.959489    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb"]
Jul 10 12:47:32.978125 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.977951    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"]
Jul 10 12:47:32.983366 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.982701    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:32.987697 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.987299    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 10 12:47:32.987697 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.987330    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 10 12:47:32.987697 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.987332    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 10 12:47:32.987697 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.987569    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 10 12:47:32.987697 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.987585    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 10 12:47:32.987697 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.987677    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 10 12:47:32.992066 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.992049    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 10 12:47:32.998844 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:32.998819    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"]
Jul 10 12:47:33.004292 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.004263    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:33.035310 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.035233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srvwt\" (UniqueName: \"kubernetes.io/projected/fc54d1a4-434b-44eb-9885-c8feef9305f1-kube-api-access-srvwt\") pod \"network-check-source-869dcfcdcd-w7kfb\" (UID: \"fc54d1a4-434b-44eb-9885-c8feef9305f1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb"
Jul 10 12:47:33.135749 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.135563    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-ca\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.135749 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.135629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.135749 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.135670    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.135749 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.135708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-hub\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.135749 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.135737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srvwt\" (UniqueName: \"kubernetes.io/projected/fc54d1a4-434b-44eb-9885-c8feef9305f1-kube-api-access-srvwt\") pod \"network-check-source-869dcfcdcd-w7kfb\" (UID: \"fc54d1a4-434b-44eb-9885-c8feef9305f1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb"
Jul 10 12:47:33.136135 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.135769    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.136135 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.135950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmp28\" (UniqueName: \"kubernetes.io/projected/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-kube-api-access-tmp28\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.154828 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.154722    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srvwt\" (UniqueName: \"kubernetes.io/projected/fc54d1a4-434b-44eb-9885-c8feef9305f1-kube-api-access-srvwt\") pod \"network-check-source-869dcfcdcd-w7kfb\" (UID: \"fc54d1a4-434b-44eb-9885-c8feef9305f1\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb"
Jul 10 12:47:33.154828 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.154735    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:33.236983 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.236947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.237150 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.237003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-hub\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.237150 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.237036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.237150 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.237066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmp28\" (UniqueName: \"kubernetes.io/projected/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-kube-api-access-tmp28\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.237150 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.237108    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-ca\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.237549 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.237521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.238155 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.238121    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.240549 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.240525    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-hub\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.240821 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.240771    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.240919 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.240826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-ca\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.241015 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.240993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.241825 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.241760    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:33.246142 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.246120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmp28\" (UniqueName: \"kubernetes.io/projected/67a9352a-c578-4a2d-8ba2-557b9ba10ae6-kube-api-access-tmp28\") pod \"cluster-proxy-proxy-agent-7bb57d76f6-hxp7q\" (UID: \"67a9352a-c578-4a2d-8ba2-557b9ba10ae6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.257757 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.257736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb"
Jul 10 12:47:33.283867 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.283835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8qvp" event={"ID":"9643749b-477e-4002-9e90-589c3afb740c","Type":"ContainerStarted","Data":"0ac931ca2365b08a1a7cb3228b34cf5028f3849339033effb3c531fe5ef7b5d0"}
Jul 10 12:47:33.305303 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.305228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"
Jul 10 12:47:33.415739 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.414730    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb"]
Jul 10 12:47:33.417354 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:33.417324    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc54d1a4_434b_44eb_9885_c8feef9305f1.slice/crio-8729240ea638f918ae7f9d661d7597177b3b2086d4d4095921616e64a390e950 WatchSource:0}: Error finding container 8729240ea638f918ae7f9d661d7597177b3b2086d4d4095921616e64a390e950: Status 404 returned error can't find the container with id 8729240ea638f918ae7f9d661d7597177b3b2086d4d4095921616e64a390e950
Jul 10 12:47:33.475066 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.475040    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q"]
Jul 10 12:47:33.478221 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:33.478192    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67a9352a_c578_4a2d_8ba2_557b9ba10ae6.slice/crio-432fdb807b173722c8682420ef48cd12be9d7a07d628662b0d43d27c39dedd11 WatchSource:0}: Error finding container 432fdb807b173722c8682420ef48cd12be9d7a07d628662b0d43d27c39dedd11: Status 404 returned error can't find the container with id 432fdb807b173722c8682420ef48cd12be9d7a07d628662b0d43d27c39dedd11
Jul 10 12:47:33.511284 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:33.511248    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:34.289166 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:34.289129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb" event={"ID":"fc54d1a4-434b-44eb-9885-c8feef9305f1","Type":"ContainerStarted","Data":"af226e4a829ab7bce9f2a0dd0b34ee24b0006d324e53908105d8d8b4920414a6"}
Jul 10 12:47:34.289628 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:34.289192    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb" event={"ID":"fc54d1a4-434b-44eb-9885-c8feef9305f1","Type":"ContainerStarted","Data":"8729240ea638f918ae7f9d661d7597177b3b2086d4d4095921616e64a390e950"}
Jul 10 12:47:34.290561 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:34.290533    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q" event={"ID":"67a9352a-c578-4a2d-8ba2-557b9ba10ae6","Type":"ContainerStarted","Data":"432fdb807b173722c8682420ef48cd12be9d7a07d628662b0d43d27c39dedd11"}
Jul 10 12:47:34.305497 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:34.305446    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-w7kfb" podStartSLOduration=2.3054290760000002 podStartE2EDuration="2.305429076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:34.304489818 +0000 UTC m=+101.822410082" watchObservedRunningTime="2026-07-10 12:47:34.305429076 +0000 UTC m=+101.823349379"
Jul 10 12:47:34.534074 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:34.534016    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:34.635306 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:34.635230    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:35.195624 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:35.195592    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kbrxg"
Jul 10 12:47:36.986181 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:36.986114    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:37.086624 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:37.086102    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:37.186698 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:37.186655    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:37.262519 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:37.262435    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:37.305596 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:37.305566    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8qvp" event={"ID":"9643749b-477e-4002-9e90-589c3afb740c","Type":"ContainerStarted","Data":"d5b24560df71f4763f5a3641a57fbefa77aef26e5aac51b359bc2250aa350514"}
Jul 10 12:47:37.640124 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:37.640050    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:39.314273 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:39.314209    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q" event={"ID":"67a9352a-c578-4a2d-8ba2-557b9ba10ae6","Type":"ContainerStarted","Data":"3180bb1d3a07e0f9c33aa48606d46e377f85aee4839936822313f66d0f2654c7"}
Jul 10 12:47:39.314273 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:39.314257    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q" event={"ID":"67a9352a-c578-4a2d-8ba2-557b9ba10ae6","Type":"ContainerStarted","Data":"942c0e97fcf6a05148f4252c58e0c0b4f306d126e5e4b2310b993a60bc3f9c7e"}
Jul 10 12:47:39.314708 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:39.314279    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q" event={"ID":"67a9352a-c578-4a2d-8ba2-557b9ba10ae6","Type":"ContainerStarted","Data":"cf2f148ab5b2f5a9e88619c5a250cbca2d60f5d1049395940a989de604c76d04"}
Jul 10 12:47:39.316075 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:39.316016    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m8qvp" event={"ID":"9643749b-477e-4002-9e90-589c3afb740c","Type":"ContainerStarted","Data":"7982d7aef627431efd7a7e8c6c41b7d06d06b9f2d5f5e05d090199516c7f794c"}
Jul 10 12:47:39.316391 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:39.316355    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:47:39.317779 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:39.317759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44mnv" event={"ID":"9e070fe7-3e7c-479f-aa6e-0015db407326","Type":"ContainerStarted","Data":"5aea3eb07b9830fd75e3c02eaec57aff7cbb54d8f650feff47aac683b5bfc436"}
Jul 10 12:47:39.334478 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:39.334424    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7bb57d76f6-hxp7q" podStartSLOduration=1.690305387 podStartE2EDuration="7.334407849s" totalImagesPullingTime="5.644102462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:39.333948068 +0000 UTC m=+106.851868337" watchObservedRunningTime="2026-07-10 12:47:39.334407849 +0000 UTC m=+106.852328118"
Jul 10 12:47:39.354209 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:39.354170    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m8qvp" podStartSLOduration=67.277065936 podStartE2EDuration="1m11.35415762s" totalImagesPullingTime="4.077091684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:46:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:39.353411062 +0000 UTC m=+106.871331344" watchObservedRunningTime="2026-07-10 12:47:39.35415762 +0000 UTC m=+106.872077887"
Jul 10 12:47:40.323103 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:40.323064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44mnv" event={"ID":"9e070fe7-3e7c-479f-aa6e-0015db407326","Type":"ContainerStarted","Data":"b98397b1820a03a531a7433ff383f7ea8cad253e805104a91ad5db938f53021b"}
Jul 10 12:47:42.417282 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:42.417245    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:43.335073 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:43.335034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:43.340430 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:43.340401    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-44mnv" event={"ID":"9e070fe7-3e7c-479f-aa6e-0015db407326","Type":"ContainerStarted","Data":"e06af9d8e97432fda8884b03e0bdee0c59b26d12b72ef08572be039041c0647c"}
Jul 10 12:47:43.360623 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:43.360576    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-44mnv" podStartSLOduration=33.868023746 podStartE2EDuration="44.360563167s" totalImagesPullingTime="10.492539421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 12:46:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:43.359603757 +0000 UTC m=+110.877524025" watchObservedRunningTime="2026-07-10 12:47:43.360563167 +0000 UTC m=+110.878483466"
Jul 10 12:47:43.438626 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:43.438592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:44.329332 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.329297    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:44.530549 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.530513    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:44.580889 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.580817    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nvm47"]
Jul 10 12:47:44.585524 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.585501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.588011 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.587981    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 10 12:47:44.588139 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.588057    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 10 12:47:44.588325 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.588310    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 10 12:47:44.589229 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.589211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 10 12:47:44.589342 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.589254    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hw9ng\""
Jul 10 12:47:44.622319 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.622292    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:44.700022 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.699971    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:44.730100 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730069    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.730212 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-sys\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.730212 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-textfile\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.730212 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730198    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-wtmp\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.730358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.730358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-tls\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.730358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-root\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.730358 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e95c17c-db0b-4eb3-8d6f-8845add347fd-metrics-client-ca\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.730488 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.730361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-754m4\" (UniqueName: \"kubernetes.io/projected/7e95c17c-db0b-4eb3-8d6f-8845add347fd-kube-api-access-754m4\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.799828 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.799782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:44.830956 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.830889    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-tls\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.830956 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.830929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-root\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.830956 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.830948    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e95c17c-db0b-4eb3-8d6f-8845add347fd-metrics-client-ca\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831194 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.830973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-754m4\" (UniqueName: \"kubernetes.io/projected/7e95c17c-db0b-4eb3-8d6f-8845add347fd-kube-api-access-754m4\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831194 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831194 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831010    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-root\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831194 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831096    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-sys\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831194 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-textfile\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831194 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-wtmp\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831509 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-sys\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831509 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831332    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-wtmp\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831509 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831509 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-textfile\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831694 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831599    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e95c17c-db0b-4eb3-8d6f-8845add347fd-metrics-client-ca\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.831946 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.831923    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-accelerators-collector-config\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.833333 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.833314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-tls\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.833488 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.833470    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e95c17c-db0b-4eb3-8d6f-8845add347fd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.839017 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.838996    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-754m4\" (UniqueName: \"kubernetes.io/projected/7e95c17c-db0b-4eb3-8d6f-8845add347fd-kube-api-access-754m4\") pod \"node-exporter-nvm47\" (UID: \"7e95c17c-db0b-4eb3-8d6f-8845add347fd\") " pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.895361 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.895332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nvm47"
Jul 10 12:47:44.895905 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:44.895873    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:44.908841 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:44.908778    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e95c17c_db0b_4eb3_8d6f_8845add347fd.slice/crio-cda3a58e3a0d37cd3ce62df06499ed62c25499fef503955a62b79bd03495c2d4 WatchSource:0}: Error finding container cda3a58e3a0d37cd3ce62df06499ed62c25499fef503955a62b79bd03495c2d4: Status 404 returned error can't find the container with id cda3a58e3a0d37cd3ce62df06499ed62c25499fef503955a62b79bd03495c2d4
Jul 10 12:47:45.068268 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:45.068236    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:45.348929 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:45.348895    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvm47" event={"ID":"7e95c17c-db0b-4eb3-8d6f-8845add347fd","Type":"ContainerStarted","Data":"cda3a58e3a0d37cd3ce62df06499ed62c25499fef503955a62b79bd03495c2d4"}
Jul 10 12:47:45.555572 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:45.555538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:45.628436 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:45.628351    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:45.774332 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:45.774294    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:45.875375 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:45.875321    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:45.963599 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:45.963567    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:46.354210 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:46.354177    2577 generic.go:356] "Generic (PLEG): container finished" podID="7e95c17c-db0b-4eb3-8d6f-8845add347fd" containerID="cb6e221ea820f39d34d32c79aeb247426e54f9e5bf3440262aafeadfc20a0b8b" exitCode=0
Jul 10 12:47:46.354367 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:46.354232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvm47" event={"ID":"7e95c17c-db0b-4eb3-8d6f-8845add347fd","Type":"ContainerDied","Data":"cb6e221ea820f39d34d32c79aeb247426e54f9e5bf3440262aafeadfc20a0b8b"}
Jul 10 12:47:46.930139 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:46.930106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:47.035459 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:47.035417    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:47.361351 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:47.360167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvm47" event={"ID":"7e95c17c-db0b-4eb3-8d6f-8845add347fd","Type":"ContainerStarted","Data":"bbcfc523c6fca3592b3e1c4ea9d2714d060e8eb8de562964e1b6a151eea8aa5f"}
Jul 10 12:47:47.361351 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:47.360293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nvm47" event={"ID":"7e95c17c-db0b-4eb3-8d6f-8845add347fd","Type":"ContainerStarted","Data":"202b0773dafa96e69a5c177624e0fe6be5530ca07e8371ed13b8658280cdee76"}
Jul 10 12:47:47.382081 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:47.382032    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nvm47" podStartSLOduration=2.348940173 podStartE2EDuration="3.382018253s" totalImagesPullingTime="968.711555ms" totalInitContainerRuntime="64.366525ms" isStatefulPod=true podCreationTimestamp="2026-07-10 12:47:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:47.379964632 +0000 UTC m=+114.897884899" watchObservedRunningTime="2026-07-10 12:47:47.382018253 +0000 UTC m=+114.899938520"
Jul 10 12:47:47.528517 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:47.528478    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:47.583295 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:47.583260    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:47.755183 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:47.755149    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:48.064242 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.064161    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:48.876206 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.876168    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7bdf578946-xwvjb"]
Jul 10 12:47:48.879336 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.879314    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:48.881981 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.881964    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 10 12:47:48.882881 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.882861    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 10 12:47:48.883000 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.882934    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 10 12:47:48.883100 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.883082    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-klf4z\""
Jul 10 12:47:48.883169 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.883117    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 10 12:47:48.883169 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.883139    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-d0ndfcal8t5em\""
Jul 10 12:47:48.890496 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:48.890469    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bdf578946-xwvjb"]
Jul 10 12:47:49.061766 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.061736    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f67ca0c-a309-405f-9ee0-492309a88f35-audit-log\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.061943 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.061788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f67ca0c-a309-405f-9ee0-492309a88f35-metrics-server-audit-profiles\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.061943 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.061873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-secret-metrics-server-tls\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.061943 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.061902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f67ca0c-a309-405f-9ee0-492309a88f35-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.062042 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.061942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-client-ca-bundle\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.062042 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.062003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-secret-metrics-server-client-certs\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.062042 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.062020    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlm5n\" (UniqueName: \"kubernetes.io/projected/5f67ca0c-a309-405f-9ee0-492309a88f35-kube-api-access-hlm5n\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.079575 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.079544    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:49.150439 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.150375    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:49.162760 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.162740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f67ca0c-a309-405f-9ee0-492309a88f35-metrics-server-audit-profiles\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.162878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.162775    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-secret-metrics-server-tls\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.162878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.162793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f67ca0c-a309-405f-9ee0-492309a88f35-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.162878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.162840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-client-ca-bundle\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.162878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.162871    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-secret-metrics-server-client-certs\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.163062 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.162887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlm5n\" (UniqueName: \"kubernetes.io/projected/5f67ca0c-a309-405f-9ee0-492309a88f35-kube-api-access-hlm5n\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.163062 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.162918    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f67ca0c-a309-405f-9ee0-492309a88f35-audit-log\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.163308 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.163281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/5f67ca0c-a309-405f-9ee0-492309a88f35-audit-log\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.163584 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.163554    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f67ca0c-a309-405f-9ee0-492309a88f35-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.163790 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.163774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/5f67ca0c-a309-405f-9ee0-492309a88f35-metrics-server-audit-profiles\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.165254 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.165233    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-secret-metrics-server-tls\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.165362 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.165306    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-client-ca-bundle\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.165362 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.165345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/5f67ca0c-a309-405f-9ee0-492309a88f35-secret-metrics-server-client-certs\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.171175 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.171157    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlm5n\" (UniqueName: \"kubernetes.io/projected/5f67ca0c-a309-405f-9ee0-492309a88f35-kube-api-access-hlm5n\") pod \"metrics-server-7bdf578946-xwvjb\" (UID: \"5f67ca0c-a309-405f-9ee0-492309a88f35\") " pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.188647 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.188628    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:47:49.312684 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.312596    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7bdf578946-xwvjb"]
Jul 10 12:47:49.317418 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:47:49.317389    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f67ca0c_a309_405f_9ee0_492309a88f35.slice/crio-2b26c100af96cbdc82d6bc469f97ebb848ed3d26047af09bf2a3806dde8b64dc WatchSource:0}: Error finding container 2b26c100af96cbdc82d6bc469f97ebb848ed3d26047af09bf2a3806dde8b64dc: Status 404 returned error can't find the container with id 2b26c100af96cbdc82d6bc469f97ebb848ed3d26047af09bf2a3806dde8b64dc
Jul 10 12:47:49.325637 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.325616    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m8qvp"
Jul 10 12:47:49.342123 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.342096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:49.369334 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.369304    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb" event={"ID":"5f67ca0c-a309-405f-9ee0-492309a88f35","Type":"ContainerStarted","Data":"2b26c100af96cbdc82d6bc469f97ebb848ed3d26047af09bf2a3806dde8b64dc"}
Jul 10 12:47:49.413478 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.413419    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:49.489960 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.489924    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:49.589933 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.589901    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:49.646115 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:49.646083    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:50.538723 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:50.538684    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:50.803719 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:50.803619    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:51.380019 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:51.379986    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb" event={"ID":"5f67ca0c-a309-405f-9ee0-492309a88f35","Type":"ContainerStarted","Data":"c8390334b51de773b10f4059fea6915f7e02a3bb3a23be256748fb972dee6d75"}
Jul 10 12:47:51.399852 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:51.399780    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb" podStartSLOduration=1.807052871 podStartE2EDuration="3.399766805s" totalImagesPullingTime="1.592713934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:47:51.398175745 +0000 UTC m=+118.916096011" watchObservedRunningTime="2026-07-10 12:47:51.399766805 +0000 UTC m=+118.917687072"
Jul 10 12:47:54.845591 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:54.845553    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:54.945864 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:54.945827    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:57.334191 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:57.334159    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:57.435484 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:57.435451    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:58.131731 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:58.131697    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:58.203179 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:58.203144    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:58.583924 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:58.583897    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:58.648379 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:58.648348    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:58.907197 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:58.907111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:59.008481 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.008444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:59.106072 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.106029    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:47:59.650711 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.650678    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d94655c96-qw87x"]
Jul 10 12:47:59.654888 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.654870    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.657546 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.657523    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 10 12:47:59.657546 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.657535    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 10 12:47:59.658616 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.658599    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 10 12:47:59.658672 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.658609    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zm5ns\""
Jul 10 12:47:59.659016 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.658998    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 10 12:47:59.659103 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.659075    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 10 12:47:59.659281 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.659266    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 10 12:47:59.659359 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.659298    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 10 12:47:59.664157 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.664137    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 10 12:47:59.664421 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.664404    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d94655c96-qw87x"]
Jul 10 12:47:59.740944 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.740915    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-console-config\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.741051 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.740951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-oauth-serving-cert\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.741051 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.740984    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-trusted-ca-bundle\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.741051 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.741034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-serving-cert\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.741167 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.741058    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bszm\" (UniqueName: \"kubernetes.io/projected/5c51ba14-4a1b-497a-a53e-898386d92991-kube-api-access-6bszm\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.741167 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.741080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-oauth-config\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.741167 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.741151    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-service-ca\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.841702 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.841668    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-serving-cert\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.841825 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.841706    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bszm\" (UniqueName: \"kubernetes.io/projected/5c51ba14-4a1b-497a-a53e-898386d92991-kube-api-access-6bszm\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.841825 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.841735    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-oauth-config\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.841825 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.841796    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-service-ca\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.841995 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.841874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-console-config\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.841995 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.841902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-oauth-serving-cert\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.841995 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.841941    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-trusted-ca-bundle\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.842625 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.842598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-service-ca\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.842726 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.842645    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-console-config\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.842726 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.842669    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-oauth-serving-cert\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.842726 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.842693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-trusted-ca-bundle\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.844201 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.844182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-oauth-config\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.844299 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.844284    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-serving-cert\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.850057 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.850037    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bszm\" (UniqueName: \"kubernetes.io/projected/5c51ba14-4a1b-497a-a53e-898386d92991-kube-api-access-6bszm\") pod \"console-6d94655c96-qw87x\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") " pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:47:59.964655 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:47:59.964630    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:48:00.091178 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:00.091150    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d94655c96-qw87x"]
Jul 10 12:48:00.094371 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:48:00.094346    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c51ba14_4a1b_497a_a53e_898386d92991.slice/crio-121f556fa5f0155c995836035067bdfd00555b3c834211f01ecabf04a8d46173 WatchSource:0}: Error finding container 121f556fa5f0155c995836035067bdfd00555b3c834211f01ecabf04a8d46173: Status 404 returned error can't find the container with id 121f556fa5f0155c995836035067bdfd00555b3c834211f01ecabf04a8d46173
Jul 10 12:48:00.407564 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:00.407489    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d94655c96-qw87x" event={"ID":"5c51ba14-4a1b-497a-a53e-898386d92991","Type":"ContainerStarted","Data":"121f556fa5f0155c995836035067bdfd00555b3c834211f01ecabf04a8d46173"}
Jul 10 12:48:01.142915 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:01.142876    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:01.245012 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:01.244947    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:01.639991 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:01.639948    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:01.705128 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:01.705089    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:02.308690 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:02.308621    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:02.402244 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:02.402204    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:02.865048 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:02.865026    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:48:02.867150 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:02.867132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d433eb93-bab1-465f-b6e5-d849aa342f28-metrics-certs\") pod \"network-metrics-daemon-z7qjm\" (UID: \"d433eb93-bab1-465f-b6e5-d849aa342f28\") " pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:48:03.166286 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:03.166212    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pmvx9\""
Jul 10 12:48:03.174513 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:03.174492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z7qjm"
Jul 10 12:48:03.299428 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:03.299402    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z7qjm"]
Jul 10 12:48:03.301518 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:48:03.301496    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd433eb93_bab1_465f_b6e5_d849aa342f28.slice/crio-b8915e960681287fd2995c3b456ba6ac5a8a1124a116039a94816a5053974276 WatchSource:0}: Error finding container b8915e960681287fd2995c3b456ba6ac5a8a1124a116039a94816a5053974276: Status 404 returned error can't find the container with id b8915e960681287fd2995c3b456ba6ac5a8a1124a116039a94816a5053974276
Jul 10 12:48:03.420458 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:03.420367    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d94655c96-qw87x" event={"ID":"5c51ba14-4a1b-497a-a53e-898386d92991","Type":"ContainerStarted","Data":"34f665e1d4f6c8a8183a2c830175ede802c04c8cf6178f1a3e5d3247ab3f360e"}
Jul 10 12:48:03.421557 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:03.421537    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7qjm" event={"ID":"d433eb93-bab1-465f-b6e5-d849aa342f28","Type":"ContainerStarted","Data":"b8915e960681287fd2995c3b456ba6ac5a8a1124a116039a94816a5053974276"}
Jul 10 12:48:03.439813 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:03.439755    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d94655c96-qw87x" podStartSLOduration=1.6961056810000001 podStartE2EDuration="4.439740757s" totalImagesPullingTime="2.743635076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:47:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:48:03.438716721 +0000 UTC m=+130.956636989" watchObservedRunningTime="2026-07-10 12:48:03.439740757 +0000 UTC m=+130.957661024"
Jul 10 12:48:03.769778 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:03.769739    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:03.827920 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:03.827867    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:04.426772 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:04.426735    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7qjm" event={"ID":"d433eb93-bab1-465f-b6e5-d849aa342f28","Type":"ContainerStarted","Data":"d49154b414b9a9233198afb28fd0c927693971931c04ade43362e057b061c878"}
Jul 10 12:48:04.427132 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:04.426822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z7qjm" event={"ID":"d433eb93-bab1-465f-b6e5-d849aa342f28","Type":"ContainerStarted","Data":"da14ad23009f57f4bebb2f102fd688cb14e2648198f8dc3d38cdc6d724985c7e"}
Jul 10 12:48:04.442905 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:04.442855    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z7qjm" podStartSLOduration=130.613684046 podStartE2EDuration="2m11.442836613s" totalImagesPullingTime="829.152567ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:45:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:48:04.442407174 +0000 UTC m=+131.960327442" watchObservedRunningTime="2026-07-10 12:48:04.442836613 +0000 UTC m=+131.960756881"
Jul 10 12:48:04.532654 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:04.532618    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:04.633354 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:04.633322    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:06.981217 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:06.981171    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:07.039271 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:07.039222    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:09.188947 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:09.188918    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:48:09.189344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:09.188968    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:48:09.965365 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:09.965334    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:48:09.965614 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:09.965397    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:48:09.970079 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:09.970055    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:48:10.450741 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:10.450711    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:48:10.533701 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:10.533646    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8tb5d_a89af1cd-d7aa-4849-82a5-b0917e58f819/serve-healthcheck-canary/0.log"
Jul 10 12:48:10.603641 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:10.603615    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:10.656331 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:10.656306    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:10.712383 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:10.712324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:14.517398 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:14.517366    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:14.619113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:14.619085    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:14.672920 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:14.672894    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:21.978037 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:21.978001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:22.036328 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:22.036290    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:25.033533 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:25.033499    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:25.091040 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:25.091011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:48:29.194020 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:29.193992    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:48:29.197885 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:48:29.197865    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7bdf578946-xwvjb"
Jul 10 12:49:00.684517 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:00.684482    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:00.754669 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:00.754640    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:12.681185 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:12.681151    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:12.735133 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:12.735087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:13.546576 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:13.546537    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:13.607120 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:13.607089    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:13.679262 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:13.679231    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:13.749867 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:13.749838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:14.276764 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:14.276715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:14.334948 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:14.334923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:21.991338 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:21.991291    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:22.091293 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:22.091261    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:24.534224 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:24.534189    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d94655c96-qw87x"]
Jul 10 12:49:24.644617 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:24.644579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:24.745716 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:24.745669    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:24.809452 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:24.809346    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:40.685752 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:40.685706    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:46.489618 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:46.489579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:49:49.554113 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.554074    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d94655c96-qw87x" podUID="5c51ba14-4a1b-497a-a53e-898386d92991" containerName="console" containerID="cri-o://34f665e1d4f6c8a8183a2c830175ede802c04c8cf6178f1a3e5d3247ab3f360e" gracePeriod=15
Jul 10 12:49:49.774789 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.774698    2577 generic.go:356] "Generic (PLEG): container finished" podID="5c51ba14-4a1b-497a-a53e-898386d92991" containerID="34f665e1d4f6c8a8183a2c830175ede802c04c8cf6178f1a3e5d3247ab3f360e" exitCode=0
Jul 10 12:49:49.774789 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.774733    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d94655c96-qw87x" event={"ID":"5c51ba14-4a1b-497a-a53e-898386d92991","Type":"ContainerDied","Data":"34f665e1d4f6c8a8183a2c830175ede802c04c8cf6178f1a3e5d3247ab3f360e"}
Jul 10 12:49:49.786726 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.786705    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:49:49.822455 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822397    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-oauth-serving-cert\") pod \"5c51ba14-4a1b-497a-a53e-898386d92991\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") "
Jul 10 12:49:49.822455 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822438    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-service-ca\") pod \"5c51ba14-4a1b-497a-a53e-898386d92991\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") "
Jul 10 12:49:49.822622 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822473    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-serving-cert\") pod \"5c51ba14-4a1b-497a-a53e-898386d92991\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") "
Jul 10 12:49:49.822622 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822502    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6bszm\" (UniqueName: \"kubernetes.io/projected/5c51ba14-4a1b-497a-a53e-898386d92991-kube-api-access-6bszm\") pod \"5c51ba14-4a1b-497a-a53e-898386d92991\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") "
Jul 10 12:49:49.822622 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822548    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-console-config\") pod \"5c51ba14-4a1b-497a-a53e-898386d92991\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") "
Jul 10 12:49:49.822788 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822687    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-trusted-ca-bundle\") pod \"5c51ba14-4a1b-497a-a53e-898386d92991\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") "
Jul 10 12:49:49.822788 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822732    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-oauth-config\") pod \"5c51ba14-4a1b-497a-a53e-898386d92991\" (UID: \"5c51ba14-4a1b-497a-a53e-898386d92991\") "
Jul 10 12:49:49.822920 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822862    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5c51ba14-4a1b-497a-a53e-898386d92991" (UID: "5c51ba14-4a1b-497a-a53e-898386d92991"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 12:49:49.822990 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822934    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-console-config" (OuterVolumeSpecName: "console-config") pod "5c51ba14-4a1b-497a-a53e-898386d92991" (UID: "5c51ba14-4a1b-497a-a53e-898386d92991"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 12:49:49.822990 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.822938    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-service-ca" (OuterVolumeSpecName: "service-ca") pod "5c51ba14-4a1b-497a-a53e-898386d92991" (UID: "5c51ba14-4a1b-497a-a53e-898386d92991"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 12:49:49.823094 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.823008    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-oauth-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:49:49.823094 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.823026    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-service-ca\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:49:49.823094 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.823035    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-console-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:49:49.823294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.823261    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5c51ba14-4a1b-497a-a53e-898386d92991" (UID: "5c51ba14-4a1b-497a-a53e-898386d92991"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 12:49:49.824914 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.824885    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5c51ba14-4a1b-497a-a53e-898386d92991" (UID: "5c51ba14-4a1b-497a-a53e-898386d92991"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 12:49:49.824993 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.824946    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c51ba14-4a1b-497a-a53e-898386d92991-kube-api-access-6bszm" (OuterVolumeSpecName: "kube-api-access-6bszm") pod "5c51ba14-4a1b-497a-a53e-898386d92991" (UID: "5c51ba14-4a1b-497a-a53e-898386d92991"). InnerVolumeSpecName "kube-api-access-6bszm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 12:49:49.824993 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.824948    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5c51ba14-4a1b-497a-a53e-898386d92991" (UID: "5c51ba14-4a1b-497a-a53e-898386d92991"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 12:49:49.923631 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.923608    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-serving-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:49:49.923631 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.923630    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6bszm\" (UniqueName: \"kubernetes.io/projected/5c51ba14-4a1b-497a-a53e-898386d92991-kube-api-access-6bszm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:49:49.923756 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.923640    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c51ba14-4a1b-497a-a53e-898386d92991-trusted-ca-bundle\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:49:49.923756 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:49.923648    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5c51ba14-4a1b-497a-a53e-898386d92991-console-oauth-config\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:49:50.779758 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:50.779725    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d94655c96-qw87x" event={"ID":"5c51ba14-4a1b-497a-a53e-898386d92991","Type":"ContainerDied","Data":"121f556fa5f0155c995836035067bdfd00555b3c834211f01ecabf04a8d46173"}
Jul 10 12:49:50.779758 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:50.779742    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d94655c96-qw87x"
Jul 10 12:49:50.780269 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:50.779780    2577 scope.go:117] "RemoveContainer" containerID="34f665e1d4f6c8a8183a2c830175ede802c04c8cf6178f1a3e5d3247ab3f360e"
Jul 10 12:49:50.801769 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:50.801739    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d94655c96-qw87x"]
Jul 10 12:49:50.807868 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:50.807846    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d94655c96-qw87x"]
Jul 10 12:49:51.156353 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:49:51.156280    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c51ba14-4a1b-497a-a53e-898386d92991" path="/var/lib/kubelet/pods/5c51ba14-4a1b-497a-a53e-898386d92991/volumes"
Jul 10 12:50:07.583018 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:07.582977    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:07.680670 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:07.680634    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:20.247868 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:20.247765    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:34.285869 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:34.285838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:35.152048 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:35.152007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:37.919849 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:37.919817    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:38.019855 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:38.019824    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:39.421662 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:39.421628    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:39.518009 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:39.517978    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:40.258370 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:40.258318    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:40.359815 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:40.359761    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:41.406275 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:41.406235    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:41.789817 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:41.789762    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:44.676307 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:44.676273    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:44.871854 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:44.871817    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:46.959032 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:46.959001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:47.059462 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:47.059427    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:50.091333 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:50.091304    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:50.203280 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:50.203241    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:52.900539 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:52.900511    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 10 12:50:56.299018 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:56.298958    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:56.403154 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:56.403119    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:50:58.316588 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.316555    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"]
Jul 10 12:50:58.316978 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.316819    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c51ba14-4a1b-497a-a53e-898386d92991" containerName="console"
Jul 10 12:50:58.316978 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.316833    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c51ba14-4a1b-497a-a53e-898386d92991" containerName="console"
Jul 10 12:50:58.316978 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.316891    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c51ba14-4a1b-497a-a53e-898386d92991" containerName="console"
Jul 10 12:50:58.319516 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.319500    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"
Jul 10 12:50:58.322108 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.322082    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 10 12:50:58.323140 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.323123    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 10 12:50:58.323219 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.323160    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-t9qk2\""
Jul 10 12:50:58.327512 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.327487    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"]
Jul 10 12:50:58.400083 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.400048    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxdzp\" (UniqueName: \"kubernetes.io/projected/424c4831-dea6-4e67-9a4a-e070281f15d7-kube-api-access-dxdzp\") pod \"openshift-lws-operator-fd8ccff4c-h6b6x\" (UID: \"424c4831-dea6-4e67-9a4a-e070281f15d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"
Jul 10 12:50:58.400265 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.400096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/424c4831-dea6-4e67-9a4a-e070281f15d7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h6b6x\" (UID: \"424c4831-dea6-4e67-9a4a-e070281f15d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"
Jul 10 12:50:58.500812 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.500772    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxdzp\" (UniqueName: \"kubernetes.io/projected/424c4831-dea6-4e67-9a4a-e070281f15d7-kube-api-access-dxdzp\") pod \"openshift-lws-operator-fd8ccff4c-h6b6x\" (UID: \"424c4831-dea6-4e67-9a4a-e070281f15d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"
Jul 10 12:50:58.500941 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.500840    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/424c4831-dea6-4e67-9a4a-e070281f15d7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h6b6x\" (UID: \"424c4831-dea6-4e67-9a4a-e070281f15d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"
Jul 10 12:50:58.501177 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.501159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/424c4831-dea6-4e67-9a4a-e070281f15d7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-h6b6x\" (UID: \"424c4831-dea6-4e67-9a4a-e070281f15d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"
Jul 10 12:50:58.509355 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.509324    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxdzp\" (UniqueName: \"kubernetes.io/projected/424c4831-dea6-4e67-9a4a-e070281f15d7-kube-api-access-dxdzp\") pod \"openshift-lws-operator-fd8ccff4c-h6b6x\" (UID: \"424c4831-dea6-4e67-9a4a-e070281f15d7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"
Jul 10 12:50:58.628168 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.628102    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"
Jul 10 12:50:58.747599 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.747574    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x"]
Jul 10 12:50:58.750059 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:50:58.750024    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod424c4831_dea6_4e67_9a4a_e070281f15d7.slice/crio-9239ffa8c6bc2985aaf4e86e563681096756bf654ca30c0bfaf6b981fbac6c32 WatchSource:0}: Error finding container 9239ffa8c6bc2985aaf4e86e563681096756bf654ca30c0bfaf6b981fbac6c32: Status 404 returned error can't find the container with id 9239ffa8c6bc2985aaf4e86e563681096756bf654ca30c0bfaf6b981fbac6c32
Jul 10 12:50:58.751429 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:58.751409    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 12:50:59.003821 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:50:59.003780    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x" event={"ID":"424c4831-dea6-4e67-9a4a-e070281f15d7","Type":"ContainerStarted","Data":"9239ffa8c6bc2985aaf4e86e563681096756bf654ca30c0bfaf6b981fbac6c32"}
Jul 10 12:51:02.016247 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:02.016204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x" event={"ID":"424c4831-dea6-4e67-9a4a-e070281f15d7","Type":"ContainerStarted","Data":"5c459634f35e19fa8c614edd6081c3b69435038417462be7b09995085f9612ac"}
Jul 10 12:51:02.035549 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:02.035502    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-h6b6x" podStartSLOduration=1.1880763540000001 podStartE2EDuration="4.035487101s" totalImagesPullingTime="2.847410747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:50:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:51:02.03418804 +0000 UTC m=+309.552108321" watchObservedRunningTime="2026-07-10 12:51:02.035487101 +0000 UTC m=+309.553407367"
Jul 10 12:51:02.704056 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:02.704011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:02.807521 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:02.807484    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:04.496891 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:04.496858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:16.699182 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:16.699138    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:17.155611 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.155494    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:17.331593 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.331551    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:17.584065 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.584031    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:17.688784 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.688753    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:17.713246 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.713222    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"]
Jul 10 12:51:17.716266 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.716251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.719097 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.719065    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 10 12:51:17.719213 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.719122    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 10 12:51:17.719213 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.719137    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6rhzd\""
Jul 10 12:51:17.719318 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.719262    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 10 12:51:17.719387 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.719370    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 10 12:51:17.730362 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.730342    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"]
Jul 10 12:51:17.741376 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.741349    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3333c65-569c-4dc0-a524-85d28ffab103-tmp\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.741467 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.741392    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3333c65-569c-4dc0-a524-85d28ffab103-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.741467 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.741417    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3333c65-569c-4dc0-a524-85d28ffab103-manifests\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.741467 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.741458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3333c65-569c-4dc0-a524-85d28ffab103-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.741583 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.741479    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvx6h\" (UniqueName: \"kubernetes.io/projected/e3333c65-569c-4dc0-a524-85d28ffab103-kube-api-access-rvx6h\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.839715 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.839624    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:17.842580 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.842561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3333c65-569c-4dc0-a524-85d28ffab103-manifests\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.842641 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.842599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3333c65-569c-4dc0-a524-85d28ffab103-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.842641 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.842623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvx6h\" (UniqueName: \"kubernetes.io/projected/e3333c65-569c-4dc0-a524-85d28ffab103-kube-api-access-rvx6h\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.842728 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.842659    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3333c65-569c-4dc0-a524-85d28ffab103-tmp\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.842728 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.842689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3333c65-569c-4dc0-a524-85d28ffab103-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.843070 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.843038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/e3333c65-569c-4dc0-a524-85d28ffab103-manifests\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.845057 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.845023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3333c65-569c-4dc0-a524-85d28ffab103-tmp\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.845157 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.845141    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/e3333c65-569c-4dc0-a524-85d28ffab103-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.845216 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.845175    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e3333c65-569c-4dc0-a524-85d28ffab103-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.851770 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.851749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvx6h\" (UniqueName: \"kubernetes.io/projected/e3333c65-569c-4dc0-a524-85d28ffab103-kube-api-access-rvx6h\") pod \"opendatahub-operator-controller-manager-7f6798dbc-h8zrk\" (UID: \"e3333c65-569c-4dc0-a524-85d28ffab103\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:17.936082 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:17.936052    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:18.025772 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:18.025731    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:18.052681 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:18.052651    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:18.137736 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:18.137686    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:18.154847 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:18.154818    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"]
Jul 10 12:51:18.157517 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:51:18.157494    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3333c65_569c_4dc0_a524_85d28ffab103.slice/crio-ae6c5965df1e4700e1f532384da22ae747c44364647c3fced29904a27c2e80ef WatchSource:0}: Error finding container ae6c5965df1e4700e1f532384da22ae747c44364647c3fced29904a27c2e80ef: Status 404 returned error can't find the container with id ae6c5965df1e4700e1f532384da22ae747c44364647c3fced29904a27c2e80ef
Jul 10 12:51:18.236834 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:18.236787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:19.081031 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:19.080992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk" event={"ID":"e3333c65-569c-4dc0-a524-85d28ffab103","Type":"ContainerStarted","Data":"ae6c5965df1e4700e1f532384da22ae747c44364647c3fced29904a27c2e80ef"}
Jul 10 12:51:22.093453 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:22.093411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk" event={"ID":"e3333c65-569c-4dc0-a524-85d28ffab103","Type":"ContainerStarted","Data":"e110c941a1aee31fad9c3ed3ad26672a5404e2b44c63719997bd923c11f56ff7"}
Jul 10 12:51:23.100253 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:23.100217    2577 generic.go:356] "Generic (PLEG): container finished" podID="e3333c65-569c-4dc0-a524-85d28ffab103" containerID="e110c941a1aee31fad9c3ed3ad26672a5404e2b44c63719997bd923c11f56ff7" exitCode=0
Jul 10 12:51:23.100601 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:23.100267    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk" event={"ID":"e3333c65-569c-4dc0-a524-85d28ffab103","Type":"ContainerDied","Data":"e110c941a1aee31fad9c3ed3ad26672a5404e2b44c63719997bd923c11f56ff7"}
Jul 10 12:51:24.105438 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:24.105400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk" event={"ID":"e3333c65-569c-4dc0-a524-85d28ffab103","Type":"ContainerStarted","Data":"4c0a61d5ad6cf8da3eed108c6aa3ba273ac7ec58123297e54dcdbe077481c5a3"}
Jul 10 12:51:24.105780 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:24.105482    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:24.135816 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:24.135758    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk" podStartSLOduration=2.579621582 podStartE2EDuration="7.135743586s" totalImagesPullingTime="3.553009107s" totalInitContainerRuntime="1.003112897s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:51:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:51:24.134506832 +0000 UTC m=+331.652427099" watchObservedRunningTime="2026-07-10 12:51:24.135743586 +0000 UTC m=+331.653663853"
Jul 10 12:51:35.111785 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:35.111750    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6798dbc-h8zrk"
Jul 10 12:51:36.802554 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:36.802519    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:36.956238 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:36.956201    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"]
Jul 10 12:51:36.964090 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:36.964070    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:36.977606 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:36.977583    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 10 12:51:36.977714 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:36.977602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 10 12:51:36.977714 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:36.977646    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 10 12:51:36.977714 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:36.977655    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tqml8\""
Jul 10 12:51:37.003164 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.003138    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"]
Jul 10 12:51:37.069423 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.069359    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5091ef3b-9789-456d-9d6e-7435ea2c7011-metrics-cert\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.069423 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.069394    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5091ef3b-9789-456d-9d6e-7435ea2c7011-cert\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.069423 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.069411    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2f8r\" (UniqueName: \"kubernetes.io/projected/5091ef3b-9789-456d-9d6e-7435ea2c7011-kube-api-access-z2f8r\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.069614 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.069522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5091ef3b-9789-456d-9d6e-7435ea2c7011-manager-config\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.170366 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.170342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5091ef3b-9789-456d-9d6e-7435ea2c7011-manager-config\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.170511 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.170378    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5091ef3b-9789-456d-9d6e-7435ea2c7011-metrics-cert\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.170511 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.170395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5091ef3b-9789-456d-9d6e-7435ea2c7011-cert\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.170511 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.170414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2f8r\" (UniqueName: \"kubernetes.io/projected/5091ef3b-9789-456d-9d6e-7435ea2c7011-kube-api-access-z2f8r\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.170977 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.170955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5091ef3b-9789-456d-9d6e-7435ea2c7011-manager-config\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.172966 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.172948    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5091ef3b-9789-456d-9d6e-7435ea2c7011-metrics-cert\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.173050 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.173014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5091ef3b-9789-456d-9d6e-7435ea2c7011-cert\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.187256 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.187229    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2f8r\" (UniqueName: \"kubernetes.io/projected/5091ef3b-9789-456d-9d6e-7435ea2c7011-kube-api-access-z2f8r\") pod \"lws-controller-manager-86f6864fb7-dmvv4\" (UID: \"5091ef3b-9789-456d-9d6e-7435ea2c7011\") " pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.273210 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.273186    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:37.403050 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.403026    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"]
Jul 10 12:51:37.405381 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:51:37.405360    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5091ef3b_9789_456d_9d6e_7435ea2c7011.slice/crio-4ae5074f9f1651c0e4a2b0530e61624388775d40aaa9c476b01a05a1be71a353 WatchSource:0}: Error finding container 4ae5074f9f1651c0e4a2b0530e61624388775d40aaa9c476b01a05a1be71a353: Status 404 returned error can't find the container with id 4ae5074f9f1651c0e4a2b0530e61624388775d40aaa9c476b01a05a1be71a353
Jul 10 12:51:37.510235 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.510205    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"]
Jul 10 12:51:37.514997 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.514976    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:37.519082 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.519065    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tsxbq\""
Jul 10 12:51:37.519280 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.519255    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 10 12:51:37.519371 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.519284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 10 12:51:37.519426 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.519392    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 10 12:51:37.519856 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.519842    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 10 12:51:37.542412 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.542375    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"]
Jul 10 12:51:37.573816 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.573743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tls-certs\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:37.573896 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.573794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46jsz\" (UniqueName: \"kubernetes.io/projected/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-kube-api-access-46jsz\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:37.573896 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.573862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tmp\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:37.674565 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.674528    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46jsz\" (UniqueName: \"kubernetes.io/projected/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-kube-api-access-46jsz\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:37.674675 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.674578    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tmp\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:37.674675 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.674647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tls-certs\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:37.674744 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:51:37.674733    2577 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 10 12:51:37.674792 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:51:37.674783    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tls-certs podName:3e375fb7-59e1-4272-acfa-c3a9afb7e93c nodeName:}" failed. No retries permitted until 2026-07-10 12:51:38.174766954 +0000 UTC m=+345.692687199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tls-certs") pod "kube-auth-proxy-779ffb979b-c8f9s" (UID: "3e375fb7-59e1-4272-acfa-c3a9afb7e93c") : secret "kube-auth-proxy-tls" not found
Jul 10 12:51:37.676770 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.676748    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tmp\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:37.705828 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:37.705792    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46jsz\" (UniqueName: \"kubernetes.io/projected/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-kube-api-access-46jsz\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:38.029389 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.029355    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:38.154573 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.154538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4" event={"ID":"5091ef3b-9789-456d-9d6e-7435ea2c7011","Type":"ContainerStarted","Data":"4ae5074f9f1651c0e4a2b0530e61624388775d40aaa9c476b01a05a1be71a353"}
Jul 10 12:51:38.177925 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.177897    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tls-certs\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:38.180999 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.180979    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e375fb7-59e1-4272-acfa-c3a9afb7e93c-tls-certs\") pod \"kube-auth-proxy-779ffb979b-c8f9s\" (UID: \"3e375fb7-59e1-4272-acfa-c3a9afb7e93c\") " pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:38.418454 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.418370    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:38.425379 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.425353    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"
Jul 10 12:51:38.738595 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.738559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:38.829972 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.829945    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s"]
Jul 10 12:51:38.832442 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:51:38.832419    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e375fb7_59e1_4272_acfa_c3a9afb7e93c.slice/crio-def9521230e6a6f5b7d646eca87fc2c7bee06533153ef96d9200ddee21fb4e3b WatchSource:0}: Error finding container def9521230e6a6f5b7d646eca87fc2c7bee06533153ef96d9200ddee21fb4e3b: Status 404 returned error can't find the container with id def9521230e6a6f5b7d646eca87fc2c7bee06533153ef96d9200ddee21fb4e3b
Jul 10 12:51:38.929838 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:38.929783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:39.054246 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:39.054172    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:39.133741 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:39.133705    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:39.159145 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:39.159111    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4" event={"ID":"5091ef3b-9789-456d-9d6e-7435ea2c7011","Type":"ContainerStarted","Data":"c4a6f8df7927efc3cdeb9417038d703f9f0662b929aa07a7c3d5a906a68acf39"}
Jul 10 12:51:39.159314 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:39.159243    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:51:39.160292 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:39.160269    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s" event={"ID":"3e375fb7-59e1-4272-acfa-c3a9afb7e93c","Type":"ContainerStarted","Data":"def9521230e6a6f5b7d646eca87fc2c7bee06533153ef96d9200ddee21fb4e3b"}
Jul 10 12:51:39.181817 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:39.181766    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4" podStartSLOduration=1.829440188 podStartE2EDuration="3.181749218s" totalImagesPullingTime="1.35230903s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:51:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:51:39.18130216 +0000 UTC m=+346.699222429" watchObservedRunningTime="2026-07-10 12:51:39.181749218 +0000 UTC m=+346.699669485"
Jul 10 12:51:39.945379 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:39.945341    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:42.174197 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:42.174157    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s" event={"ID":"3e375fb7-59e1-4272-acfa-c3a9afb7e93c","Type":"ContainerStarted","Data":"3f6b8c06be9d2b9a86e54fc67ea5a2f2361428ec4bf82835f2b331541f765331"}
Jul 10 12:51:42.191103 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:42.191057    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-779ffb979b-c8f9s" podStartSLOduration=2.549888512 podStartE2EDuration="5.191042579s" totalImagesPullingTime="2.641154067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:51:42.190300229 +0000 UTC m=+349.708220500" watchObservedRunningTime="2026-07-10 12:51:42.191042579 +0000 UTC m=+349.708962845"
Jul 10 12:51:44.943840 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:44.943778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:45.063477 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:45.063437    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:45.689444 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:45.689404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:45.928527 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:45.928496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:46.127730 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:46.127637    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:46.834710 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:46.834670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:48.031065 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:48.031021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:48.134912 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:48.134876    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:48.230816 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:48.230772    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:48.610027 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:48.609995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:49.362563 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:49.362525    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:49.462339 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:49.462303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:49.572622 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:49.572590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:51:50.166124 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:51:50.166091    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86f6864fb7-dmvv4"
Jul 10 12:52:38.262179 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:52:38.262140    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:52:38.353043 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:52:38.353002    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:52:38.453264 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:52:38.453229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:52:38.575510 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:52:38.575427    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:52:39.180640 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:52:39.180608    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:52:39.385739 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:52:39.385700    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:06.543604 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:06.543569    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:07.145293 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:07.145251    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:11.555193 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:11.555154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:13.848667 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:13.848638    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:13.945297 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:13.945265    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:16.450179 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:16.450099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:16.775681 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:16.775597    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:19.156870 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:19.156823    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:19.805667 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:19.805612    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:22.214429 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:22.214395    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:22.951995 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:22.951955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:23.055570 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:23.055513    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:23.352082 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:23.351979    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:23.452310 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:23.452285    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:25.068721 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.068691    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"]
Jul 10 12:53:25.071793 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.071776    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.074356 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.074330    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 10 12:53:25.074481 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.074387    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6qgc9\""
Jul 10 12:53:25.075438 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.075419    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 10 12:53:25.075544 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.075420    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 10 12:53:25.075544 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.075453    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 10 12:53:25.081546 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.081522    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"]
Jul 10 12:53:25.084221 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.084197    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:25.167095 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.167071    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69h67\" (UniqueName: \"kubernetes.io/projected/284074a6-12ad-4d3a-ae71-892e68c8e8ad-kube-api-access-69h67\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.167221 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.167112    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/284074a6-12ad-4d3a-ae71-892e68c8e8ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.167221 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.167170    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/284074a6-12ad-4d3a-ae71-892e68c8e8ad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.188347 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.188321    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:25.268450 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.268426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/284074a6-12ad-4d3a-ae71-892e68c8e8ad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.268594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.268485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69h67\" (UniqueName: \"kubernetes.io/projected/284074a6-12ad-4d3a-ae71-892e68c8e8ad-kube-api-access-69h67\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.268594 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.268531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/284074a6-12ad-4d3a-ae71-892e68c8e8ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.269101 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.269080    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/284074a6-12ad-4d3a-ae71-892e68c8e8ad-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.270679 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.270657    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/284074a6-12ad-4d3a-ae71-892e68c8e8ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.289038 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.289019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69h67\" (UniqueName: \"kubernetes.io/projected/284074a6-12ad-4d3a-ae71-892e68c8e8ad-kube-api-access-69h67\") pod \"kuadrant-console-plugin-66b5774985-t2ftc\" (UID: \"284074a6-12ad-4d3a-ae71-892e68c8e8ad\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.380714 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.380659    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"
Jul 10 12:53:25.503942 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.503899    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc"]
Jul 10 12:53:25.506780 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:53:25.506750    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod284074a6_12ad_4d3a_ae71_892e68c8e8ad.slice/crio-b33fe8a161d80b28c3436146b27a553fd5ce4c3040f2be9ab51fef325fccd95a WatchSource:0}: Error finding container b33fe8a161d80b28c3436146b27a553fd5ce4c3040f2be9ab51fef325fccd95a: Status 404 returned error can't find the container with id b33fe8a161d80b28c3436146b27a553fd5ce4c3040f2be9ab51fef325fccd95a
Jul 10 12:53:25.570555 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:25.570521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc" event={"ID":"284074a6-12ad-4d3a-ae71-892e68c8e8ad","Type":"ContainerStarted","Data":"b33fe8a161d80b28c3436146b27a553fd5ce4c3040f2be9ab51fef325fccd95a"}
Jul 10 12:53:26.966053 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:26.966013    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:27.066547 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:27.066511    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:31.448739 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:31.448700    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:31.529781 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:31.529747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:34.178749 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:34.178715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:34.279255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:34.279217    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:38.184334 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:38.184285    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:38.282081 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:38.282045    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:41.962912 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:41.962870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:42.019716 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:42.019671    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:42.165321 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:42.165280    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:42.224549 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:42.224471    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:44.735654 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:44.735621    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:44.835305 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:44.835232    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:48.675173 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:48.675139    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc" event={"ID":"284074a6-12ad-4d3a-ae71-892e68c8e8ad","Type":"ContainerStarted","Data":"5647d1b879c4e61e3a7a83f1fbca292446f24d7f8d33dceb4ad2ada7c20c95ae"}
Jul 10 12:53:48.692822 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:48.692754    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-t2ftc" podStartSLOduration=1.130428917 podStartE2EDuration="23.692739685s" totalImagesPullingTime="22.562310768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:53:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:53:48.690874814 +0000 UTC m=+476.208795082" watchObservedRunningTime="2026-07-10 12:53:48.692739685 +0000 UTC m=+476.210659953"
Jul 10 12:53:53.367980 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:53.367941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:53.469889 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:53.469854    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:54.596152 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:54.596121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:54.691825 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:54.691773    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:58.164830 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:58.164780    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:53:58.265603 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:53:58.265564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:02.187888 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:02.187858    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:02.242897 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:02.242857    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:02.778686 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:02.778652    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:02.829964 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:02.829931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:05.179135 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:05.179096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:05.640726 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:05.640645    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:07.049529 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.049498    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:07.135084 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.135050    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:07.219778 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.219742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:07.290958 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.290930    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:07.462404 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.462379    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:54:07.482114 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.482092    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:54:07.482250 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.482198    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:07.484839 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.484818    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 10 12:54:07.493269 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.493247    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:54:07.503389 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.503366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b219d4ef-0665-402a-bbc1-b2baf2b7fcdd-config-file\") pod \"limitador-limitador-54d6d988d5-2xbjm\" (UID: \"b219d4ef-0665-402a-bbc1-b2baf2b7fcdd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:07.503472 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.503419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j76fw\" (UniqueName: \"kubernetes.io/projected/b219d4ef-0665-402a-bbc1-b2baf2b7fcdd-kube-api-access-j76fw\") pod \"limitador-limitador-54d6d988d5-2xbjm\" (UID: \"b219d4ef-0665-402a-bbc1-b2baf2b7fcdd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:07.604051 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.604020    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j76fw\" (UniqueName: \"kubernetes.io/projected/b219d4ef-0665-402a-bbc1-b2baf2b7fcdd-kube-api-access-j76fw\") pod \"limitador-limitador-54d6d988d5-2xbjm\" (UID: \"b219d4ef-0665-402a-bbc1-b2baf2b7fcdd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:07.604184 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.604078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b219d4ef-0665-402a-bbc1-b2baf2b7fcdd-config-file\") pod \"limitador-limitador-54d6d988d5-2xbjm\" (UID: \"b219d4ef-0665-402a-bbc1-b2baf2b7fcdd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:07.604619 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.604602    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b219d4ef-0665-402a-bbc1-b2baf2b7fcdd-config-file\") pod \"limitador-limitador-54d6d988d5-2xbjm\" (UID: \"b219d4ef-0665-402a-bbc1-b2baf2b7fcdd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:07.615102 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.615079    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j76fw\" (UniqueName: \"kubernetes.io/projected/b219d4ef-0665-402a-bbc1-b2baf2b7fcdd-kube-api-access-j76fw\") pod \"limitador-limitador-54d6d988d5-2xbjm\" (UID: \"b219d4ef-0665-402a-bbc1-b2baf2b7fcdd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:07.792175 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.792114    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:07.913905 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.913878    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-jdx9t"]
Jul 10 12:54:07.918324 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.918307    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jdx9t"
Jul 10 12:54:07.921348 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.921326    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gz9pg\""
Jul 10 12:54:07.922670 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.922650    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:54:07.926370 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:54:07.926348    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb219d4ef_0665_402a_bbc1_b2baf2b7fcdd.slice/crio-85810d2eecd81ced4b307760afa543b29e640c15ea6a91b11d05f7dbb7f87680 WatchSource:0}: Error finding container 85810d2eecd81ced4b307760afa543b29e640c15ea6a91b11d05f7dbb7f87680: Status 404 returned error can't find the container with id 85810d2eecd81ced4b307760afa543b29e640c15ea6a91b11d05f7dbb7f87680
Jul 10 12:54:07.926944 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.926925    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jdx9t"]
Jul 10 12:54:07.941660 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:07.941622    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:08.003152 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:08.003127    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:08.007694 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:08.007674    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8s6g\" (UniqueName: \"kubernetes.io/projected/61e4717e-7711-4ba0-914b-0f0ab66dff71-kube-api-access-k8s6g\") pod \"authorino-58cd955675-jdx9t\" (UID: \"61e4717e-7711-4ba0-914b-0f0ab66dff71\") " pod="kuadrant-system/authorino-58cd955675-jdx9t"
Jul 10 12:54:08.108628 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:08.108572    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8s6g\" (UniqueName: \"kubernetes.io/projected/61e4717e-7711-4ba0-914b-0f0ab66dff71-kube-api-access-k8s6g\") pod \"authorino-58cd955675-jdx9t\" (UID: \"61e4717e-7711-4ba0-914b-0f0ab66dff71\") " pod="kuadrant-system/authorino-58cd955675-jdx9t"
Jul 10 12:54:08.117334 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:08.117314    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8s6g\" (UniqueName: \"kubernetes.io/projected/61e4717e-7711-4ba0-914b-0f0ab66dff71-kube-api-access-k8s6g\") pod \"authorino-58cd955675-jdx9t\" (UID: \"61e4717e-7711-4ba0-914b-0f0ab66dff71\") " pod="kuadrant-system/authorino-58cd955675-jdx9t"
Jul 10 12:54:08.237354 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:08.237332    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jdx9t"
Jul 10 12:54:08.387871 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:08.387848    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-jdx9t"]
Jul 10 12:54:08.389963 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:54:08.389942    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61e4717e_7711_4ba0_914b_0f0ab66dff71.slice/crio-fee7cf0b194738fed8c486e6b12ca8aa03ded9240fd5c0d8fcf370ccd7b1c5b8 WatchSource:0}: Error finding container fee7cf0b194738fed8c486e6b12ca8aa03ded9240fd5c0d8fcf370ccd7b1c5b8: Status 404 returned error can't find the container with id fee7cf0b194738fed8c486e6b12ca8aa03ded9240fd5c0d8fcf370ccd7b1c5b8
Jul 10 12:54:08.758034 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:08.757983    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm" event={"ID":"b219d4ef-0665-402a-bbc1-b2baf2b7fcdd","Type":"ContainerStarted","Data":"85810d2eecd81ced4b307760afa543b29e640c15ea6a91b11d05f7dbb7f87680"}
Jul 10 12:54:08.760558 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:08.760487    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jdx9t" event={"ID":"61e4717e-7711-4ba0-914b-0f0ab66dff71","Type":"ContainerStarted","Data":"fee7cf0b194738fed8c486e6b12ca8aa03ded9240fd5c0d8fcf370ccd7b1c5b8"}
Jul 10 12:54:10.499448 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:10.499387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:12.107098 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:12.107060    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jdx9t"]
Jul 10 12:54:13.322501 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:13.322468    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:13.420506 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:13.420480    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:13.788102 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:13.788061    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm" event={"ID":"b219d4ef-0665-402a-bbc1-b2baf2b7fcdd","Type":"ContainerStarted","Data":"3bfda4d07619f07bd35cc3b76af7d7733ef583006b73c67b79a8a895be4a971d"}
Jul 10 12:54:13.788299 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:13.788157    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:13.789657 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:13.789629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jdx9t" event={"ID":"61e4717e-7711-4ba0-914b-0f0ab66dff71","Type":"ContainerStarted","Data":"48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef"}
Jul 10 12:54:13.789758 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:13.789651    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-jdx9t" podUID="61e4717e-7711-4ba0-914b-0f0ab66dff71" containerName="authorino" containerID="cri-o://48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef" gracePeriod=30
Jul 10 12:54:13.805011 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:13.804967    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm" podStartSLOduration=1.510098641 podStartE2EDuration="6.80495434s" totalImagesPullingTime="5.294855699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:54:13.803258499 +0000 UTC m=+501.321178803" watchObservedRunningTime="2026-07-10 12:54:13.80495434 +0000 UTC m=+501.322874607"
Jul 10 12:54:13.817527 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:13.817487    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-jdx9t" podStartSLOduration=1.901110774 podStartE2EDuration="6.817474459s" totalImagesPullingTime="4.916363685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:54:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:54:13.816640516 +0000 UTC m=+501.334560787" watchObservedRunningTime="2026-07-10 12:54:13.817474459 +0000 UTC m=+501.335394727"
Jul 10 12:54:14.562771 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.562745    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jdx9t"
Jul 10 12:54:14.664410 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.664373    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8s6g\" (UniqueName: \"kubernetes.io/projected/61e4717e-7711-4ba0-914b-0f0ab66dff71-kube-api-access-k8s6g\") pod \"61e4717e-7711-4ba0-914b-0f0ab66dff71\" (UID: \"61e4717e-7711-4ba0-914b-0f0ab66dff71\") "
Jul 10 12:54:14.666638 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.666612    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61e4717e-7711-4ba0-914b-0f0ab66dff71-kube-api-access-k8s6g" (OuterVolumeSpecName: "kube-api-access-k8s6g") pod "61e4717e-7711-4ba0-914b-0f0ab66dff71" (UID: "61e4717e-7711-4ba0-914b-0f0ab66dff71"). InnerVolumeSpecName "kube-api-access-k8s6g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 12:54:14.765128 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.765056    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8s6g\" (UniqueName: \"kubernetes.io/projected/61e4717e-7711-4ba0-914b-0f0ab66dff71-kube-api-access-k8s6g\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:54:14.794489 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.794458    2577 generic.go:356] "Generic (PLEG): container finished" podID="61e4717e-7711-4ba0-914b-0f0ab66dff71" containerID="48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef" exitCode=0
Jul 10 12:54:14.794638 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.794500    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-jdx9t"
Jul 10 12:54:14.794638 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.794543    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jdx9t" event={"ID":"61e4717e-7711-4ba0-914b-0f0ab66dff71","Type":"ContainerDied","Data":"48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef"}
Jul 10 12:54:14.794638 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.794585    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-jdx9t" event={"ID":"61e4717e-7711-4ba0-914b-0f0ab66dff71","Type":"ContainerDied","Data":"fee7cf0b194738fed8c486e6b12ca8aa03ded9240fd5c0d8fcf370ccd7b1c5b8"}
Jul 10 12:54:14.794638 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.794606    2577 scope.go:117] "RemoveContainer" containerID="48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef"
Jul 10 12:54:14.803136 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.803122    2577 scope.go:117] "RemoveContainer" containerID="48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef"
Jul 10 12:54:14.803405 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:54:14.803388    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef\": container with ID starting with 48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef not found: ID does not exist" containerID="48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef"
Jul 10 12:54:14.803447 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.803412    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef"} err="failed to get container status \"48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef\": rpc error: code = NotFound desc = could not find container \"48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef\": container with ID starting with 48735353ea5502416d27c339e217e21a474a5c0a79cb3e7160f76e8878f936ef not found: ID does not exist"
Jul 10 12:54:14.814506 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.814486    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-jdx9t"]
Jul 10 12:54:14.820635 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:14.820618    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-jdx9t"]
Jul 10 12:54:15.162430 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:15.162360    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61e4717e-7711-4ba0-914b-0f0ab66dff71" path="/var/lib/kubelet/pods/61e4717e-7711-4ba0-914b-0f0ab66dff71/volumes"
Jul 10 12:54:17.982445 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:17.982399    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:18.083599 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:18.083562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:24.796878 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:24.796847    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"
Jul 10 12:54:28.194071 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:28.194037    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:28.290189 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:28.290155    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:28.641255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:28.641154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:40.724156 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:40.724117    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:40.918639 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:40.918605    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:40.947192 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:40.947164    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wm46z"]
Jul 10 12:54:40.947506 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:40.947489    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61e4717e-7711-4ba0-914b-0f0ab66dff71" containerName="authorino"
Jul 10 12:54:40.947582 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:40.947509    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="61e4717e-7711-4ba0-914b-0f0ab66dff71" containerName="authorino"
Jul 10 12:54:40.947637 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:40.947603    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="61e4717e-7711-4ba0-914b-0f0ab66dff71" containerName="authorino"
Jul 10 12:54:41.002603 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.002531    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wm46z"]
Jul 10 12:54:41.002726 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.002632    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wm46z"
Jul 10 12:54:41.006214 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.006188    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gz9pg\""
Jul 10 12:54:41.149234 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.149201    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4r5d\" (UniqueName: \"kubernetes.io/projected/cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb-kube-api-access-d4r5d\") pod \"authorino-5d4b67c446-wm46z\" (UID: \"cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb\") " pod="kuadrant-system/authorino-5d4b67c446-wm46z"
Jul 10 12:54:41.176000 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.175971    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wm46z"]
Jul 10 12:54:41.176180 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:54:41.176162    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d4r5d], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-wm46z" podUID="cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb"
Jul 10 12:54:41.199101 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.199072    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-799f8548dd-fc622"]
Jul 10 12:54:41.202294 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.202276    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799f8548dd-fc622"
Jul 10 12:54:41.209146 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.209123    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-799f8548dd-fc622"]
Jul 10 12:54:41.249823 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.249774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4r5d\" (UniqueName: \"kubernetes.io/projected/cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb-kube-api-access-d4r5d\") pod \"authorino-5d4b67c446-wm46z\" (UID: \"cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb\") " pod="kuadrant-system/authorino-5d4b67c446-wm46z"
Jul 10 12:54:41.254547 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.254490    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-799f8548dd-fc622"]
Jul 10 12:54:41.254698 ip-10-0-134-90 kubenswrapper[2577]: E0710 12:54:41.254679    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cp6ch], unattached volumes=[], failed to process volumes=[kube-api-access-cp6ch]: context canceled" pod="kuadrant-system/authorino-799f8548dd-fc622" podUID="9a5df109-5885-4c76-a3a2-7fd3b819e278"
Jul 10 12:54:41.258834 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.258785    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4r5d\" (UniqueName: \"kubernetes.io/projected/cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb-kube-api-access-d4r5d\") pod \"authorino-5d4b67c446-wm46z\" (UID: \"cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb\") " pod="kuadrant-system/authorino-5d4b67c446-wm46z"
Jul 10 12:54:41.351148 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.351120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6ch\" (UniqueName: \"kubernetes.io/projected/9a5df109-5885-4c76-a3a2-7fd3b819e278-kube-api-access-cp6ch\") pod \"authorino-799f8548dd-fc622\" (UID: \"9a5df109-5885-4c76-a3a2-7fd3b819e278\") " pod="kuadrant-system/authorino-799f8548dd-fc622"
Jul 10 12:54:41.451572 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.451523    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6ch\" (UniqueName: \"kubernetes.io/projected/9a5df109-5885-4c76-a3a2-7fd3b819e278-kube-api-access-cp6ch\") pod \"authorino-799f8548dd-fc622\" (UID: \"9a5df109-5885-4c76-a3a2-7fd3b819e278\") " pod="kuadrant-system/authorino-799f8548dd-fc622"
Jul 10 12:54:41.460125 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.460097    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6ch\" (UniqueName: \"kubernetes.io/projected/9a5df109-5885-4c76-a3a2-7fd3b819e278-kube-api-access-cp6ch\") pod \"authorino-799f8548dd-fc622\" (UID: \"9a5df109-5885-4c76-a3a2-7fd3b819e278\") " pod="kuadrant-system/authorino-799f8548dd-fc622"
Jul 10 12:54:41.897369 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.897331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799f8548dd-fc622"
Jul 10 12:54:41.897838 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.897331    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wm46z"
Jul 10 12:54:41.904403 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.904383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799f8548dd-fc622"
Jul 10 12:54:41.907252 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.907235    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wm46z"
Jul 10 12:54:41.956060 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.956036    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp6ch\" (UniqueName: \"kubernetes.io/projected/9a5df109-5885-4c76-a3a2-7fd3b819e278-kube-api-access-cp6ch\") pod \"9a5df109-5885-4c76-a3a2-7fd3b819e278\" (UID: \"9a5df109-5885-4c76-a3a2-7fd3b819e278\") "
Jul 10 12:54:41.958136 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:41.958110    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a5df109-5885-4c76-a3a2-7fd3b819e278-kube-api-access-cp6ch" (OuterVolumeSpecName: "kube-api-access-cp6ch") pod "9a5df109-5885-4c76-a3a2-7fd3b819e278" (UID: "9a5df109-5885-4c76-a3a2-7fd3b819e278"). InnerVolumeSpecName "kube-api-access-cp6ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 12:54:42.056779 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.056747    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4r5d\" (UniqueName: \"kubernetes.io/projected/cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb-kube-api-access-d4r5d\") pod \"cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb\" (UID: \"cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb\") "
Jul 10 12:54:42.056989 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.056973    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp6ch\" (UniqueName: \"kubernetes.io/projected/9a5df109-5885-4c76-a3a2-7fd3b819e278-kube-api-access-cp6ch\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:54:42.058699 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.058670    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb-kube-api-access-d4r5d" (OuterVolumeSpecName: "kube-api-access-d4r5d") pod "cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb" (UID: "cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb"). InnerVolumeSpecName "kube-api-access-d4r5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 12:54:42.157502 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.157441    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4r5d\" (UniqueName: \"kubernetes.io/projected/cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb-kube-api-access-d4r5d\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 12:54:42.901595 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.901563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-wm46z"
Jul 10 12:54:42.901978 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.901565    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-799f8548dd-fc622"
Jul 10 12:54:42.930998 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.930975    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-799f8548dd-fc622"]
Jul 10 12:54:42.936408 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.936384    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-799f8548dd-fc622"]
Jul 10 12:54:42.956546 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.956524    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wm46z"]
Jul 10 12:54:42.962542 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:42.962523    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-wm46z"]
Jul 10 12:54:43.155636 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:43.155561    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a5df109-5885-4c76-a3a2-7fd3b819e278" path="/var/lib/kubelet/pods/9a5df109-5885-4c76-a3a2-7fd3b819e278/volumes"
Jul 10 12:54:43.155828 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:43.155814    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb" path="/var/lib/kubelet/pods/cdf5f9c9-99c4-4991-a30c-3adf9ecd8aeb/volumes"
Jul 10 12:54:46.523104 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:46.523069    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:46.626199 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:46.626163    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:46.747952 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:46.747912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:46.864710 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:46.864633    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:50.205073 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:50.205037    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:54:50.301837 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:54:50.301787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:21.690550 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:21.690505    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:22.108042 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:22.107970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:22.236002 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:22.235971    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:22.554190 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:22.554157    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:22.662728 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:22.662690    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:22.718554 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:22.718523    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:55:33.130968 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:33.130936    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:33.228415 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:33.228376    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:39.089590 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:39.089557    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:39.581023 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:39.580985    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:55:55.387029 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:55.386995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:55:56.181772 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:55:56.181740    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:56:06.161624 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:06.161578    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:09.006493 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:09.006462    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:10.288963 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:10.288930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:56:11.305581 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:11.305545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:13.666256 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:13.666221    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:13.722577 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:13.722547    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:14.991818 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:14.991775    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"]
Jul 10 12:56:14.994912 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:14.994893    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:14.998786 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:14.998765    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 10 12:56:15.000116 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.000085    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mkb4s\""
Jul 10 12:56:15.000245 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.000132    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 10 12:56:15.000245 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.000231    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 10 12:56:15.006258 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.006236    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"]
Jul 10 12:56:15.093521 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.093474    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:15.098445 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.098423    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.098526 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.098464    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.098526 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.098483    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.098526 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.098505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.098655 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.098567    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bde213d-ab21-47c1-a74e-ae5521a12638-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.098655 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.098612    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckfl2\" (UniqueName: \"kubernetes.io/projected/9bde213d-ab21-47c1-a74e-ae5521a12638-kube-api-access-ckfl2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.199541 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.199507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.199722 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.199551    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.199722 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.199669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.199722 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.199718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bde213d-ab21-47c1-a74e-ae5521a12638-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.199927 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.199747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckfl2\" (UniqueName: \"kubernetes.io/projected/9bde213d-ab21-47c1-a74e-ae5521a12638-kube-api-access-ckfl2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.199927 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.199794    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.200087 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.200060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.200220 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.200097    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.200220 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.200140    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.201826 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.201793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9bde213d-ab21-47c1-a74e-ae5521a12638-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.202118 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.202100    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9bde213d-ab21-47c1-a74e-ae5521a12638-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.208933 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.208910    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckfl2\" (UniqueName: \"kubernetes.io/projected/9bde213d-ab21-47c1-a74e-ae5521a12638-kube-api-access-ckfl2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq\" (UID: \"9bde213d-ab21-47c1-a74e-ae5521a12638\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.304890 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.304828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:15.439739 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.439707    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"]
Jul 10 12:56:15.442647 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:56:15.442599    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bde213d_ab21_47c1_a74e_ae5521a12638.slice/crio-843998630b5d961f05bdc4fa0c3553bd2ad2a30f8d74ce256ccf40baac4d51d7 WatchSource:0}: Error finding container 843998630b5d961f05bdc4fa0c3553bd2ad2a30f8d74ce256ccf40baac4d51d7: Status 404 returned error can't find the container with id 843998630b5d961f05bdc4fa0c3553bd2ad2a30f8d74ce256ccf40baac4d51d7
Jul 10 12:56:15.444044 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:15.444021    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 12:56:16.252078 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:16.252044    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq" event={"ID":"9bde213d-ab21-47c1-a74e-ae5521a12638","Type":"ContainerStarted","Data":"843998630b5d961f05bdc4fa0c3553bd2ad2a30f8d74ce256ccf40baac4d51d7"}
Jul 10 12:56:17.084055 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:17.084018    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:56:17.256851 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:17.256822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq" event={"ID":"9bde213d-ab21-47c1-a74e-ae5521a12638","Type":"ContainerStarted","Data":"7f0fe175db23039da01803f9d06760509c8d1095d4433ac9be67a0043e3892d3"}
Jul 10 12:56:17.277255 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:17.277211    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq" podStartSLOduration=2.21323098 podStartE2EDuration="3.277197383s" totalImagesPullingTime="1.063966403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:56:17.275854392 +0000 UTC m=+624.793774660" watchObservedRunningTime="2026-07-10 12:56:17.277197383 +0000 UTC m=+624.795117650"
Jul 10 12:56:25.305251 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:25.305217    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:25.305668 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:25.305286    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:25.317389 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:25.317371    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:26.303840 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:26.303814    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq"
Jul 10 12:56:26.326344 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:26.326304    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:26.381094 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:26.381057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:38.029146 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:38.029107    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:39.971378 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:39.971347    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:56:45.270197 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.270160    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"]
Jul 10 12:56:45.273518 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.273482    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.275996 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.275973    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 10 12:56:45.283349 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.283325    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"]
Jul 10 12:56:45.292385 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.292361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:56:45.427431 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.427402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9dkt\" (UniqueName: \"kubernetes.io/projected/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-kube-api-access-z9dkt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.427431 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.427435    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.427625 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.427463    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.427625 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.427485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.427625 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.427503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.427625 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.427526    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.528535 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528461    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.528535 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.528535 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528521    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.528778 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.528778 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528596    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9dkt\" (UniqueName: \"kubernetes.io/projected/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-kube-api-access-z9dkt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.528778 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528614    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.528957 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.528957 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.529041 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.528975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.530901 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.530875    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.531088 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.531072    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.536592 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.536568    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9dkt\" (UniqueName: \"kubernetes.io/projected/3ce888d9-8971-4227-8e1f-ad2cb4869f8a-kube-api-access-z9dkt\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f\" (UID: \"3ce888d9-8971-4227-8e1f-ad2cb4869f8a\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.582592 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.582570    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:45.704704 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:45.704671    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"]
Jul 10 12:56:45.707575 ip-10-0-134-90 kubenswrapper[2577]: W0710 12:56:45.707547    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ce888d9_8971_4227_8e1f_ad2cb4869f8a.slice/crio-b97df992d30230a5026151b822348a9ad04d017b266c4567e68db1e5124eff07 WatchSource:0}: Error finding container b97df992d30230a5026151b822348a9ad04d017b266c4567e68db1e5124eff07: Status 404 returned error can't find the container with id b97df992d30230a5026151b822348a9ad04d017b266c4567e68db1e5124eff07
Jul 10 12:56:46.369163 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:46.369128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f" event={"ID":"3ce888d9-8971-4227-8e1f-ad2cb4869f8a","Type":"ContainerStarted","Data":"bd0756d9e1a57c1acdc45d3df90ada4cc31b4ecaeca85be40f4ad5d7ccda626e"}
Jul 10 12:56:46.369515 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:46.369172    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f" event={"ID":"3ce888d9-8971-4227-8e1f-ad2cb4869f8a","Type":"ContainerStarted","Data":"b97df992d30230a5026151b822348a9ad04d017b266c4567e68db1e5124eff07"}
Jul 10 12:56:46.387747 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:46.387705    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f" podStartSLOduration=1.185348946 podStartE2EDuration="1.387689562s" totalImagesPullingTime="202.340616ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 12:56:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 12:56:46.386480231 +0000 UTC m=+653.904400497" watchObservedRunningTime="2026-07-10 12:56:46.387689562 +0000 UTC m=+653.905609865"
Jul 10 12:56:48.883220 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:48.883187    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:56:55.583451 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:55.583414    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:55.583906 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:55.583474    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:55.595591 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:55.595569    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:56:56.420640 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:56:56.420607    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f"
Jul 10 12:57:26.097158 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:57:26.097121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:57:41.483145 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:57:41.483109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:57:41.577784 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:57:41.577753    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:57:42.578087 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:57:42.578052    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:57:42.676740 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:57:42.676709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:17.136926 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:17.136889    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:58:18.982393 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:18.982358    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:19.039504 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:19.039472    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:19.123088 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:19.123043    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:19.176777 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:19.176740    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:19.718245 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:19.718208    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:19.818684 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:19.818647    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:24.871194 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:24.871156    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:58:29.781699 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:29.781664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:29.837505 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:29.837469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:29.892616 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:29.892573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:58:35.668716 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:35.668681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:58:46.787292 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:46.787255    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:58:55.380708 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:58:55.380671    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:59:04.974204 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:59:04.974169    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:59:13.373201 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:59:13.373167    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:59:14.370187 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:59:14.370144    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:59:16.298057 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:59:16.297978    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:59:22.014957 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:59:22.014920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 12:59:40.276318 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:59:40.276282    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 12:59:52.180290 ip-10-0-134-90 kubenswrapper[2577]: I0710 12:59:52.180261    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:00:07.071531 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:07.071496    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:00:08.893946 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:08.893905    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:08.995036 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:08.994997    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:09.107825 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:09.107774    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:14.796496 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:14.796465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:14.866504 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:14.866475    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:14.956933 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:14.956906    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:15.055339 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:15.055263    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:15.154954 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:15.154923    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:15.976991 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:15.976953    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:00:20.958750 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:20.958711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:21.056550 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:21.056511    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:00:24.276564 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:24.276526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:00:32.476751 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:32.476718    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:00:41.882177 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:41.882137    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:00:53.372200 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:00:53.372168    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:01:03.674268 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:01:03.674233    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:01:12.074753 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:01:12.074717    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:01:24.980751 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:01:24.980713    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:01:35.669699 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:01:35.669661    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:01:50.178505 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:01:50.178471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:01:58.071770 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:01:58.071731    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:02:07.775205 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:02:07.775173    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:02:37.880479 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:02:37.880447    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:02:47.179683 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:02:47.179652    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:02:54.150840 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:02:54.150783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:03:07.782283 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:07.782248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:03:11.133531 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:11.133488    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:03:15.730816 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:15.730767    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:03:15.874622 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:15.874590    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:03:22.773926 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:22.773886    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:03:39.672204 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:39.672169    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:03:39.810244 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:39.810217    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:03:39.912079 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:39.912050    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:03:51.372606 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:03:51.372572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:04:00.979859 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:04:00.979824    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:04:10.888061 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:04:10.888022    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:04:22.277058 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:04:22.277029    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:04:39.374244 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:04:39.374212    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:04:50.276499 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:04:50.276465    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:05:04.982986 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:05:04.982950    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:06:52.909849 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:06:52.909816    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:07:04.187533 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:07:04.187494    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:07:16.916428 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:07:16.916394    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:07:29.775996 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:07:29.775962    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:07:40.788259 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:07:40.788228    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:07:51.183356 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:07:51.183324    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:08:04.975552 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:08:04.975517    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:08:17.074044 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:08:17.073957    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:08:24.873599 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:08:24.873564    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:08:34.782567 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:08:34.782525    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:08:42.876735 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:08:42.876702    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:08:52.375236 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:08:52.375201    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:09:04.269343 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:09:04.269310    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:09:13.669337 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:09:13.669305    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:09:28.781569 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:09:28.781531    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:09:40.683833 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:09:40.683787    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:09:55.391699 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:09:55.391664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:10:04.684915 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:10:04.684876    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:10:14.084226 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:10:14.084191    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:10:26.875466 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:10:26.875425    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:10:38.078792 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:10:38.078753    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:10:49.981268 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:10:49.981229    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:10:51.003992 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:10:51.003947    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:10:52.142715 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:10:52.142686    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:11:00.801536 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:11:00.801499    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:11:10.091467 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:11:10.091433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:11:23.880177 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:11:23.880098    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:11:36.296355 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:11:36.296324    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:11:47.764075 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:11:47.764041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:11:52.808424 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:11:52.808391    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:12:03.927170 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:03.927133    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:12:06.312868 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:06.312834    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:12:12.458341 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:12.458289    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:12:16.390321 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:16.390288    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:12:25.167338 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:25.167307    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:12:25.208179 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:25.208149    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:12:33.282310 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:33.282275    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:12:36.420037 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:36.419995    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:12:42.993449 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:42.993416    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:12:55.297656 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:12:55.297622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:13:02.785874 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:13:02.785838    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:13:14.173775 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:13:14.173739    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:13:22.983783 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:13:22.983750    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:13:33.993961 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:13:33.993925    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:13:42.383034 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:13:42.382995    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:13:53.889918 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:13:53.889885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:14:05.695852 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:14:05.695820    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:14:09.221697 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:14:09.221640    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:14:14.894270 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:14:14.894236    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:14:49.161722 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:14:49.161653    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:14:52.587887 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:14:52.587848    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:14:57.400457 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:14:57.400425    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:01.382612 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:01.382572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:15:05.482041 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:05.481992    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:08.709137 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:08.709102    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:08.805764 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:08.805711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:09.191782 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:09.191745    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:10.379008 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:10.378972    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:15:15.086935 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:15.086901    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:15.345362 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:15.345271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:15.590652 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:15.590622    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:16.518789 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:16.518755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:16.619347 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:16.619308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:16.698699 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:16.698668    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:16.876880 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:16.876786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:17.237813 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:17.237782    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:17.332617 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:17.332591    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:19.487269 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:19.487236    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:20.479432 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:20.479399    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:15:21.738581 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:21.738549    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:21.809295 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:21.809249    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:21.912995 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:21.912949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:22.112163 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:22.112086    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:23.984635 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:23.984592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:27.737414 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.737371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:27.841762 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.841733    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:27.925871 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.925836    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"]
Jul 10 13:15:27.929360 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.929337    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.932183 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.932163    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1bce492d-openshift-default-dockercfg-fqdwb\""
Jul 10 13:15:27.934910 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.934888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbsxf\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-kube-api-access-jbsxf\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935009 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.934950    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-podinfo\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935009 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.934979    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-socket\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935101 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.935012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-credential-socket\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935101 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.935054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istiod-ca-cert\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935101 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.935096    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-data\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935242 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.935116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-envoy\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935242 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.935131    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-token\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935242 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.935150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-certs\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:27.935674 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.935657    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 13:15:27.949895 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.949874    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"]
Jul 10 13:15:27.977816 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:27.977774    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:28.035906 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.035822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbsxf\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-kube-api-access-jbsxf\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.035906 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.035885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-podinfo\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.035906 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.035907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-socket\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036230 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.035934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-credential-socket\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036230 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.035952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istiod-ca-cert\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036230 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.035980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-data\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036230 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.036006    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-envoy\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036230 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.036028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-token\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036230 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.036056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-certs\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036586 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.036345    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-socket\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036586 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.036400    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-credential-socket\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036586 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.036462    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-certs\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036680 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.036647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-data\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.036727 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.036704    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istiod-ca-cert\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.038887 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.038866    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-envoy\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.039197 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.039179    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-podinfo\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.047930 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.047900    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-token\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.048193 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.048171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbsxf\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-kube-api-access-jbsxf\") pod \"e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") " pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.059531 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.059497    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:28.242010 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.241973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:28.377028 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.377004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"]
Jul 10 13:15:28.378743 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:15:28.378712    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20d2d6fd_3dbc_485a_8226_84c2e1f37ec1.slice/crio-7c4a709ca956918c385a07dde137d608aade1992d29b9342212db4b6bc98f7a2 WatchSource:0}: Error finding container 7c4a709ca956918c385a07dde137d608aade1992d29b9342212db4b6bc98f7a2: Status 404 returned error can't find the container with id 7c4a709ca956918c385a07dde137d608aade1992d29b9342212db4b6bc98f7a2
Jul 10 13:15:28.380670 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.380653    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 13:15:28.853576 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:28.853534    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq" event={"ID":"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1","Type":"ContainerStarted","Data":"7c4a709ca956918c385a07dde137d608aade1992d29b9342212db4b6bc98f7a2"}
Jul 10 13:15:29.186669 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:29.186573    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:29.292108 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:29.292075    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:29.406682 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:29.406627    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:29.639059 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:29.638983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:29.961243 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:29.961206    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:30.078327 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:30.078265    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:30.912620 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:30.912588    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:15:30.962287 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:30.962256    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:15:30.962553 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:30.962323    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:15:30.962553 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:30.962349    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:15:31.631003 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:31.630977    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:31.870642 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:31.870551    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq" event={"ID":"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1","Type":"ContainerStarted","Data":"ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0"}
Jul 10 13:15:31.897173 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:31.897126    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq" podStartSLOduration=2.315906696 podStartE2EDuration="4.897112428s" totalImagesPullingTime="2.581205732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:15:31.894827464 +0000 UTC m=+1779.412747728" watchObservedRunningTime="2026-07-10 13:15:31.897112428 +0000 UTC m=+1779.415032695"
Jul 10 13:15:32.242758 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:32.242728    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:32.247351 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:32.247330    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:32.875744 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:32.875706    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:32.876624 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:32.876603    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:34.184136 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:34.184101    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:34.562115 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:34.562033    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:40.203925 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:40.203883    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"]
Jul 10 13:15:40.204333 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:40.204128    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq" podUID="20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" containerName="istio-proxy" containerID="cri-o://ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0" gracePeriod=30
Jul 10 13:15:40.228734 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:40.228692    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:40.329120 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:40.329084    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:42.494017 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:42.493985    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:45.451915 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.451891    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:45.570073 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570001    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-token\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570073 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570042    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-certs\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570280 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570090    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-podinfo\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570280 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570260    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-envoy\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570390 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570310    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-credential-socket\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570390 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570328    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istiod-ca-cert\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570390 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570355    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-socket\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570393    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-data\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570424    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:15:45.570540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570445    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbsxf\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-kube-api-access-jbsxf\") pod \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\" (UID: \"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1\") "
Jul 10 13:15:45.570699 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570639    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:15:45.570756 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570703    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:15:45.570911 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570884    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:15:45.570911 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570893    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.571085 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570917    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-credential-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.571085 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570932    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istiod-ca-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.571085 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.570961    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-data" (OuterVolumeSpecName: "istio-data") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:15:45.572518 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.572499    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:15:45.572592 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.572534    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-kube-api-access-jbsxf" (OuterVolumeSpecName: "kube-api-access-jbsxf") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "kube-api-access-jbsxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:15:45.572634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.572590    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 13:15:45.572634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.572605    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-token" (OuterVolumeSpecName: "istio-token") pod "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" (UID: "20d2d6fd-3dbc-485a-8226-84c2e1f37ec1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:15:45.671628 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.671599    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.671628 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.671618    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-podinfo\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.671628 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.671627    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-envoy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.671793 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.671636    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-workload-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.671793 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.671644    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-istio-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.671793 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.671653    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbsxf\" (UniqueName: \"kubernetes.io/projected/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1-kube-api-access-jbsxf\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:15:45.932891 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.932855    2577 generic.go:356] "Generic (PLEG): container finished" podID="20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" containerID="ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0" exitCode=0
Jul 10 13:15:45.933063 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.932885    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq" event={"ID":"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1","Type":"ContainerDied","Data":"ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0"}
Jul 10 13:15:45.933063 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.932922    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"
Jul 10 13:15:45.933063 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.932987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq" event={"ID":"20d2d6fd-3dbc-485a-8226-84c2e1f37ec1","Type":"ContainerDied","Data":"7c4a709ca956918c385a07dde137d608aade1992d29b9342212db4b6bc98f7a2"}
Jul 10 13:15:45.933063 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.933020    2577 scope.go:117] "RemoveContainer" containerID="ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0"
Jul 10 13:15:45.942290 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.942271    2577 scope.go:117] "RemoveContainer" containerID="ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0"
Jul 10 13:15:45.942632 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:15:45.942566    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0\": container with ID starting with ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0 not found: ID does not exist" containerID="ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0"
Jul 10 13:15:45.942741 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.942652    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0"} err="failed to get container status \"ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0\": rpc error: code = NotFound desc = could not find container \"ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0\": container with ID starting with ac077e019ea35dc3ecaf53a696297a824128822ff8833d06958aa6e808f74fe0 not found: ID does not exist"
Jul 10 13:15:45.956344 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.956315    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"]
Jul 10 13:15:45.961069 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:45.961046    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1bce492d-openshift-default-7fbd54b5f5-75rfq"]
Jul 10 13:15:46.409324 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:46.409217    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:46.486969 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:46.486911    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:46.662154 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:46.662076    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:46.761290 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:46.761254    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:47.156671 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:47.156636    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" path="/var/lib/kubelet/pods/20d2d6fd-3dbc-485a-8226-84c2e1f37ec1/volumes"
Jul 10 13:15:47.817715 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:47.817683    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:47.957759 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:47.957730    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:48.156619 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:48.156535    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:48.256981 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:48.256931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:48.688996 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:48.688967    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:48.789154 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:48.789127    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:50.273867 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:50.273843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:51.007208 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:51.007176    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:15:52.209196 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:52.209164    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:53.538313 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:53.538266    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:53.658844 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:53.658813    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:58.870433 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:58.870383    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:58.987745 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:58.987712    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:59.346621 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:59.346580    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:59.452081 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:59.452047    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:15:59.543165 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:15:59.543130    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:01.054210 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:01.054173    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:03.189635 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:03.189600    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:16:07.055485 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:07.055448    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:07.126993 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:07.126926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:07.231159 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:07.231125    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:07.334788 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:07.334678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:07.429367 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:07.429320    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:08.186882 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:08.186852    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:33.788348 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:33.788312    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:33.889057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:33.889022    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:34.188410 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:34.188381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:40.421683 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:40.421653    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:40.583448 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:40.583416    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:40.688499 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:40.688470    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:16:56.687360 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:16:56.687329    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:02.825667 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:02.825630    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:02.946843 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:02.946791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:03.038778 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:03.038746    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:13.607712 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:13.607675    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:14.411289 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:14.411249    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:20.400521 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:20.400447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:20.505390 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:20.505362    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:20.602789 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:20.602756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:20.701817 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:20.701771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:21.480593 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:21.480563    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:21.590359 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:21.590324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:21.693748 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:21.693720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:23.230292 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:23.230258    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:23.590677 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:23.590593    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:17:29.691729 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:29.691694    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:29.790516 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:29.790483    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:30.348447 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:30.348412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:32.789105 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:32.789074    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:17:36.789649 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:36.789618    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:36.890890 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:36.890862    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:37.003117 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.003081    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:37.323347 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.323313    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"]
Jul 10 13:17:37.323756 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.323734    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" containerName="istio-proxy"
Jul 10 13:17:37.323756 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.323752    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" containerName="istio-proxy"
Jul 10 13:17:37.323953 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.323849    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="20d2d6fd-3dbc-485a-8226-84c2e1f37ec1" containerName="istio-proxy"
Jul 10 13:17:37.327248 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.327229    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.330513 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.330493    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fb9fe4e8-openshift-default-dockercfg-ndmrr\""
Jul 10 13:17:37.330726 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.330710    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 13:17:37.338026 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.338004    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"]
Jul 10 13:17:37.355091 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.355070    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:37.365501 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-data\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.365598 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-podinfo\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.365598 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-token\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.365598 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e66efc8-ef08-4740-8c2c-a7af612d414e-istiod-ca-cert\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.365731 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365619    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-certs\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.365731 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365658    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-credential-socket\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.365731 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-socket\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.365731 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-envoy\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.365731 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.365711    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slv55\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-kube-api-access-slv55\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467025 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-credential-socket\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467035    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-socket\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-envoy\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467085    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slv55\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-kube-api-access-slv55\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467305 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-data\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467305 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467185    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-podinfo\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467305 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467212    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-token\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467454 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e66efc8-ef08-4740-8c2c-a7af612d414e-istiod-ca-cert\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467454 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-certs\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467454 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467445    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-credential-socket\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467606 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-socket\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467770 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-data\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.467890 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.467875    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-certs\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.468021 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.468003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e66efc8-ef08-4740-8c2c-a7af612d414e-istiod-ca-cert\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.469833 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.469813    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-envoy\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.470024 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.470008    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-podinfo\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.476610 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.476586    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-token\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.477933 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.477914    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slv55\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-kube-api-access-slv55\") pod \"e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") " pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.555521 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.555490    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:37.637527 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.637468    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:37.775728 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.775685    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"]
Jul 10 13:17:37.777933 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:17:37.777907    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e66efc8_ef08_4740_8c2c_a7af612d414e.slice/crio-e2d5c9d83f8745a59771fb9aae4af12b87c68361ccfa4c79aa70f6f0ac4de110 WatchSource:0}: Error finding container e2d5c9d83f8745a59771fb9aae4af12b87c68361ccfa4c79aa70f6f0ac4de110: Status 404 returned error can't find the container with id e2d5c9d83f8745a59771fb9aae4af12b87c68361ccfa4c79aa70f6f0ac4de110
Jul 10 13:17:37.784637 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.784602    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:17:37.784746 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.784665    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:17:37.784746 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:37.784693    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:17:38.370507 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:38.370469    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" event={"ID":"4e66efc8-ef08-4740-8c2c-a7af612d414e","Type":"ContainerStarted","Data":"e164af0fe00fbc869e64b1cb2c2f5eefa39e1dcab38f6c782798514415cb85cc"}
Jul 10 13:17:38.370893 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:38.370548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" event={"ID":"4e66efc8-ef08-4740-8c2c-a7af612d414e","Type":"ContainerStarted","Data":"e2d5c9d83f8745a59771fb9aae4af12b87c68361ccfa4c79aa70f6f0ac4de110"}
Jul 10 13:17:38.394021 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:38.393976    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" podStartSLOduration=1.393962093 podStartE2EDuration="1.393962093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:17:38.392787121 +0000 UTC m=+1905.910707428" watchObservedRunningTime="2026-07-10 13:17:38.393962093 +0000 UTC m=+1905.911882360"
Jul 10 13:17:38.638204 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:38.638128    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:38.642595 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:38.642565    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:39.375291 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:39.375264    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:39.376260 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:39.376237    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:40.301670 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:40.301632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:40.414817 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:40.414767    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:40.548031 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:40.547998    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:40.670984 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:40.670913    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:41.315937 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:41.315908    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:41.415341 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:41.415310    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:41.818360 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:41.818326    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:44.775896 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:44.775863    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:45.410122 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:45.410090    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:45.541456 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:45.541421    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:45.831014 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:45.830986    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:47.891411 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:47.891379    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:17:52.114135 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:52.114100    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:52.216419 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:52.216384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:52.565000 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:52.564966    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:53.026289 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:53.026244    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:53.121944 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:53.121906    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:55.417998 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:55.417953    2577 patch_prober.go:28] interesting pod/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 10 13:17:55.418387 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:55.418025    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 10 13:17:56.450168 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:56.450134    2577 generic.go:356] "Generic (PLEG): container finished" podID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerID="e164af0fe00fbc869e64b1cb2c2f5eefa39e1dcab38f6c782798514415cb85cc" exitCode=0
Jul 10 13:17:56.450588 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:56.450203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" event={"ID":"4e66efc8-ef08-4740-8c2c-a7af612d414e","Type":"ContainerDied","Data":"e164af0fe00fbc869e64b1cb2c2f5eefa39e1dcab38f6c782798514415cb85cc"}
Jul 10 13:17:56.450588 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:56.450543    2577 scope.go:117] "RemoveContainer" containerID="e164af0fe00fbc869e64b1cb2c2f5eefa39e1dcab38f6c782798514415cb85cc"
Jul 10 13:17:56.451551 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:56.451527    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:17:56.451603 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:56.451593    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:17:56.451642 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:56.451625    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:17:56.679146 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:56.679112    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:17:57.456552 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:57.456515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" event={"ID":"4e66efc8-ef08-4740-8c2c-a7af612d414e","Type":"ContainerStarted","Data":"495b8b474fe37287d3caec6f76024b96cda6d43153591f712dbc31f2ef7ab753"}
Jul 10 13:17:57.638906 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:57.638864    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:17:57.639112 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:57.639069    2577 patch_prober.go:28] interesting pod/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 10 13:17:57.639186 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:57.639124    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 10 13:17:58.638207 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:58.638168    2577 patch_prober.go:28] interesting pod/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Jul 10 13:17:58.638776 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:58.638744    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Jul 10 13:17:58.926489 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:58.926436    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:59.026958 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:59.026921    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:59.158556 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:59.158523    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"]
Jul 10 13:17:59.179665 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:59.179576    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:59.383946 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:59.383903    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:59.465475 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:59.465396    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy" containerID="cri-o://495b8b474fe37287d3caec6f76024b96cda6d43153591f712dbc31f2ef7ab753" gracePeriod=30
Jul 10 13:17:59.501429 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:59.501391    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:59.602134 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:59.602102    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:17:59.716556 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:17:59.716474    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:05.651521 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:05.651484    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:05.770932 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:05.770889    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:05.857283 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:05.857254    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:06.003834 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.003786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:06.497098 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.497065    2577 generic.go:356] "Generic (PLEG): container finished" podID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerID="495b8b474fe37287d3caec6f76024b96cda6d43153591f712dbc31f2ef7ab753" exitCode=0
Jul 10 13:18:06.497256 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.497134    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" event={"ID":"4e66efc8-ef08-4740-8c2c-a7af612d414e","Type":"ContainerDied","Data":"495b8b474fe37287d3caec6f76024b96cda6d43153591f712dbc31f2ef7ab753"}
Jul 10 13:18:06.497256 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.497207    2577 scope.go:117] "RemoveContainer" containerID="e164af0fe00fbc869e64b1cb2c2f5eefa39e1dcab38f6c782798514415cb85cc"
Jul 10 13:18:06.619182 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.619160    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:18:06.714418 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714391    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-token\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714427    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-certs\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714562    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-socket\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714622    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-data\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714648    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e66efc8-ef08-4740-8c2c-a7af612d414e-istiod-ca-cert\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714676    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-envoy\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714702    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slv55\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-kube-api-access-slv55\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714709    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714742    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-credential-socket\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714784    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-podinfo\") pod \"4e66efc8-ef08-4740-8c2c-a7af612d414e\" (UID: \"4e66efc8-ef08-4740-8c2c-a7af612d414e\") "
Jul 10 13:18:06.714858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.714854    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:18:06.715365 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.715052    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:18:06.715365 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.715066    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:06.715365 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.715083    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-workload-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:06.715517 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.715459    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e66efc8-ef08-4740-8c2c-a7af612d414e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:18:06.715874 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.715848    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-data" (OuterVolumeSpecName: "istio-data") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:18:06.717123 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.717091    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:18:06.717123 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.717111    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-token" (OuterVolumeSpecName: "istio-token") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:18:06.717431 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.717405    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 13:18:06.717431 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.717406    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-kube-api-access-slv55" (OuterVolumeSpecName: "kube-api-access-slv55") pod "4e66efc8-ef08-4740-8c2c-a7af612d414e" (UID: "4e66efc8-ef08-4740-8c2c-a7af612d414e"). InnerVolumeSpecName "kube-api-access-slv55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:18:06.815981 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.815955    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:06.815981 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.815978    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4e66efc8-ef08-4740-8c2c-a7af612d414e-istiod-ca-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:06.815981 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.815986    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-envoy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:06.816192 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.815994    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slv55\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-kube-api-access-slv55\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:06.816192 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.816003    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4e66efc8-ef08-4740-8c2c-a7af612d414e-credential-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:06.816192 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.816012    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-podinfo\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:06.816192 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:06.816030    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e66efc8-ef08-4740-8c2c-a7af612d414e-istio-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:18:07.503140 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:07.503102    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9" event={"ID":"4e66efc8-ef08-4740-8c2c-a7af612d414e","Type":"ContainerDied","Data":"e2d5c9d83f8745a59771fb9aae4af12b87c68361ccfa4c79aa70f6f0ac4de110"}
Jul 10 13:18:07.503320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:07.503151    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"
Jul 10 13:18:07.503320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:07.503162    2577 scope.go:117] "RemoveContainer" containerID="495b8b474fe37287d3caec6f76024b96cda6d43153591f712dbc31f2ef7ab753"
Jul 10 13:18:07.522967 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:07.522945    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"]
Jul 10 13:18:07.529614 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:07.529590    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fb9fe4e8-openshift-default-7b4bb986cf-76sc9"]
Jul 10 13:18:09.156271 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:09.156242    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" path="/var/lib/kubelet/pods/4e66efc8-ef08-4740-8c2c-a7af612d414e/volumes"
Jul 10 13:18:11.802186 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:11.802157    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:11.879535 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:11.879497    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:18.946448 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:18.946417    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:19.221606 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.221531    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"]
Jul 10 13:18:19.221848 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.221836    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy"
Jul 10 13:18:19.221897 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.221851    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy"
Jul 10 13:18:19.221935 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.221913    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy"
Jul 10 13:18:19.221935 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.221921    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy"
Jul 10 13:18:19.225976 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.225957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.228703 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.228683    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-6c7c4d1d-openshift-default-dockercfg-qqbbr\""
Jul 10 13:18:19.228897 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.228723    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 13:18:19.241290 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.241269    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"]
Jul 10 13:18:19.257583 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.257564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:19.311853 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.311826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-token\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.311969 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.311877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-credential-socket\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.312033 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.311980    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-socket\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.312033 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.312019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-podinfo\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.312149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.312081    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff80ac9-9592-46a3-a723-ed047e2e5818-istiod-ca-cert\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.312149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.312106    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt5sd\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-kube-api-access-zt5sd\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.312149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.312134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-certs\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.312287 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.312190    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-data\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.312287 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.312215    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-envoy\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413079 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-data\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413079 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-envoy\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413272 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413097    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-token\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413272 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413219    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-credential-socket\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413377 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413284    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-socket\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413377 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413327    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-podinfo\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413377 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff80ac9-9592-46a3-a723-ed047e2e5818-istiod-ca-cert\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413384    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt5sd\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-kube-api-access-zt5sd\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-certs\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413482    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-data\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413740 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413605    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-credential-socket\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413740 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413629    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-socket\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.413740 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.413694    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-certs\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.414046 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.414028    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff80ac9-9592-46a3-a723-ed047e2e5818-istiod-ca-cert\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.415467 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.415441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-envoy\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.415674 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.415658    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-podinfo\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.419348 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.419325    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:19.421434 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.421414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt5sd\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-kube-api-access-zt5sd\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.421517 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.421497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-token\") pod \"e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") " pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.535518 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.535451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:19.666790 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.666739    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"]
Jul 10 13:18:19.669003 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:18:19.668978    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff80ac9_9592_46a3_a723_ed047e2e5818.slice/crio-2609007f7b4f192bdc4b3fc3ce1d40833c18465bde7c1c41499dfd7f6ce63067 WatchSource:0}: Error finding container 2609007f7b4f192bdc4b3fc3ce1d40833c18465bde7c1c41499dfd7f6ce63067: Status 404 returned error can't find the container with id 2609007f7b4f192bdc4b3fc3ce1d40833c18465bde7c1c41499dfd7f6ce63067
Jul 10 13:18:19.671009 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.670971    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:18:19.671075 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.671044    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:18:19.671112 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:19.671074    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:18:20.557097 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:20.557056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" event={"ID":"3ff80ac9-9592-46a3-a723-ed047e2e5818","Type":"ContainerStarted","Data":"507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c"}
Jul 10 13:18:20.557497 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:20.557151    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" event={"ID":"3ff80ac9-9592-46a3-a723-ed047e2e5818","Type":"ContainerStarted","Data":"2609007f7b4f192bdc4b3fc3ce1d40833c18465bde7c1c41499dfd7f6ce63067"}
Jul 10 13:18:20.578666 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:20.578620    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" podStartSLOduration=1.5786078510000001 podStartE2EDuration="1.578607851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:18:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:18:20.576344295 +0000 UTC m=+1948.094264565" watchObservedRunningTime="2026-07-10 13:18:20.578607851 +0000 UTC m=+1948.096528118"
Jul 10 13:18:21.536253 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:21.536217    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:21.540961 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:21.540937    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:21.561139 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:21.561117    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:21.561758 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:21.561741    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:22.547767 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:22.547736    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:22.642796 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:22.642769    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:22.924829 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:22.924783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:23.023505 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:23.023460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:23.398678 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:23.398559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:23.496478 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:23.496440    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:26.962522 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:26.962490    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:27.483874 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:27.483836    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:18:35.619162 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:35.619124    2577 generic.go:356] "Generic (PLEG): container finished" podID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerID="507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c" exitCode=0
Jul 10 13:18:35.619621 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:35.619177    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" event={"ID":"3ff80ac9-9592-46a3-a723-ed047e2e5818","Type":"ContainerDied","Data":"507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c"}
Jul 10 13:18:35.619621 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:35.619545    2577 scope.go:117] "RemoveContainer" containerID="507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c"
Jul 10 13:18:35.620478 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:35.620448    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:18:35.620581 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:35.620517    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:18:35.620581 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:35.620550    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:18:36.561521 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:36.561468    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:36.628891 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:36.627971    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" event={"ID":"3ff80ac9-9592-46a3-a723-ed047e2e5818","Type":"ContainerStarted","Data":"60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51"}
Jul 10 13:18:37.537061 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:37.537024    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:37.537375 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:37.537351    2577 patch_prober.go:28] interesting pod/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 10 13:18:37.537559 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:37.537534    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 10 13:18:38.536314 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:38.536276    2577 patch_prober.go:28] interesting pod/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 10 13:18:38.536907 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:38.536874    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 10 13:18:39.536375 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.536333    2577 patch_prober.go:28] interesting pod/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Jul 10 13:18:39.536998 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.536959    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Jul 10 13:18:39.689162 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.689132    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"]
Jul 10 13:18:39.689446 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.689434    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy"
Jul 10 13:18:39.689487 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.689447    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e66efc8-ef08-4740-8c2c-a7af612d414e" containerName="istio-proxy"
Jul 10 13:18:39.693011 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.692996    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.696777 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.696752    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6c7c4d1d\"/\"kube-root-ca.crt\""
Jul 10 13:18:39.696943 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.696927    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6c7c4d1d\"/\"e2e-lifecycle-model-6c7c4d1d-kserve-self-signed-certs\""
Jul 10 13:18:39.697029 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.696950    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-6c7c4d1d\"/\"openshift-service-ca.crt\""
Jul 10 13:18:39.697029 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.696969    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-6c7c4d1d\"/\"default-dockercfg-msx6s\""
Jul 10 13:18:39.706329 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.706307    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"]
Jul 10 13:18:39.745537 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.745510    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:18:39.781826 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.781776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c9f6263-55e5-4ff4-9b4f-165432a63583-tls-certs\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.781960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.781863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-tmp-dir\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.781960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.781925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-model-cache\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.781960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.781949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gmqw\" (UniqueName: \"kubernetes.io/projected/7c9f6263-55e5-4ff4-9b4f-165432a63583-kube-api-access-8gmqw\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.782076 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.781983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-dshm\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.782076 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.782012    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-home\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883340 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883239    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-model-cache\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883340 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gmqw\" (UniqueName: \"kubernetes.io/projected/7c9f6263-55e5-4ff4-9b4f-165432a63583-kube-api-access-8gmqw\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883340 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-dshm\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883340 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883352    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-home\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883702 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c9f6263-55e5-4ff4-9b4f-165432a63583-tls-certs\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883702 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883393    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-tmp-dir\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883702 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-model-cache\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883885 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883787    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-home\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.883949 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.883883    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-tmp-dir\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.885635 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.885611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-dshm\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.885898 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.885878    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c9f6263-55e5-4ff4-9b4f-165432a63583-tls-certs\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:39.892641 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:39.892614    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gmqw\" (UniqueName: \"kubernetes.io/projected/7c9f6263-55e5-4ff4-9b4f-165432a63583-kube-api-access-8gmqw\") pod \"e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") " pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:40.002369 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:40.002333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:40.180940 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:40.180915    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"]
Jul 10 13:18:40.184343 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:18:40.184313    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c9f6263_55e5_4ff4_9b4f_165432a63583.slice/crio-e54799a9fb6b000ebe15a04a8338562fc074be187903376f4391593d0688db06 WatchSource:0}: Error finding container e54799a9fb6b000ebe15a04a8338562fc074be187903376f4391593d0688db06: Status 404 returned error can't find the container with id e54799a9fb6b000ebe15a04a8338562fc074be187903376f4391593d0688db06
Jul 10 13:18:40.539999 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:40.539922    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:40.540332 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:40.540178    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:40.540886 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:40.540869    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:18:40.651338 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:40.651301    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7" event={"ID":"7c9f6263-55e5-4ff4-9b4f-165432a63583","Type":"ContainerStarted","Data":"39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035"}
Jul 10 13:18:40.651514 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:40.651351    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7" event={"ID":"7c9f6263-55e5-4ff4-9b4f-165432a63583","Type":"ContainerStarted","Data":"e54799a9fb6b000ebe15a04a8338562fc074be187903376f4391593d0688db06"}
Jul 10 13:18:40.668533 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:40.668493    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7" podStartSLOduration=1.668478301 podStartE2EDuration="1.668478301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:18:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:18:40.667310455 +0000 UTC m=+1968.185230723" watchObservedRunningTime="2026-07-10 13:18:40.668478301 +0000 UTC m=+1968.186398595"
Jul 10 13:18:42.788267 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:42.788235    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:18:50.002687 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:50.002645    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:50.003121 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:50.002702    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:50.015039 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:50.015007    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:18:50.704660 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:18:50.704632    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:19:07.285615 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:07.285584    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:19:09.763140 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:09.763106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:19:10.234780 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:10.234747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:19:15.840401 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:15.840366    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:19:18.381104 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:18.381071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:19:20.814104 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:20.814073    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"]
Jul 10 13:19:20.911260 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:20.911229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:19:35.834230 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:35.834184    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7" podUID="7c9f6263-55e5-4ff4-9b4f-165432a63583" containerName="main" containerID="cri-o://39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035" gracePeriod=45
Jul 10 13:19:36.087086 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.087027    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:19:36.126474 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126440    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-model-cache\") pod \"7c9f6263-55e5-4ff4-9b4f-165432a63583\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") "
Jul 10 13:19:36.126654 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126501    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-tmp-dir\") pod \"7c9f6263-55e5-4ff4-9b4f-165432a63583\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") "
Jul 10 13:19:36.126654 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126550    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-home\") pod \"7c9f6263-55e5-4ff4-9b4f-165432a63583\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") "
Jul 10 13:19:36.126654 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126567    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gmqw\" (UniqueName: \"kubernetes.io/projected/7c9f6263-55e5-4ff4-9b4f-165432a63583-kube-api-access-8gmqw\") pod \"7c9f6263-55e5-4ff4-9b4f-165432a63583\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") "
Jul 10 13:19:36.126654 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126616    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c9f6263-55e5-4ff4-9b4f-165432a63583-tls-certs\") pod \"7c9f6263-55e5-4ff4-9b4f-165432a63583\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") "
Jul 10 13:19:36.126654 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126636    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-dshm\") pod \"7c9f6263-55e5-4ff4-9b4f-165432a63583\" (UID: \"7c9f6263-55e5-4ff4-9b4f-165432a63583\") "
Jul 10 13:19:36.127175 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126753    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c9f6263-55e5-4ff4-9b4f-165432a63583" (UID: "7c9f6263-55e5-4ff4-9b4f-165432a63583"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:19:36.127175 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126815    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-home" (OuterVolumeSpecName: "home") pod "7c9f6263-55e5-4ff4-9b4f-165432a63583" (UID: "7c9f6263-55e5-4ff4-9b4f-165432a63583"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:19:36.127175 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126851    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c9f6263-55e5-4ff4-9b4f-165432a63583" (UID: "7c9f6263-55e5-4ff4-9b4f-165432a63583"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:19:36.127175 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126919    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:19:36.127175 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126935    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:19:36.127175 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.126944    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:19:36.129033 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.129010    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c9f6263-55e5-4ff4-9b4f-165432a63583-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c9f6263-55e5-4ff4-9b4f-165432a63583" (UID: "7c9f6263-55e5-4ff4-9b4f-165432a63583"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:19:36.129167 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.129153    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-dshm" (OuterVolumeSpecName: "dshm") pod "7c9f6263-55e5-4ff4-9b4f-165432a63583" (UID: "7c9f6263-55e5-4ff4-9b4f-165432a63583"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:19:36.129228 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.129193    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c9f6263-55e5-4ff4-9b4f-165432a63583-kube-api-access-8gmqw" (OuterVolumeSpecName: "kube-api-access-8gmqw") pod "7c9f6263-55e5-4ff4-9b4f-165432a63583" (UID: "7c9f6263-55e5-4ff4-9b4f-165432a63583"). InnerVolumeSpecName "kube-api-access-8gmqw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:19:36.227977 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.227941    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gmqw\" (UniqueName: \"kubernetes.io/projected/7c9f6263-55e5-4ff4-9b4f-165432a63583-kube-api-access-8gmqw\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:19:36.227977 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.227974    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c9f6263-55e5-4ff4-9b4f-165432a63583-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:19:36.228155 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.227989    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c9f6263-55e5-4ff4-9b4f-165432a63583-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:19:36.885435 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.885401    2577 generic.go:356] "Generic (PLEG): container finished" podID="7c9f6263-55e5-4ff4-9b4f-165432a63583" containerID="39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035" exitCode=0
Jul 10 13:19:36.885858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.885445    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"
Jul 10 13:19:36.885858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.885465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7" event={"ID":"7c9f6263-55e5-4ff4-9b4f-165432a63583","Type":"ContainerDied","Data":"39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035"}
Jul 10 13:19:36.885858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.885495    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7" event={"ID":"7c9f6263-55e5-4ff4-9b4f-165432a63583","Type":"ContainerDied","Data":"e54799a9fb6b000ebe15a04a8338562fc074be187903376f4391593d0688db06"}
Jul 10 13:19:36.885858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.885511    2577 scope.go:117] "RemoveContainer" containerID="39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035"
Jul 10 13:19:36.895861 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.895768    2577 scope.go:117] "RemoveContainer" containerID="39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035"
Jul 10 13:19:36.896383 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:19:36.896353    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035\": container with ID starting with 39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035 not found: ID does not exist" containerID="39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035"
Jul 10 13:19:36.896478 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.896390    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035"} err="failed to get container status \"39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035\": rpc error: code = NotFound desc = could not find container \"39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035\": container with ID starting with 39bd14b095a17c531c010b2b32ad3216c556037f48e1eac9978945e8fd314035 not found: ID does not exist"
Jul 10 13:19:36.908289 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.908267    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"]
Jul 10 13:19:36.912749 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:36.912733    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-6c7c4d1d/e2e-lifecycle-model-6c7c4d1d-kserve-6f7db7b6c5-ctcz7"]
Jul 10 13:19:37.156725 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:37.156651    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c9f6263-55e5-4ff4-9b4f-165432a63583" path="/var/lib/kubelet/pods/7c9f6263-55e5-4ff4-9b4f-165432a63583/volumes"
Jul 10 13:19:40.123551 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:40.123518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:19:40.223735 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:40.223705    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:19:57.221903 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:57.221866    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:19:57.282098 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:57.282039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:19:58.229409 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:19:58.229378    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:00.488701 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:00.488668    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:20:03.913777 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:03.913744    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:04.015109 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:04.015079    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:04.203172 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:04.203139    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"]
Jul 10 13:20:04.203408 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:04.203383    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy" containerID="cri-o://60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51" gracePeriod=30
Jul 10 13:20:04.227506 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:04.227476    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:04.463119 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:04.463018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:08.927116 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:08.927077    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:09.027565 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.027537    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:09.128821 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.128767    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:09.448543 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.448519    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:20:09.493618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.493558    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-data\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.493618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.493601    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-podinfo\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.493826 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.493623    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-token\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.493826 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.493637    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-socket\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.493941 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.493890    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:20:09.494003 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.493940    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-certs\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.494057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494011    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt5sd\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-kube-api-access-zt5sd\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.494108 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494080    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:20:09.494181 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494163    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff80ac9-9592-46a3-a723-ed047e2e5818-istiod-ca-cert\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.494233 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494219    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-envoy\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.494288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494267    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-credential-socket\") pod \"3ff80ac9-9592-46a3-a723-ed047e2e5818\" (UID: \"3ff80ac9-9592-46a3-a723-ed047e2e5818\") "
Jul 10 13:20:09.494626 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494494    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-data" (OuterVolumeSpecName: "istio-data") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:20:09.494626 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494521    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ff80ac9-9592-46a3-a723-ed047e2e5818-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:20:09.494845 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494743    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.494845 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494758    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:20:09.494845 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494767    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3ff80ac9-9592-46a3-a723-ed047e2e5818-istiod-ca-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.494845 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494815    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.494845 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.494833    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-workload-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.496073 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.496047    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 13:20:09.496208 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.496178    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-kube-api-access-zt5sd" (OuterVolumeSpecName: "kube-api-access-zt5sd") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "kube-api-access-zt5sd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:20:09.496367 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.496347    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-token" (OuterVolumeSpecName: "istio-token") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:20:09.496742 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.496720    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3ff80ac9-9592-46a3-a723-ed047e2e5818" (UID: "3ff80ac9-9592-46a3-a723-ed047e2e5818"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:20:09.595977 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.595952    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt5sd\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-kube-api-access-zt5sd\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.595977 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.595974    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-envoy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.596135 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.595982    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3ff80ac9-9592-46a3-a723-ed047e2e5818-credential-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.596135 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.595992    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-podinfo\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.596135 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.596000    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3ff80ac9-9592-46a3-a723-ed047e2e5818-istio-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:20:09.622665 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.622642    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:20:09.851769 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.851685    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:09.952882 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:09.952853    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:10.021710 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.021680    2577 generic.go:356] "Generic (PLEG): container finished" podID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerID="60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51" exitCode=0
Jul 10 13:20:10.021875 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.021728    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"
Jul 10 13:20:10.021875 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.021765    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" event={"ID":"3ff80ac9-9592-46a3-a723-ed047e2e5818","Type":"ContainerDied","Data":"60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51"}
Jul 10 13:20:10.021875 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.021839    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7" event={"ID":"3ff80ac9-9592-46a3-a723-ed047e2e5818","Type":"ContainerDied","Data":"2609007f7b4f192bdc4b3fc3ce1d40833c18465bde7c1c41499dfd7f6ce63067"}
Jul 10 13:20:10.021875 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.021863    2577 scope.go:117] "RemoveContainer" containerID="60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51"
Jul 10 13:20:10.030323 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.030299    2577 scope.go:117] "RemoveContainer" containerID="507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c"
Jul 10 13:20:10.039846 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.039829    2577 scope.go:117] "RemoveContainer" containerID="60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51"
Jul 10 13:20:10.040106 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:20:10.040087    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51\": container with ID starting with 60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51 not found: ID does not exist" containerID="60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51"
Jul 10 13:20:10.040159 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.040114    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51"} err="failed to get container status \"60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51\": rpc error: code = NotFound desc = could not find container \"60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51\": container with ID starting with 60be2f2ecfdfa284dab56f9faacdaa6ef815cb63e27700da2029655312302d51 not found: ID does not exist"
Jul 10 13:20:10.040159 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.040132    2577 scope.go:117] "RemoveContainer" containerID="507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c"
Jul 10 13:20:10.040404 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:20:10.040376    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c\": container with ID starting with 507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c not found: ID does not exist" containerID="507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c"
Jul 10 13:20:10.040457 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.040402    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c"} err="failed to get container status \"507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c\": rpc error: code = NotFound desc = could not find container \"507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c\": container with ID starting with 507df5dd49d3f5adcbf281ef5429263db0eda4a795beedf57605249a09a5bd0c not found: ID does not exist"
Jul 10 13:20:10.051603 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.051577    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:10.052371 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.052353    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"]
Jul 10 13:20:10.054903 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:10.054885    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-6c7c4d1d-openshift-default-76964c4b7-xjnb7"]
Jul 10 13:20:11.156149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:11.156118    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" path="/var/lib/kubelet/pods/3ff80ac9-9592-46a3-a723-ed047e2e5818/volumes"
Jul 10 13:20:11.521750 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:11.521715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:17.904237 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:17.904154    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:17.969486 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:17.969453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:18.597988 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:18.597955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:20.480506 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:20.480473    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:20:24.456126 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:24.456088    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:24.568166 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:24.568132    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:24.656628 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:24.656587    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:35.212558 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:35.212515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:35.580820 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:35.580718    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:20:56.879679 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:20:56.879650    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:02.932025 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:02.931989    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:03.027767 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.027724    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:03.268151 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.268069    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:03.566650 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566565    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"]
Jul 10 13:21:03.566880 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566868    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c9f6263-55e5-4ff4-9b4f-165432a63583" containerName="main"
Jul 10 13:21:03.566927 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566882    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c9f6263-55e5-4ff4-9b4f-165432a63583" containerName="main"
Jul 10 13:21:03.566927 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566895    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy"
Jul 10 13:21:03.566927 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566901    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy"
Jul 10 13:21:03.566927 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566909    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy"
Jul 10 13:21:03.566927 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566914    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy"
Jul 10 13:21:03.567079 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566969    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy"
Jul 10 13:21:03.567079 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.566977    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c9f6263-55e5-4ff4-9b4f-165432a63583" containerName="main"
Jul 10 13:21:03.569734 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.569718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.572415 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.572395    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 13:21:03.572549 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.572457    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-9a834f-openshift-default-dockercfg-46lqk\""
Jul 10 13:21:03.585384 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.585356    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"]
Jul 10 13:21:03.593160 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.593132    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:03.622016 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.621986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-token\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.622158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.622024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-credential-socket\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.622158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.622052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istiod-ca-cert\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.622158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.622125    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-socket\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.622310 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.622162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-data\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.622310 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.622207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-certs\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.622310 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.622247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-podinfo\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.622408 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.622303    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-envoy\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.622408 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.622337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz24g\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-kube-api-access-bz24g\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723281    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-podinfo\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-envoy\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723569 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723344    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz24g\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-kube-api-access-bz24g\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723569 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-token\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723569 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723489    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-credential-socket\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723569 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istiod-ca-cert\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723784 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-socket\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723784 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-data\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.723784 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.723663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-certs\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.724029 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.724006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-credential-socket\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.724100 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.724071    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-data\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.724158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.724114    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-socket\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.724158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.724148    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-certs\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.724408 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.724385    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istiod-ca-cert\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.725901 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.725875    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-podinfo\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.726031 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.726012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-envoy\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.731475 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.731446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-token\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.731696 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.731681    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz24g\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-kube-api-access-bz24g\") pod \"e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") " pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.879832 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.879722    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:03.882555 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:03.882527    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:04.010975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:04.010930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"]
Jul 10 13:21:04.013384 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:21:04.013358    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6319ebdf_eecf_42c6_b360_2dbd6e645cde.slice/crio-d7f0528cd60e49b618ab30c8bc502ded2449ffd557c852295a411e6831b995e9 WatchSource:0}: Error finding container d7f0528cd60e49b618ab30c8bc502ded2449ffd557c852295a411e6831b995e9: Status 404 returned error can't find the container with id d7f0528cd60e49b618ab30c8bc502ded2449ffd557c852295a411e6831b995e9
Jul 10 13:21:04.015501 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:04.015472    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:21:04.015568 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:04.015541    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:21:04.015605 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:04.015568    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:21:04.243442 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:04.243406    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" event={"ID":"6319ebdf-eecf-42c6-b360-2dbd6e645cde","Type":"ContainerStarted","Data":"cdfdb04201a4688c43e9786f03b14edeb1b60584c0d484452d6ae135d0394129"}
Jul 10 13:21:04.243638 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:04.243468    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" event={"ID":"6319ebdf-eecf-42c6-b360-2dbd6e645cde","Type":"ContainerStarted","Data":"d7f0528cd60e49b618ab30c8bc502ded2449ffd557c852295a411e6831b995e9"}
Jul 10 13:21:04.263875 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:04.263824    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" podStartSLOduration=1.263782385 podStartE2EDuration="1.263782385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:21:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:21:04.262481179 +0000 UTC m=+2111.780401447" watchObservedRunningTime="2026-07-10 13:21:04.263782385 +0000 UTC m=+2111.781702651"
Jul 10 13:21:04.880241 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:04.880203    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:05.884920 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:05.884895    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:06.251301 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:06.251268    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:06.252265 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:06.252247    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:06.379294 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:06.379264    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:06.478299 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:06.478269    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:06.760416 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:06.760379    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:06.960091 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:06.960050    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:07.257496 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:07.257456    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:07.360528 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:07.360499    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:10.933540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:10.933514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:11.327581 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:11.327477    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:11.740743 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:11.740711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:11.839698 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:11.839667    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:14.281740 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:14.281712    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:21:14.788554 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:14.788514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:14.885220 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:14.885183    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:14.955955 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:14.955925    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:15.167563 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:15.167490    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:15.457212 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:15.457183    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:15.558952 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:15.558918    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:19.259095 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:19.259064    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:21.921296 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:21.920613    2577 patch_prober.go:28] interesting pod/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:53784->10.133.0.32:15021: read: connection reset by peer" start-of-body=
Jul 10 13:21:21.921296 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:21.920697    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": read tcp 10.133.0.2:53784->10.133.0.32:15021: read: connection reset by peer"
Jul 10 13:21:22.316002 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:22.315967    2577 generic.go:356] "Generic (PLEG): container finished" podID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerID="cdfdb04201a4688c43e9786f03b14edeb1b60584c0d484452d6ae135d0394129" exitCode=0
Jul 10 13:21:22.316176 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:22.316043    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" event={"ID":"6319ebdf-eecf-42c6-b360-2dbd6e645cde","Type":"ContainerDied","Data":"cdfdb04201a4688c43e9786f03b14edeb1b60584c0d484452d6ae135d0394129"}
Jul 10 13:21:22.316430 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:22.316417    2577 scope.go:117] "RemoveContainer" containerID="cdfdb04201a4688c43e9786f03b14edeb1b60584c0d484452d6ae135d0394129"
Jul 10 13:21:22.317379 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:22.317352    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:21:22.317484 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:22.317431    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:21:22.317547 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:22.317484    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:21:23.322845 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:23.322782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" event={"ID":"6319ebdf-eecf-42c6-b360-2dbd6e645cde","Type":"ContainerStarted","Data":"746ef392cc64fa6974a86c8223e1ad9f6110614daa3cab3e4cbac83b318fbf36"}
Jul 10 13:21:23.880273 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:23.880231    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:23.880517 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:23.880498    2577 patch_prober.go:28] interesting pod/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 10 13:21:23.880560 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:23.880540    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 10 13:21:24.880940 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:24.880901    2577 patch_prober.go:28] interesting pod/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 10 13:21:24.881308 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:24.880963    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 10 13:21:25.880304 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.880272    2577 patch_prober.go:28] interesting pod/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 10 13:21:25.880498 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.880330    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 10 13:21:25.898627 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.898601    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"]
Jul 10 13:21:25.898976 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.898951    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ff80ac9-9592-46a3-a723-ed047e2e5818" containerName="istio-proxy"
Jul 10 13:21:25.902484 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.902466    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:25.905057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.905039    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9a834f\"/\"test-model-9a834f-kserve-self-signed-certs\""
Jul 10 13:21:25.906382 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.906363    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9a834f\"/\"openshift-service-ca.crt\""
Jul 10 13:21:25.906476 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.906433    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9a834f\"/\"default-dockercfg-k87d6\""
Jul 10 13:21:25.906551 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.906472    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9a834f\"/\"kube-root-ca.crt\""
Jul 10 13:21:25.911074 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.911053    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"]
Jul 10 13:21:25.986229 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:25.986192    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:26.017220 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.017192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfdsq\" (UniqueName: \"kubernetes.io/projected/2165902b-af0a-463d-97c6-af3437a92a66-kube-api-access-kfdsq\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.017345 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.017242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-dshm\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.017345 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.017271    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-tmp-dir\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.017345 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.017287    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2165902b-af0a-463d-97c6-af3437a92a66-tls-certs\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.017345 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.017318    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-home\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.017345 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.017337    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-model-cache\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.118649 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.118616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-home\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.118828 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.118655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-model-cache\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.118828 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.118723    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfdsq\" (UniqueName: \"kubernetes.io/projected/2165902b-af0a-463d-97c6-af3437a92a66-kube-api-access-kfdsq\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.118828 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.118742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-dshm\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.118828 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.118759    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-tmp-dir\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.119054 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.118822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2165902b-af0a-463d-97c6-af3437a92a66-tls-certs\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.119118 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.119073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-home\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.119174 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.119120    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-model-cache\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.119174 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.119152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-tmp-dir\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.127119 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.127089    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-dshm\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.127328 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.127302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2165902b-af0a-463d-97c6-af3437a92a66-tls-certs\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.130857 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.129217    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfdsq\" (UniqueName: \"kubernetes.io/projected/2165902b-af0a-463d-97c6-af3437a92a66-kube-api-access-kfdsq\") pod \"test-model-9a834f-kserve-664bc8cf5f-xw866\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") " pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.212298 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.212265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:26.386241 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.386096    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"]
Jul 10 13:21:26.388775 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:21:26.388747    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2165902b_af0a_463d_97c6_af3437a92a66.slice/crio-b1b3e16fcb0c467b9a92ef36cb018768dfd7dfd95041ef67d406515e2cbe5420 WatchSource:0}: Error finding container b1b3e16fcb0c467b9a92ef36cb018768dfd7dfd95041ef67d406515e2cbe5420: Status 404 returned error can't find the container with id b1b3e16fcb0c467b9a92ef36cb018768dfd7dfd95041ef67d406515e2cbe5420
Jul 10 13:21:26.880468 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.880435    2577 patch_prober.go:28] interesting pod/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 10 13:21:26.880643 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:26.880485    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 10 13:21:27.359966 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:27.359929    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866" event={"ID":"2165902b-af0a-463d-97c6-af3437a92a66","Type":"ContainerStarted","Data":"38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405"}
Jul 10 13:21:27.360342 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:27.359973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866" event={"ID":"2165902b-af0a-463d-97c6-af3437a92a66","Type":"ContainerStarted","Data":"b1b3e16fcb0c467b9a92ef36cb018768dfd7dfd95041ef67d406515e2cbe5420"}
Jul 10 13:21:27.378102 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:27.378055    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866" podStartSLOduration=2.378041936 podStartE2EDuration="2.378041936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:21:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:21:27.376576709 +0000 UTC m=+2134.894496976" watchObservedRunningTime="2026-07-10 13:21:27.378041936 +0000 UTC m=+2134.895962209"
Jul 10 13:21:27.878761 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:27.878724    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:21:27.883591 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:27.883564    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:27.883835 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:27.883811    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:27.884384 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:27.884366    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:21:28.279833 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:28.279785    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:28.379960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:28.379926    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:36.212729 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:36.212686    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:36.213152 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:36.212743    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:36.225346 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:36.225319    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:36.408723 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:36.408693    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:21:37.305105 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:37.305074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:37.403361 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:37.403331    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:45.080640 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:45.080602    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:21:48.575271 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.575240    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"]
Jul 10 13:21:48.578529 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.578514    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.582185 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.582158    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-76c01a\"/\"test-model-76c01a-kserve-self-signed-certs\""
Jul 10 13:21:48.582185 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.582172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-76c01a\"/\"default-dockercfg-6bs2k\""
Jul 10 13:21:48.582358 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.582233    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-76c01a\"/\"kube-root-ca.crt\""
Jul 10 13:21:48.582358 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.582280    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-76c01a\"/\"openshift-service-ca.crt\""
Jul 10 13:21:48.588259 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.588238    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"]
Jul 10 13:21:48.610482 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.610453    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:48.720972 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.720943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-dshm\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.721101 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.720991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8b29\" (UniqueName: \"kubernetes.io/projected/579f13d7-6b41-415c-a507-b0907d058310-kube-api-access-c8b29\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.721101 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.721019    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-model-cache\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.721101 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.721073    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-home\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.721233 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.721098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-tmp-dir\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.721233 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.721138    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/579f13d7-6b41-415c-a507-b0907d058310-tls-certs\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822183 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822160    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-home\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822324 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-tmp-dir\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822324 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/579f13d7-6b41-415c-a507-b0907d058310-tls-certs\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822324 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822244    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-dshm\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822324 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822278    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8b29\" (UniqueName: \"kubernetes.io/projected/579f13d7-6b41-415c-a507-b0907d058310-kube-api-access-c8b29\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822324 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-model-cache\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822598    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-tmp-dir\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822700 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822644    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-home\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.822740 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.822713    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-model-cache\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.824503 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.824485    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-dshm\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.824762 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.824745    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/579f13d7-6b41-415c-a507-b0907d058310-tls-certs\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.830491 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.830438    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8b29\" (UniqueName: \"kubernetes.io/projected/579f13d7-6b41-415c-a507-b0907d058310-kube-api-access-c8b29\") pod \"test-model-76c01a-kserve-8cdb45fc-vv9ck\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") " pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:48.888203 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:48.888179    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:49.017972 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:49.017943    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"]
Jul 10 13:21:49.020400 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:21:49.020375    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod579f13d7_6b41_415c_a507_b0907d058310.slice/crio-24a5d024a2700748c2ab0a0565846eea10ecee966e521b4f55c6a98ce5878cbb WatchSource:0}: Error finding container 24a5d024a2700748c2ab0a0565846eea10ecee966e521b4f55c6a98ce5878cbb: Status 404 returned error can't find the container with id 24a5d024a2700748c2ab0a0565846eea10ecee966e521b4f55c6a98ce5878cbb
Jul 10 13:21:49.454222 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:49.454181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck" event={"ID":"579f13d7-6b41-415c-a507-b0907d058310","Type":"ContainerStarted","Data":"e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967"}
Jul 10 13:21:49.454430 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:49.454235    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck" event={"ID":"579f13d7-6b41-415c-a507-b0907d058310","Type":"ContainerStarted","Data":"24a5d024a2700748c2ab0a0565846eea10ecee966e521b4f55c6a98ce5878cbb"}
Jul 10 13:21:49.473478 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:49.473415    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck" podStartSLOduration=1.473400396 podStartE2EDuration="1.473400396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:21:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:21:49.473295717 +0000 UTC m=+2156.991216006" watchObservedRunningTime="2026-07-10 13:21:49.473400396 +0000 UTC m=+2156.991320663"
Jul 10 13:21:53.856560 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:53.856527    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:21:55.283903 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:55.283869    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:21:58.888389 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:58.888353    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:58.888389 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:58.888397    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:58.900972 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:58.900945    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:21:59.509366 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:21:59.509339    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:22:07.115710 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:07.115678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:07.467739 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:07.467711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:07.905587 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:07.905516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:10.137062 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:10.137018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:10.237787 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:10.237756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:10.312740 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:10.312704    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:10.497763 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:10.497725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:10.935988 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:10.935959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:11.040689 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:11.040659    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:14.595943 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:14.595914    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:18.379617 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.379584    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"]
Jul 10 13:22:18.382847 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.382828    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.386911 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.386886    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-0fbd6d\"/\"default-dockercfg-jbdhr\""
Jul 10 13:22:18.386911 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.386901    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-0fbd6d\"/\"openshift-service-ca.crt\""
Jul 10 13:22:18.387111 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.386926    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-0fbd6d\"/\"kube-root-ca.crt\""
Jul 10 13:22:18.387111 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.386903    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-0fbd6d\"/\"test-model-0fbd6d-kserve-self-signed-certs\""
Jul 10 13:22:18.393009 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.392988    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"]
Jul 10 13:22:18.405361 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.405330    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:18.469157 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.469135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-tmp-dir\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.469257 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.469167    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-home\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.469257 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.469184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63bce3cc-e8ba-43cd-9b8d-344312180df5-tls-certs\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.469332 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.469264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-dshm\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.469332 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.469289    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-model-cache\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.469332 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.469306    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wft6k\" (UniqueName: \"kubernetes.io/projected/63bce3cc-e8ba-43cd-9b8d-344312180df5-kube-api-access-wft6k\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570051 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570024    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-home\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570051 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63bce3cc-e8ba-43cd-9b8d-344312180df5-tls-certs\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570200 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-dshm\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570200 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-model-cache\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570200 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wft6k\" (UniqueName: \"kubernetes.io/projected/63bce3cc-e8ba-43cd-9b8d-344312180df5-kube-api-access-wft6k\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570200 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-tmp-dir\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570463 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570442    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-home\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570571 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-model-cache\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.570639 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.570580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-tmp-dir\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.572416 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.572393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-dshm\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.572604 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.572583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63bce3cc-e8ba-43cd-9b8d-344312180df5-tls-certs\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.583517 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.583491    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wft6k\" (UniqueName: \"kubernetes.io/projected/63bce3cc-e8ba-43cd-9b8d-344312180df5-kube-api-access-wft6k\") pod \"test-model-0fbd6d-kserve-c6db9d557-649hl\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.691484 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.691448    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:18.829348 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:18.829312    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"]
Jul 10 13:22:18.832135 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:22:18.832104    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod63bce3cc_e8ba_43cd_9b8d_344312180df5.slice/crio-3f004ccd739d8cc90ba487853ae0bf537af7d49a632c7b107091074860d0884b WatchSource:0}: Error finding container 3f004ccd739d8cc90ba487853ae0bf537af7d49a632c7b107091074860d0884b: Status 404 returned error can't find the container with id 3f004ccd739d8cc90ba487853ae0bf537af7d49a632c7b107091074860d0884b
Jul 10 13:22:19.591173 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:19.591143    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl" event={"ID":"63bce3cc-e8ba-43cd-9b8d-344312180df5","Type":"ContainerStarted","Data":"f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56"}
Jul 10 13:22:19.591545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:19.591182    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl" event={"ID":"63bce3cc-e8ba-43cd-9b8d-344312180df5","Type":"ContainerStarted","Data":"3f004ccd739d8cc90ba487853ae0bf537af7d49a632c7b107091074860d0884b"}
Jul 10 13:22:19.608697 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:19.608647    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl" podStartSLOduration=1.608633015 podStartE2EDuration="1.608633015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:22:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:22:19.608537459 +0000 UTC m=+2187.126457731" watchObservedRunningTime="2026-07-10 13:22:19.608633015 +0000 UTC m=+2187.126553281"
Jul 10 13:22:22.472491 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:22.472452    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:22:28.692156 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:28.692103    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:28.692156 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:28.692164    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:28.704459 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:28.704427    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:29.644008 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:29.643974    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:22:46.085097 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:46.085065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:46.521177 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:46.521141    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:46.621535 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:46.621500    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:51.490300 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:51.490266    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"]
Jul 10 13:22:51.585848 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:51.585818    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:22:52.174000 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:22:52.173965    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:23:06.510894 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.510850    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl" podUID="63bce3cc-e8ba-43cd-9b8d-344312180df5" containerName="main" containerID="cri-o://f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56" gracePeriod=45
Jul 10 13:23:06.764216 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.764158    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:23:06.796695 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.796662    2577 generic.go:356] "Generic (PLEG): container finished" podID="63bce3cc-e8ba-43cd-9b8d-344312180df5" containerID="f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56" exitCode=0
Jul 10 13:23:06.796918 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.796706    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"
Jul 10 13:23:06.796918 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.796752    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl" event={"ID":"63bce3cc-e8ba-43cd-9b8d-344312180df5","Type":"ContainerDied","Data":"f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56"}
Jul 10 13:23:06.796918 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.796823    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl" event={"ID":"63bce3cc-e8ba-43cd-9b8d-344312180df5","Type":"ContainerDied","Data":"3f004ccd739d8cc90ba487853ae0bf537af7d49a632c7b107091074860d0884b"}
Jul 10 13:23:06.796918 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.796852    2577 scope.go:117] "RemoveContainer" containerID="f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56"
Jul 10 13:23:06.805132 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.805112    2577 scope.go:117] "RemoveContainer" containerID="f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56"
Jul 10 13:23:06.805421 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:23:06.805394    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56\": container with ID starting with f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56 not found: ID does not exist" containerID="f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56"
Jul 10 13:23:06.805494 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.805432    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56"} err="failed to get container status \"f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56\": rpc error: code = NotFound desc = could not find container \"f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56\": container with ID starting with f87cb19244fa5a6c0a77af3feba0f4587634da27edf982c5139eb30591fbef56 not found: ID does not exist"
Jul 10 13:23:06.862911 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.862882    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-tmp-dir\") pod \"63bce3cc-e8ba-43cd-9b8d-344312180df5\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") "
Jul 10 13:23:06.862911 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.862921    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-home\") pod \"63bce3cc-e8ba-43cd-9b8d-344312180df5\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") "
Jul 10 13:23:06.863158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.862962    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wft6k\" (UniqueName: \"kubernetes.io/projected/63bce3cc-e8ba-43cd-9b8d-344312180df5-kube-api-access-wft6k\") pod \"63bce3cc-e8ba-43cd-9b8d-344312180df5\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") "
Jul 10 13:23:06.863158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.863036    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-dshm\") pod \"63bce3cc-e8ba-43cd-9b8d-344312180df5\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") "
Jul 10 13:23:06.863158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.863088    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63bce3cc-e8ba-43cd-9b8d-344312180df5-tls-certs\") pod \"63bce3cc-e8ba-43cd-9b8d-344312180df5\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") "
Jul 10 13:23:06.863158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.863134    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-model-cache\") pod \"63bce3cc-e8ba-43cd-9b8d-344312180df5\" (UID: \"63bce3cc-e8ba-43cd-9b8d-344312180df5\") "
Jul 10 13:23:06.863158 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.863148    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-home" (OuterVolumeSpecName: "home") pod "63bce3cc-e8ba-43cd-9b8d-344312180df5" (UID: "63bce3cc-e8ba-43cd-9b8d-344312180df5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:23:06.863393 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.863183    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "63bce3cc-e8ba-43cd-9b8d-344312180df5" (UID: "63bce3cc-e8ba-43cd-9b8d-344312180df5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:23:06.863447 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.863398    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:23:06.863447 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.863416    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:23:06.863447 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.863436    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-model-cache" (OuterVolumeSpecName: "model-cache") pod "63bce3cc-e8ba-43cd-9b8d-344312180df5" (UID: "63bce3cc-e8ba-43cd-9b8d-344312180df5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:23:06.865155 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.865124    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-dshm" (OuterVolumeSpecName: "dshm") pod "63bce3cc-e8ba-43cd-9b8d-344312180df5" (UID: "63bce3cc-e8ba-43cd-9b8d-344312180df5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:23:06.865267 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.865191    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63bce3cc-e8ba-43cd-9b8d-344312180df5-kube-api-access-wft6k" (OuterVolumeSpecName: "kube-api-access-wft6k") pod "63bce3cc-e8ba-43cd-9b8d-344312180df5" (UID: "63bce3cc-e8ba-43cd-9b8d-344312180df5"). InnerVolumeSpecName "kube-api-access-wft6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:23:06.865267 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.865211    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63bce3cc-e8ba-43cd-9b8d-344312180df5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "63bce3cc-e8ba-43cd-9b8d-344312180df5" (UID: "63bce3cc-e8ba-43cd-9b8d-344312180df5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:23:06.964316 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.964281    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wft6k\" (UniqueName: \"kubernetes.io/projected/63bce3cc-e8ba-43cd-9b8d-344312180df5-kube-api-access-wft6k\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:23:06.964316 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.964315    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:23:06.964499 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.964335    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63bce3cc-e8ba-43cd-9b8d-344312180df5-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:23:06.964499 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:06.964349    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63bce3cc-e8ba-43cd-9b8d-344312180df5-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:23:07.122824 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:07.118884    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"]
Jul 10 13:23:07.125964 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:07.125941    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-649hl"]
Jul 10 13:23:07.156062 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:07.156034    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63bce3cc-e8ba-43cd-9b8d-344312180df5" path="/var/lib/kubelet/pods/63bce3cc-e8ba-43cd-9b8d-344312180df5/volumes"
Jul 10 13:23:28.213970 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:28.213887    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:28.729665 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:28.729629    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:34.282757 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:34.282726    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:23:34.456023 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:34.455988    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:34.559154 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:34.559071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:34.762884 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:34.762847    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:35.353107 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:35.353074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:35.709711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:35.709680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:36.023596 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.023518    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"]
Jul 10 13:23:36.023839 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.023826    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63bce3cc-e8ba-43cd-9b8d-344312180df5" containerName="main"
Jul 10 13:23:36.023893 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.023841    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="63bce3cc-e8ba-43cd-9b8d-344312180df5" containerName="main"
Jul 10 13:23:36.023925 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.023910    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="63bce3cc-e8ba-43cd-9b8d-344312180df5" containerName="main"
Jul 10 13:23:36.026757 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.026736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.029458 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.029437    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-0fbd6d-openshift-default-dockercfg-25x5r\""
Jul 10 13:23:36.040644 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.040603    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"]
Jul 10 13:23:36.047945 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.047896    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:36.104759 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104727    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-socket\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.104759 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-istio-token\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.104960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhvm\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-kube-api-access-xqhvm\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.104960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a322426-c852-4c3c-93b8-d689b47effb4-istiod-ca-cert\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.104960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-data\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.104960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-credential-socket\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.104960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a322426-c852-4c3c-93b8-d689b47effb4-istio-podinfo\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.104960 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104956    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-certs\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.105433 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.104973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-envoy\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206136 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a322426-c852-4c3c-93b8-d689b47effb4-istio-podinfo\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206143    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-certs\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206162    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-envoy\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206200    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-socket\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-istio-token\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhvm\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-kube-api-access-xqhvm\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206320 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206282    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a322426-c852-4c3c-93b8-d689b47effb4-istiod-ca-cert\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206653 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-data\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206653 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-credential-socket\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206653 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-socket\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206835 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206663    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-certs\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206921 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-data\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.206993 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206971    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-credential-socket\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.207050 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.206981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a322426-c852-4c3c-93b8-d689b47effb4-istiod-ca-cert\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.208687 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.208661    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-envoy\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.208794 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.208779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a322426-c852-4c3c-93b8-d689b47effb4-istio-podinfo\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.219502 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.219474    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-istio-token\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.219649 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.219476    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhvm\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-kube-api-access-xqhvm\") pod \"e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") " pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.343942 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.343854    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:36.490708 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.490622    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"]
Jul 10 13:23:36.493098 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:23:36.493069    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a322426_c852_4c3c_93b8_d689b47effb4.slice/crio-c550f9e33391f7e29616c33b1c4474ec6b9e83ae8fb9623cfbf0974a057c7b37 WatchSource:0}: Error finding container c550f9e33391f7e29616c33b1c4474ec6b9e83ae8fb9623cfbf0974a057c7b37: Status 404 returned error can't find the container with id c550f9e33391f7e29616c33b1c4474ec6b9e83ae8fb9623cfbf0974a057c7b37
Jul 10 13:23:36.495172 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.495144    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:23:36.495249 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.495204    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:23:36.495249 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.495234    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:23:36.535333 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.535311    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:36.926773 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.926725    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" event={"ID":"4a322426-c852-4c3c-93b8-d689b47effb4","Type":"ContainerStarted","Data":"8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53"}
Jul 10 13:23:36.926976 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.926785    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" event={"ID":"4a322426-c852-4c3c-93b8-d689b47effb4","Type":"ContainerStarted","Data":"c550f9e33391f7e29616c33b1c4474ec6b9e83ae8fb9623cfbf0974a057c7b37"}
Jul 10 13:23:36.946011 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:36.945964    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" podStartSLOduration=0.945949236 podStartE2EDuration="945.949236ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:23:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:23:36.94538598 +0000 UTC m=+2264.463306249" watchObservedRunningTime="2026-07-10 13:23:36.945949236 +0000 UTC m=+2264.463869502"
Jul 10 13:23:37.344915 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:37.344839    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:37.349730 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:37.349705    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:37.931927 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:37.931899    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:37.933160 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:37.933136    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:37.998071 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:37.998031    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:38.090072 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:38.090040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:38.236483 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:38.236399    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:38.485282 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:38.485250    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:42.510831 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:42.510771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:23:52.002222 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:52.002194    2577 generic.go:356] "Generic (PLEG): container finished" podID="4a322426-c852-4c3c-93b8-d689b47effb4" containerID="8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53" exitCode=0
Jul 10 13:23:52.002567 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:52.002268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" event={"ID":"4a322426-c852-4c3c-93b8-d689b47effb4","Type":"ContainerDied","Data":"8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53"}
Jul 10 13:23:52.002683 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:52.002666    2577 scope.go:117] "RemoveContainer" containerID="8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53"
Jul 10 13:23:52.003687 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:52.003649    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:23:52.003754 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:52.003736    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:23:52.003812 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:52.003787    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:23:52.932234 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:52.932186    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:53.007944 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:53.007908    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" event={"ID":"4a322426-c852-4c3c-93b8-d689b47effb4","Type":"ContainerStarted","Data":"edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1"}
Jul 10 13:23:53.344965 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:53.344876    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:53.345267 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:53.345243    2577 patch_prober.go:28] interesting pod/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 10 13:23:53.345326 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:53.345301    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 10 13:23:54.344958 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:54.344920    2577 patch_prober.go:28] interesting pod/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 10 13:23:54.345332 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:54.344975    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 10 13:23:55.345066 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:55.345018    2577 patch_prober.go:28] interesting pod/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 10 13:23:55.345451 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:55.345093    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 10 13:23:56.344296 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:56.344252    2577 patch_prober.go:28] interesting pod/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused" start-of-body=
Jul 10 13:23:56.344514 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:56.344324    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.36:15021/healthz/ready\": dial tcp 10.133.0.36:15021: connect: connection refused"
Jul 10 13:23:57.072332 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:57.072287    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:23:57.348463 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:57.348392    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:57.348740 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:57.348715    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:23:57.349503 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:23:57.349485    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:24:11.879402 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.879369    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"]
Jul 10 13:24:11.883074 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.883055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:11.886826 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.886785    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-0fbd6d\"/\"openshift-service-ca.crt\""
Jul 10 13:24:11.886826 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.886821    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-0fbd6d\"/\"default-dockercfg-cd2dt\""
Jul 10 13:24:11.887067 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.886873    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-reuse-0fbd6d\"/\"kube-root-ca.crt\""
Jul 10 13:24:11.887067 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.886873    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-reuse-0fbd6d\"/\"test-model-0fbd6d-kserve-self-signed-certs\""
Jul 10 13:24:11.893518 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.893499    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"]
Jul 10 13:24:11.916202 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.916176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eee13180-0d5b-46f4-9fe1-a2435003bf91-tls-certs\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:11.916310 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.916206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-home\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:11.916310 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.916226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-tmp-dir\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:11.916310 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.916244    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-dshm\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:11.916310 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.916296    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mf7bc\" (UniqueName: \"kubernetes.io/projected/eee13180-0d5b-46f4-9fe1-a2435003bf91-kube-api-access-mf7bc\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:11.916466 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.916340    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-model-cache\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:11.918783 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:11.918747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:24:12.016723 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.016697    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eee13180-0d5b-46f4-9fe1-a2435003bf91-tls-certs\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.016864 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.016726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-home\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.016864 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.016746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-tmp-dir\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.016864 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.016762    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-dshm\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.017030 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.016874    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mf7bc\" (UniqueName: \"kubernetes.io/projected/eee13180-0d5b-46f4-9fe1-a2435003bf91-kube-api-access-mf7bc\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.017030 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.016929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-model-cache\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.017236 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.017202    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-tmp-dir\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.017353 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.017251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-home\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.017353 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.017279    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-model-cache\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.019046 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.019026    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-dshm\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.019220 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.019204    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eee13180-0d5b-46f4-9fe1-a2435003bf91-tls-certs\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.025898 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.025876    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mf7bc\" (UniqueName: \"kubernetes.io/projected/eee13180-0d5b-46f4-9fe1-a2435003bf91-kube-api-access-mf7bc\") pod \"test-model-0fbd6d-kserve-c6db9d557-wwf4z\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") " pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.192812 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.192777    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:12.321881 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:12.321848    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"]
Jul 10 13:24:12.324867 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:24:12.324843    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeee13180_0d5b_46f4_9fe1_a2435003bf91.slice/crio-b577bea6a1ef8eeab61e71f56c26b3f8f2ed6ec0fc70532b5871c561dd32b689 WatchSource:0}: Error finding container b577bea6a1ef8eeab61e71f56c26b3f8f2ed6ec0fc70532b5871c561dd32b689: Status 404 returned error can't find the container with id b577bea6a1ef8eeab61e71f56c26b3f8f2ed6ec0fc70532b5871c561dd32b689
Jul 10 13:24:13.093221 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:13.093190    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z" event={"ID":"eee13180-0d5b-46f4-9fe1-a2435003bf91","Type":"ContainerStarted","Data":"813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5"}
Jul 10 13:24:13.093663 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:13.093232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z" event={"ID":"eee13180-0d5b-46f4-9fe1-a2435003bf91","Type":"ContainerStarted","Data":"b577bea6a1ef8eeab61e71f56c26b3f8f2ed6ec0fc70532b5871c561dd32b689"}
Jul 10 13:24:13.112447 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:13.112405    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z" podStartSLOduration=2.112390293 podStartE2EDuration="2.112390293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:24:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:24:13.110324918 +0000 UTC m=+2300.628245196" watchObservedRunningTime="2026-07-10 13:24:13.112390293 +0000 UTC m=+2300.630310578"
Jul 10 13:24:19.174328 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:19.174296    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:24:22.193570 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:22.193525    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:22.193570 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:22.193578    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:22.205762 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:22.205733    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:23.156223 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:23.156194    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:24:39.061079 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:39.061045    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:24:39.529128 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:39.529095    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:24:39.834761 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:39.834678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:24:40.896641 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:40.896608    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:24:40.995330 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:40.995295    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:24:44.820093 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:44.820060    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"]
Jul 10 13:24:44.874768 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:44.874714    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:24:45.080578 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:45.080492    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:24:59.840252 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:24:59.840192    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z" podUID="eee13180-0d5b-46f4-9fe1-a2435003bf91" containerName="main" containerID="cri-o://813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5" gracePeriod=45
Jul 10 13:25:00.088530 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.088508    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:25:00.119668 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.119603    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-model-cache\") pod \"eee13180-0d5b-46f4-9fe1-a2435003bf91\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") "
Jul 10 13:25:00.119791 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.119667    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-tmp-dir\") pod \"eee13180-0d5b-46f4-9fe1-a2435003bf91\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") "
Jul 10 13:25:00.119791 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.119720    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-home\") pod \"eee13180-0d5b-46f4-9fe1-a2435003bf91\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") "
Jul 10 13:25:00.119791 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.119747    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-dshm\") pod \"eee13180-0d5b-46f4-9fe1-a2435003bf91\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") "
Jul 10 13:25:00.119975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.119790    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mf7bc\" (UniqueName: \"kubernetes.io/projected/eee13180-0d5b-46f4-9fe1-a2435003bf91-kube-api-access-mf7bc\") pod \"eee13180-0d5b-46f4-9fe1-a2435003bf91\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") "
Jul 10 13:25:00.119975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.119852    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eee13180-0d5b-46f4-9fe1-a2435003bf91-tls-certs\") pod \"eee13180-0d5b-46f4-9fe1-a2435003bf91\" (UID: \"eee13180-0d5b-46f4-9fe1-a2435003bf91\") "
Jul 10 13:25:00.119975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.119913    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-model-cache" (OuterVolumeSpecName: "model-cache") pod "eee13180-0d5b-46f4-9fe1-a2435003bf91" (UID: "eee13180-0d5b-46f4-9fe1-a2435003bf91"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:00.119975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.119961    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eee13180-0d5b-46f4-9fe1-a2435003bf91" (UID: "eee13180-0d5b-46f4-9fe1-a2435003bf91"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:00.120170 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.120115    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-home" (OuterVolumeSpecName: "home") pod "eee13180-0d5b-46f4-9fe1-a2435003bf91" (UID: "eee13180-0d5b-46f4-9fe1-a2435003bf91"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:00.120170 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.120155    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:00.120269 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.120173    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:00.122160 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.122130    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eee13180-0d5b-46f4-9fe1-a2435003bf91-kube-api-access-mf7bc" (OuterVolumeSpecName: "kube-api-access-mf7bc") pod "eee13180-0d5b-46f4-9fe1-a2435003bf91" (UID: "eee13180-0d5b-46f4-9fe1-a2435003bf91"). InnerVolumeSpecName "kube-api-access-mf7bc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:25:00.122352 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.122333    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eee13180-0d5b-46f4-9fe1-a2435003bf91-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eee13180-0d5b-46f4-9fe1-a2435003bf91" (UID: "eee13180-0d5b-46f4-9fe1-a2435003bf91"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:25:00.122423 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.122409    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-dshm" (OuterVolumeSpecName: "dshm") pod "eee13180-0d5b-46f4-9fe1-a2435003bf91" (UID: "eee13180-0d5b-46f4-9fe1-a2435003bf91"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:00.222102 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.222063    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mf7bc\" (UniqueName: \"kubernetes.io/projected/eee13180-0d5b-46f4-9fe1-a2435003bf91-kube-api-access-mf7bc\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:00.222102 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.222090    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eee13180-0d5b-46f4-9fe1-a2435003bf91-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:00.222102 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.222104    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:00.222333 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.222115    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eee13180-0d5b-46f4-9fe1-a2435003bf91-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:00.303224 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.303189    2577 generic.go:356] "Generic (PLEG): container finished" podID="eee13180-0d5b-46f4-9fe1-a2435003bf91" containerID="813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5" exitCode=0
Jul 10 13:25:00.303373 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.303228    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"
Jul 10 13:25:00.303373 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.303238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z" event={"ID":"eee13180-0d5b-46f4-9fe1-a2435003bf91","Type":"ContainerDied","Data":"813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5"}
Jul 10 13:25:00.303373 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.303268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z" event={"ID":"eee13180-0d5b-46f4-9fe1-a2435003bf91","Type":"ContainerDied","Data":"b577bea6a1ef8eeab61e71f56c26b3f8f2ed6ec0fc70532b5871c561dd32b689"}
Jul 10 13:25:00.303373 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.303284    2577 scope.go:117] "RemoveContainer" containerID="813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5"
Jul 10 13:25:00.312337 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.312320    2577 scope.go:117] "RemoveContainer" containerID="813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5"
Jul 10 13:25:00.312609 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:25:00.312588    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5\": container with ID starting with 813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5 not found: ID does not exist" containerID="813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5"
Jul 10 13:25:00.312653 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.312616    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5"} err="failed to get container status \"813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5\": rpc error: code = NotFound desc = could not find container \"813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5\": container with ID starting with 813b5477bb1dcaeee4c7f960f03491cb94a5025f338a7ba344d8a29da705b5c5 not found: ID does not exist"
Jul 10 13:25:00.325877 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.325857    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"]
Jul 10 13:25:00.330456 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:00.330438    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-reuse-0fbd6d/test-model-0fbd6d-kserve-c6db9d557-wwf4z"]
Jul 10 13:25:01.159810 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:01.159766    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eee13180-0d5b-46f4-9fe1-a2435003bf91" path="/var/lib/kubelet/pods/eee13180-0d5b-46f4-9fe1-a2435003bf91/volumes"
Jul 10 13:25:11.425055 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:11.425017    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:21.683398 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:21.683367    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:22.391289 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:22.391253    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:26.779449 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:26.779417    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:25:27.870020 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:27.869991    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:27.940472 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:27.940441    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:28.132820 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:28.132734    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"]
Jul 10 13:25:28.132999 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:28.132973    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy" containerID="cri-o://edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1" gracePeriod=30
Jul 10 13:25:28.160666 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:28.160637    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:28.383003 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:28.382920    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:32.379441 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:32.379404    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"]
Jul 10 13:25:32.406971 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:32.406943    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:33.386376 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.386352    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:25:33.445193 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.445161    2577 generic.go:356] "Generic (PLEG): container finished" podID="4a322426-c852-4c3c-93b8-d689b47effb4" containerID="edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1" exitCode=0
Jul 10 13:25:33.445354 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.445207    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"
Jul 10 13:25:33.445354 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.445204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" event={"ID":"4a322426-c852-4c3c-93b8-d689b47effb4","Type":"ContainerDied","Data":"edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1"}
Jul 10 13:25:33.445354 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.445318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v" event={"ID":"4a322426-c852-4c3c-93b8-d689b47effb4","Type":"ContainerDied","Data":"c550f9e33391f7e29616c33b1c4474ec6b9e83ae8fb9623cfbf0974a057c7b37"}
Jul 10 13:25:33.445354 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.445341    2577 scope.go:117] "RemoveContainer" containerID="edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1"
Jul 10 13:25:33.453516 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.453498    2577 scope.go:117] "RemoveContainer" containerID="8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53"
Jul 10 13:25:33.460607 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.460591    2577 scope.go:117] "RemoveContainer" containerID="edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1"
Jul 10 13:25:33.460890 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:25:33.460869    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1\": container with ID starting with edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1 not found: ID does not exist" containerID="edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1"
Jul 10 13:25:33.460964 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.460901    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1"} err="failed to get container status \"edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1\": rpc error: code = NotFound desc = could not find container \"edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1\": container with ID starting with edfec5e09203eab642790504846ffdb6c968e931a0ee9a058b8588638618bdb1 not found: ID does not exist"
Jul 10 13:25:33.460964 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.460925    2577 scope.go:117] "RemoveContainer" containerID="8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53"
Jul 10 13:25:33.461165 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:25:33.461149    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53\": container with ID starting with 8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53 not found: ID does not exist" containerID="8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53"
Jul 10 13:25:33.461213 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.461170    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53"} err="failed to get container status \"8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53\": rpc error: code = NotFound desc = could not find container \"8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53\": container with ID starting with 8766540e5e970c6adb8677e50e3f8e94badff2a744ba40422876242db76b3b53 not found: ID does not exist"
Jul 10 13:25:33.494643 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.494611    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-istio-token\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.494751 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.494660    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-credential-socket\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.494835 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.494749    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-data\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.494835 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.494829    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a322426-c852-4c3c-93b8-d689b47effb4-istio-podinfo\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.494953 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.494853    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-envoy\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.494953 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.494871    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqhvm\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-kube-api-access-xqhvm\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.494953 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.494934    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a322426-c852-4c3c-93b8-d689b47effb4-istiod-ca-cert\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.495130 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.495006    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-socket\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.495130 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.495031    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-certs\") pod \"4a322426-c852-4c3c-93b8-d689b47effb4\" (UID: \"4a322426-c852-4c3c-93b8-d689b47effb4\") "
Jul 10 13:25:33.495713 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.494930    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:33.495713 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.495347    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-credential-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.495713 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.495551    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-data" (OuterVolumeSpecName: "istio-data") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:33.495713 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.495570    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:33.495713 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.495676    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a322426-c852-4c3c-93b8-d689b47effb4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:25:33.496102 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.496078    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:33.497170 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.497136    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-istio-token" (OuterVolumeSpecName: "istio-token") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:25:33.497170 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.497140    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:33.497334 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.497299    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4a322426-c852-4c3c-93b8-d689b47effb4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 13:25:33.497449 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.497428    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-kube-api-access-xqhvm" (OuterVolumeSpecName: "kube-api-access-xqhvm") pod "4a322426-c852-4c3c-93b8-d689b47effb4" (UID: "4a322426-c852-4c3c-93b8-d689b47effb4"). InnerVolumeSpecName "kube-api-access-xqhvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:25:33.596176 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.596150    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4a322426-c852-4c3c-93b8-d689b47effb4-istiod-ca-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.596176 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.596173    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.596325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.596182    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-workload-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.596325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.596191    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-istio-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.596325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.596199    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.596325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.596206    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4a322426-c852-4c3c-93b8-d689b47effb4-istio-podinfo\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.596325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.596213    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4a322426-c852-4c3c-93b8-d689b47effb4-istio-envoy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.596325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.596222    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqhvm\" (UniqueName: \"kubernetes.io/projected/4a322426-c852-4c3c-93b8-d689b47effb4-kube-api-access-xqhvm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:33.778494 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.778460    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"]
Jul 10 13:25:33.780015 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:33.779990    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-0fbd6d-openshift-default-68878c4d59-nm74v"]
Jul 10 13:25:35.157118 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:35.157080    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" path="/var/lib/kubelet/pods/4a322426-c852-4c3c-93b8-d689b47effb4/volumes"
Jul 10 13:25:36.189905 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:36.189876    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"]
Jul 10 13:25:36.211141 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:36.211100    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:36.785714 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:36.785674    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:37.282693 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:37.282636    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:37.417771 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:37.417737    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:37.518198 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:37.518153    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:37.671855 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:37.671727    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:42.333281 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:42.333237    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:25:46.492293 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:46.492257    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:25:47.398866 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.398794    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866" podUID="2165902b-af0a-463d-97c6-af3437a92a66" containerName="main" containerID="cri-o://38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405" gracePeriod=45
Jul 10 13:25:47.645312 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.645289    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:25:47.812072 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812040    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-model-cache\") pod \"2165902b-af0a-463d-97c6-af3437a92a66\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") "
Jul 10 13:25:47.812072 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812079    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-tmp-dir\") pod \"2165902b-af0a-463d-97c6-af3437a92a66\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") "
Jul 10 13:25:47.812303 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812100    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-home\") pod \"2165902b-af0a-463d-97c6-af3437a92a66\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") "
Jul 10 13:25:47.812303 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812124    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfdsq\" (UniqueName: \"kubernetes.io/projected/2165902b-af0a-463d-97c6-af3437a92a66-kube-api-access-kfdsq\") pod \"2165902b-af0a-463d-97c6-af3437a92a66\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") "
Jul 10 13:25:47.812303 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812139    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2165902b-af0a-463d-97c6-af3437a92a66-tls-certs\") pod \"2165902b-af0a-463d-97c6-af3437a92a66\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") "
Jul 10 13:25:47.812303 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812208    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-dshm\") pod \"2165902b-af0a-463d-97c6-af3437a92a66\" (UID: \"2165902b-af0a-463d-97c6-af3437a92a66\") "
Jul 10 13:25:47.812476 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812355    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-model-cache" (OuterVolumeSpecName: "model-cache") pod "2165902b-af0a-463d-97c6-af3437a92a66" (UID: "2165902b-af0a-463d-97c6-af3437a92a66"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:47.812476 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812371    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2165902b-af0a-463d-97c6-af3437a92a66" (UID: "2165902b-af0a-463d-97c6-af3437a92a66"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:47.812476 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.812386    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-home" (OuterVolumeSpecName: "home") pod "2165902b-af0a-463d-97c6-af3437a92a66" (UID: "2165902b-af0a-463d-97c6-af3437a92a66"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:47.814428 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.814393    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2165902b-af0a-463d-97c6-af3437a92a66-kube-api-access-kfdsq" (OuterVolumeSpecName: "kube-api-access-kfdsq") pod "2165902b-af0a-463d-97c6-af3437a92a66" (UID: "2165902b-af0a-463d-97c6-af3437a92a66"). InnerVolumeSpecName "kube-api-access-kfdsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:25:47.814428 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.814406    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-dshm" (OuterVolumeSpecName: "dshm") pod "2165902b-af0a-463d-97c6-af3437a92a66" (UID: "2165902b-af0a-463d-97c6-af3437a92a66"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:47.814428 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.814412    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2165902b-af0a-463d-97c6-af3437a92a66-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2165902b-af0a-463d-97c6-af3437a92a66" (UID: "2165902b-af0a-463d-97c6-af3437a92a66"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:25:47.913395 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.913368    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:47.913395 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.913391    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:47.913545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.913401    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:47.913545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.913409    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2165902b-af0a-463d-97c6-af3437a92a66-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:47.913545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.913417    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfdsq\" (UniqueName: \"kubernetes.io/projected/2165902b-af0a-463d-97c6-af3437a92a66-kube-api-access-kfdsq\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:47.913545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:47.913425    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2165902b-af0a-463d-97c6-af3437a92a66-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:48.517856 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.517822    2577 generic.go:356] "Generic (PLEG): container finished" podID="2165902b-af0a-463d-97c6-af3437a92a66" containerID="38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405" exitCode=0
Jul 10 13:25:48.517856 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.517852    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"
Jul 10 13:25:48.518092 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.517861    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866" event={"ID":"2165902b-af0a-463d-97c6-af3437a92a66","Type":"ContainerDied","Data":"38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405"}
Jul 10 13:25:48.518092 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.517891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866" event={"ID":"2165902b-af0a-463d-97c6-af3437a92a66","Type":"ContainerDied","Data":"b1b3e16fcb0c467b9a92ef36cb018768dfd7dfd95041ef67d406515e2cbe5420"}
Jul 10 13:25:48.518092 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.517906    2577 scope.go:117] "RemoveContainer" containerID="38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405"
Jul 10 13:25:48.526645 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.526628    2577 scope.go:117] "RemoveContainer" containerID="38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405"
Jul 10 13:25:48.526927 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:25:48.526909    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405\": container with ID starting with 38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405 not found: ID does not exist" containerID="38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405"
Jul 10 13:25:48.526977 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.526935    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405"} err="failed to get container status \"38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405\": rpc error: code = NotFound desc = could not find container \"38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405\": container with ID starting with 38435491e85b9308b26108fc92472e617e5aa19caefd2e80dd5e70513b80a405 not found: ID does not exist"
Jul 10 13:25:48.539384 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.539363    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"]
Jul 10 13:25:48.544868 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:48.544849    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9a834f/test-model-9a834f-kserve-664bc8cf5f-xw866"]
Jul 10 13:25:49.157327 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:49.157292    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2165902b-af0a-463d-97c6-af3437a92a66" path="/var/lib/kubelet/pods/2165902b-af0a-463d-97c6-af3437a92a66/volumes"
Jul 10 13:25:51.210084 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.210038    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck" podUID="579f13d7-6b41-415c-a507-b0907d058310" containerName="main" containerID="cri-o://e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967" gracePeriod=45
Jul 10 13:25:51.448867 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.448845    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:25:51.533084 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.532994    2577 generic.go:356] "Generic (PLEG): container finished" podID="579f13d7-6b41-415c-a507-b0907d058310" containerID="e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967" exitCode=0
Jul 10 13:25:51.533084 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.533046    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"
Jul 10 13:25:51.533084 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.533067    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck" event={"ID":"579f13d7-6b41-415c-a507-b0907d058310","Type":"ContainerDied","Data":"e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967"}
Jul 10 13:25:51.533338 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.533099    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck" event={"ID":"579f13d7-6b41-415c-a507-b0907d058310","Type":"ContainerDied","Data":"24a5d024a2700748c2ab0a0565846eea10ecee966e521b4f55c6a98ce5878cbb"}
Jul 10 13:25:51.533338 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.533115    2577 scope.go:117] "RemoveContainer" containerID="e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967"
Jul 10 13:25:51.541001 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.540984    2577 scope.go:117] "RemoveContainer" containerID="e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967"
Jul 10 13:25:51.541093 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541076    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-tmp-dir\") pod \"579f13d7-6b41-415c-a507-b0907d058310\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") "
Jul 10 13:25:51.541143 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541116    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-home\") pod \"579f13d7-6b41-415c-a507-b0907d058310\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") "
Jul 10 13:25:51.541194 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541181    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-dshm\") pod \"579f13d7-6b41-415c-a507-b0907d058310\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") "
Jul 10 13:25:51.541243 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541228    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8b29\" (UniqueName: \"kubernetes.io/projected/579f13d7-6b41-415c-a507-b0907d058310-kube-api-access-c8b29\") pod \"579f13d7-6b41-415c-a507-b0907d058310\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") "
Jul 10 13:25:51.541303 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541264    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-model-cache\") pod \"579f13d7-6b41-415c-a507-b0907d058310\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") "
Jul 10 13:25:51.541303 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541289    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/579f13d7-6b41-415c-a507-b0907d058310-tls-certs\") pod \"579f13d7-6b41-415c-a507-b0907d058310\" (UID: \"579f13d7-6b41-415c-a507-b0907d058310\") "
Jul 10 13:25:51.541408 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:25:51.541300    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967\": container with ID starting with e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967 not found: ID does not exist" containerID="e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967"
Jul 10 13:25:51.541408 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541334    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967"} err="failed to get container status \"e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967\": rpc error: code = NotFound desc = could not find container \"e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967\": container with ID starting with e8d982a187a4cc2d56cc61ae512963e9371cfc63f50ad15c4cbff91dab2f9967 not found: ID does not exist"
Jul 10 13:25:51.541527 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541424    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-home" (OuterVolumeSpecName: "home") pod "579f13d7-6b41-415c-a507-b0907d058310" (UID: "579f13d7-6b41-415c-a507-b0907d058310"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:51.541527 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541436    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "579f13d7-6b41-415c-a507-b0907d058310" (UID: "579f13d7-6b41-415c-a507-b0907d058310"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:51.541618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541540    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:51.541618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541558    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:51.541618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.541582    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-model-cache" (OuterVolumeSpecName: "model-cache") pod "579f13d7-6b41-415c-a507-b0907d058310" (UID: "579f13d7-6b41-415c-a507-b0907d058310"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:51.543307 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.543287    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-dshm" (OuterVolumeSpecName: "dshm") pod "579f13d7-6b41-415c-a507-b0907d058310" (UID: "579f13d7-6b41-415c-a507-b0907d058310"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:25:51.543462 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.543444    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/579f13d7-6b41-415c-a507-b0907d058310-kube-api-access-c8b29" (OuterVolumeSpecName: "kube-api-access-c8b29") pod "579f13d7-6b41-415c-a507-b0907d058310" (UID: "579f13d7-6b41-415c-a507-b0907d058310"). InnerVolumeSpecName "kube-api-access-c8b29". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:25:51.543546 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.543528    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/579f13d7-6b41-415c-a507-b0907d058310-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "579f13d7-6b41-415c-a507-b0907d058310" (UID: "579f13d7-6b41-415c-a507-b0907d058310"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:25:51.641992 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.641971    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:51.641992 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.641990    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8b29\" (UniqueName: \"kubernetes.io/projected/579f13d7-6b41-415c-a507-b0907d058310-kube-api-access-c8b29\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:51.642110 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.642000    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/579f13d7-6b41-415c-a507-b0907d058310-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:51.642110 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.642009    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/579f13d7-6b41-415c-a507-b0907d058310-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:25:51.855327 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.855295    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"]
Jul 10 13:25:51.861516 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:51.861494    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-76c01a/test-model-76c01a-kserve-8cdb45fc-vv9ck"]
Jul 10 13:25:53.157471 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:25:53.157440    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="579f13d7-6b41-415c-a507-b0907d058310" path="/var/lib/kubelet/pods/579f13d7-6b41-415c-a507-b0907d058310/volumes"
Jul 10 13:26:19.142646 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:19.142567    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:19.473112 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:19.473082    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"]
Jul 10 13:26:19.473323 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:19.473299    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy" containerID="cri-o://746ef392cc64fa6974a86c8223e1ad9f6110614daa3cab3e4cbac83b318fbf36" gracePeriod=30
Jul 10 13:26:20.411647 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:20.411603    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:20.597994 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:20.597958    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:23.979854 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:23.979823    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:26:24.669339 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.669307    2577 generic.go:356] "Generic (PLEG): container finished" podID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerID="746ef392cc64fa6974a86c8223e1ad9f6110614daa3cab3e4cbac83b318fbf36" exitCode=0
Jul 10 13:26:24.669480 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.669383    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" event={"ID":"6319ebdf-eecf-42c6-b360-2dbd6e645cde","Type":"ContainerDied","Data":"746ef392cc64fa6974a86c8223e1ad9f6110614daa3cab3e4cbac83b318fbf36"}
Jul 10 13:26:24.669480 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.669444    2577 scope.go:117] "RemoveContainer" containerID="cdfdb04201a4688c43e9786f03b14edeb1b60584c0d484452d6ae135d0394129"
Jul 10 13:26:24.720375 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.720355    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:26:24.811858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.811766    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istiod-ca-cert\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.811988 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.811863    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bz24g\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-kube-api-access-bz24g\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.811988 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.811884    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-podinfo\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.811988 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.811918    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-envoy\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.811988 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.811941    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-token\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.811988 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.811968    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-data\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.812231 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.811994    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-certs\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.812231 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.812116    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-credential-socket\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.812231 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.812130    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:26:24.812231 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.812154    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-socket\") pod \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\" (UID: \"6319ebdf-eecf-42c6-b360-2dbd6e645cde\") "
Jul 10 13:26:24.812434 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.812244    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:26:24.812434 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.812406    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:26:24.812540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.812464    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istiod-ca-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:24.812540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.812481    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:24.812540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.812462    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:26:24.813066 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.813042    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-data" (OuterVolumeSpecName: "istio-data") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:26:24.814069 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.814039    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:26:24.814262 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.814242    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 13:26:24.814532 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.814507    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-token" (OuterVolumeSpecName: "istio-token") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:26:24.814532 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.814521    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-kube-api-access-bz24g" (OuterVolumeSpecName: "kube-api-access-bz24g") pod "6319ebdf-eecf-42c6-b360-2dbd6e645cde" (UID: "6319ebdf-eecf-42c6-b360-2dbd6e645cde"). InnerVolumeSpecName "kube-api-access-bz24g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:26:24.913481 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.913436    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:24.913481 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.913474    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:24.913481 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.913484    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-credential-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:24.913481 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.913493    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-workload-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:24.913726 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.913502    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bz24g\" (UniqueName: \"kubernetes.io/projected/6319ebdf-eecf-42c6-b360-2dbd6e645cde-kube-api-access-bz24g\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:24.913726 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.913510    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-podinfo\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:24.913726 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:24.913518    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6319ebdf-eecf-42c6-b360-2dbd6e645cde-istio-envoy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:26:25.674626 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:25.674590    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"
Jul 10 13:26:25.675062 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:25.674592    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v" event={"ID":"6319ebdf-eecf-42c6-b360-2dbd6e645cde","Type":"ContainerDied","Data":"d7f0528cd60e49b618ab30c8bc502ded2449ffd557c852295a411e6831b995e9"}
Jul 10 13:26:25.675062 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:25.674716    2577 scope.go:117] "RemoveContainer" containerID="746ef392cc64fa6974a86c8223e1ad9f6110614daa3cab3e4cbac83b318fbf36"
Jul 10 13:26:25.693508 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:25.693486    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"]
Jul 10 13:26:25.699204 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:25.699175    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-9a834f-openshift-default-6b89b665f9-zj25v"]
Jul 10 13:26:26.253470 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:26.253433    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:26.363129 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:26.363095    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:26.578369 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:26.578293    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:26.782376 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:26.782344    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:27.130591 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.130551    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:27.156516 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.156481    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" path="/var/lib/kubelet/pods/6319ebdf-eecf-42c6-b360-2dbd6e645cde/volumes"
Jul 10 13:26:27.420894 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.420810    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"]
Jul 10 13:26:27.421198 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421179    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2165902b-af0a-463d-97c6-af3437a92a66" containerName="main"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421200    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2165902b-af0a-463d-97c6-af3437a92a66" containerName="main"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421215    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="579f13d7-6b41-415c-a507-b0907d058310" containerName="main"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421224    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="579f13d7-6b41-415c-a507-b0907d058310" containerName="main"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421236    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421244    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421259    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eee13180-0d5b-46f4-9fe1-a2435003bf91" containerName="main"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421267    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee13180-0d5b-46f4-9fe1-a2435003bf91" containerName="main"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421279    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy"
Jul 10 13:26:27.421288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421288    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421299    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421307    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421328    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421336    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421407    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="579f13d7-6b41-415c-a507-b0907d058310" containerName="main"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421420    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421429    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a322426-c852-4c3c-93b8-d689b47effb4" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421438    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421446    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6319ebdf-eecf-42c6-b360-2dbd6e645cde" containerName="istio-proxy"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421454    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="eee13180-0d5b-46f4-9fe1-a2435003bf91" containerName="main"
Jul 10 13:26:27.421711 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.421464    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2165902b-af0a-463d-97c6-af3437a92a66" containerName="main"
Jul 10 13:26:27.426011 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.425991    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.428929 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.428882    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 13:26:27.428929 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.428915    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-01c5f9-openshift-default-dockercfg-fj6w8\""
Jul 10 13:26:27.436235 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.436213    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"]
Jul 10 13:26:27.446140 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.446118    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:27.532279 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532247    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-data\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.532279 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-certs\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.532451 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532309    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-socket\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.532451 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532383    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8a1ddee-c902-4f98-8991-d27607117839-istio-podinfo\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.532451 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532428    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-credential-socket\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.532451 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-istio-token\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.532600 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532480    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-envoy\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.532600 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8a1ddee-c902-4f98-8991-d27607117839-istiod-ca-cert\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.532600 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.532518    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8zpc\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-kube-api-access-l8zpc\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.633523 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8a1ddee-c902-4f98-8991-d27607117839-istio-podinfo\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.633620 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-credential-socket\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.633620 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-istio-token\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.633620 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-envoy\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.633895 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8a1ddee-c902-4f98-8991-d27607117839-istiod-ca-cert\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.633895 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8zpc\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-kube-api-access-l8zpc\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.633895 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-data\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.633895 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-certs\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.634193 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633944    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-socket\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.634193 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.633967    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-credential-socket\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.634193 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.634161    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-data\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.634352 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.634250    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-certs\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.634352 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.634275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-socket\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.634465 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.634398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8a1ddee-c902-4f98-8991-d27607117839-istiod-ca-cert\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.635811 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.635774    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-envoy\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.636144 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.636129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8a1ddee-c902-4f98-8991-d27607117839-istio-podinfo\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.641997 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.641976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-istio-token\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.642092 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.642038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8zpc\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-kube-api-access-l8zpc\") pod \"e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") " pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.736887 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.736861    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:27.765117 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.765093    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:27.821590 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.821555    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:27.867911 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.867871    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"]
Jul 10 13:26:27.870584 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:26:27.870552    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a1ddee_c902_4f98_8991_d27607117839.slice/crio-b9b2db1ab74b16a0715b0ba39e60ef71b432b26408e55eb2200abbabc822c033 WatchSource:0}: Error finding container b9b2db1ab74b16a0715b0ba39e60ef71b432b26408e55eb2200abbabc822c033: Status 404 returned error can't find the container with id b9b2db1ab74b16a0715b0ba39e60ef71b432b26408e55eb2200abbabc822c033
Jul 10 13:26:27.872719 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.872684    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:26:27.872793 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.872755    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:26:27.872793 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.872784    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:26:27.980952 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:27.980907    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:28.690259 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:28.690225    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" event={"ID":"a8a1ddee-c902-4f98-8991-d27607117839","Type":"ContainerStarted","Data":"b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e"}
Jul 10 13:26:28.690438 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:28.690276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" event={"ID":"a8a1ddee-c902-4f98-8991-d27607117839","Type":"ContainerStarted","Data":"b9b2db1ab74b16a0715b0ba39e60ef71b432b26408e55eb2200abbabc822c033"}
Jul 10 13:26:28.719451 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:28.719396    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" podStartSLOduration=1.719378238 podStartE2EDuration="1.719378238s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:26:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:26:28.716740032 +0000 UTC m=+2436.234660299" watchObservedRunningTime="2026-07-10 13:26:28.719378238 +0000 UTC m=+2436.237298505"
Jul 10 13:26:28.737201 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:28.737172    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:28.742080 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:28.742057    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:29.694710 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:29.694675    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:29.695732 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:29.695715    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:30.623515 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:30.623473    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:30.723083 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:30.723048    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:30.919656 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:30.919583    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:31.005856 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:31.005786    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:31.517301 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:31.517264    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:31.618270 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:31.618243    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:35.160462 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:35.160427    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:35.635011 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:35.634980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:35.956006 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:35.955957    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:36.057612 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:36.057580    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:38.685306 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:38.685280    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:38.768476 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:38.768440    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:38.864483 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:38.864449    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:38.983258 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:38.983156    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:39.193117 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:39.193084    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:26:39.360733 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:39.360665    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:39.458758 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:39.458729    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:43.159003 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:43.158973    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:45.735978 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:45.735935    2577 patch_prober.go:28] interesting pod/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 10 13:26:45.736344 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:45.736020    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 10 13:26:47.777952 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:47.777917    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8a1ddee-c902-4f98-8991-d27607117839" containerID="b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e" exitCode=0
Jul 10 13:26:47.778375 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:47.777989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" event={"ID":"a8a1ddee-c902-4f98-8991-d27607117839","Type":"ContainerDied","Data":"b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e"}
Jul 10 13:26:47.778423 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:47.778413    2577 scope.go:117] "RemoveContainer" containerID="b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e"
Jul 10 13:26:47.779430 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:47.779401    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:26:47.779532 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:47.779481    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:26:47.779593 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:47.779528    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:26:48.783265 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:48.783227    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" event={"ID":"a8a1ddee-c902-4f98-8991-d27607117839","Type":"ContainerStarted","Data":"7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404"}
Jul 10 13:26:49.737169 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:49.737132    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:49.737727 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:49.737679    2577 patch_prober.go:28] interesting pod/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 10 13:26:49.738004 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:49.737955    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 10 13:26:50.737892 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:50.737848    2577 patch_prober.go:28] interesting pod/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 10 13:26:50.738396 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:50.737915    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 10 13:26:51.248867 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:51.248831    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:51.624991 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:51.624900    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:51.728153 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:51.728075    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:51.738674 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:51.738224    2577 patch_prober.go:28] interesting pod/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 10 13:26:51.738674 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:51.738294    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 10 13:26:51.825343 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:51.825303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:51.983607 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:51.983567    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:52.738197 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:52.738157    2577 patch_prober.go:28] interesting pod/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Jul 10 13:26:52.738495 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:52.738462    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Jul 10 13:26:53.740727 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:53.740694    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:53.741166 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:53.741005    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:53.741588 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:53.741570    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:26:55.078551 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:55.078518    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:26:57.394756 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:57.394720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:57.495195 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:57.495165    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:58.012187 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:58.012159    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"]
Jul 10 13:26:58.012404 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:58.012377    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy" containerID="cri-o://7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404" gracePeriod=30
Jul 10 13:26:58.040672 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:58.040638    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:58.253938 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:58.253907    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:58.435511 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:58.435483    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:58.791768 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:58.791680    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:58.913733 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:58.913703    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:59.014140 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:59.014107    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:26:59.171172 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:26:59.171096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:03.258795 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.258769    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:27:03.333975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.333893    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8a1ddee-c902-4f98-8991-d27607117839-istio-podinfo\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.333975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.333942    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-certs\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.333975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.333968    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-socket\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.334217 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.333987    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-istio-token\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.334217 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334044    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8zpc\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-kube-api-access-l8zpc\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.334217 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334085    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-credential-socket\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.334217 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334132    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-envoy\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.334217 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334157    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8a1ddee-c902-4f98-8991-d27607117839-istiod-ca-cert\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.334217 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-data\") pod \"a8a1ddee-c902-4f98-8991-d27607117839\" (UID: \"a8a1ddee-c902-4f98-8991-d27607117839\") "
Jul 10 13:27:03.334217 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334207    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:27:03.334596 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334265    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:27:03.334596 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334409    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.334596 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334415    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:27:03.334596 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334429    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-workload-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.334794 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.334617    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8a1ddee-c902-4f98-8991-d27607117839-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:27:03.335163 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.335134    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-data" (OuterVolumeSpecName: "istio-data") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:27:03.336409 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.336376    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a8a1ddee-c902-4f98-8991-d27607117839-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 13:27:03.336409 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.336386    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-istio-token" (OuterVolumeSpecName: "istio-token") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:27:03.336548 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.336435    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-kube-api-access-l8zpc" (OuterVolumeSpecName: "kube-api-access-l8zpc") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "kube-api-access-l8zpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:27:03.336548 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.336435    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a8a1ddee-c902-4f98-8991-d27607117839" (UID: "a8a1ddee-c902-4f98-8991-d27607117839"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:27:03.435025 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.434995    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-istio-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.435025 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.435019    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8zpc\" (UniqueName: \"kubernetes.io/projected/a8a1ddee-c902-4f98-8991-d27607117839-kube-api-access-l8zpc\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.435025 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.435028    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-credential-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.435254 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.435038    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-envoy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.435254 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.435046    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8a1ddee-c902-4f98-8991-d27607117839-istiod-ca-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.435254 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.435054    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8a1ddee-c902-4f98-8991-d27607117839-istio-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.435254 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.435060    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8a1ddee-c902-4f98-8991-d27607117839-istio-podinfo\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:27:03.846666 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.846631    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8a1ddee-c902-4f98-8991-d27607117839" containerID="7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404" exitCode=0
Jul 10 13:27:03.846886 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.846686    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" event={"ID":"a8a1ddee-c902-4f98-8991-d27607117839","Type":"ContainerDied","Data":"7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404"}
Jul 10 13:27:03.846886 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.846690    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"
Jul 10 13:27:03.846886 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.846728    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh" event={"ID":"a8a1ddee-c902-4f98-8991-d27607117839","Type":"ContainerDied","Data":"b9b2db1ab74b16a0715b0ba39e60ef71b432b26408e55eb2200abbabc822c033"}
Jul 10 13:27:03.846886 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.846750    2577 scope.go:117] "RemoveContainer" containerID="7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404"
Jul 10 13:27:03.855588 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.855568    2577 scope.go:117] "RemoveContainer" containerID="b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e"
Jul 10 13:27:03.862654 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.862636    2577 scope.go:117] "RemoveContainer" containerID="7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404"
Jul 10 13:27:03.862920 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:27:03.862897    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404\": container with ID starting with 7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404 not found: ID does not exist" containerID="7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404"
Jul 10 13:27:03.862968 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.862931    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404"} err="failed to get container status \"7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404\": rpc error: code = NotFound desc = could not find container \"7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404\": container with ID starting with 7d705feec59049a14e4f4ca6acb048905804b55b74624954b1f887a64d251404 not found: ID does not exist"
Jul 10 13:27:03.862968 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.862950    2577 scope.go:117] "RemoveContainer" containerID="b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e"
Jul 10 13:27:03.863183 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:27:03.863166    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e\": container with ID starting with b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e not found: ID does not exist" containerID="b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e"
Jul 10 13:27:03.863219 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.863190    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e"} err="failed to get container status \"b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e\": rpc error: code = NotFound desc = could not find container \"b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e\": container with ID starting with b0749397e649f26288e07cb4e80fd48a6af09ecd5c51f2b598cc9abd4154696e not found: ID does not exist"
Jul 10 13:27:03.867697 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.867676    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"]
Jul 10 13:27:03.872858 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:03.872837    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-01c5f9-openshift-default-5bcb654667-ws5vh"]
Jul 10 13:27:04.716869 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:04.716836    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:04.817626 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:04.817596    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:04.978982 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:04.978900    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:05.156655 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.156626    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8a1ddee-c902-4f98-8991-d27607117839" path="/var/lib/kubelet/pods/a8a1ddee-c902-4f98-8991-d27607117839/volumes"
Jul 10 13:27:05.166811 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.166778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:05.488592 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.488562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:05.776170 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.776089    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"]
Jul 10 13:27:05.776602 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.776380    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy"
Jul 10 13:27:05.776602 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.776391    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy"
Jul 10 13:27:05.776602 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.776459    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy"
Jul 10 13:27:05.776602 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.776467    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy"
Jul 10 13:27:05.780676 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.780657    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.784174 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.784150    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7266ad-openshift-default-dockercfg-sx8mn\""
Jul 10 13:27:05.784649 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.784630    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 10 13:27:05.797267 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.797245    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"]
Jul 10 13:27:05.816186 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.816158    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:05.852915 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.852880    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7px7j\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-kube-api-access-7px7j\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.852915 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.852916    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-envoy\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.853151 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.852941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-token\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.853151 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.852983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-data\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.853151 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.853001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-certs\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.853151 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.853017    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-socket\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.853151 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.853100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istiod-ca-cert\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.853151 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.853135    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-credential-socket\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.853469 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.853157    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-podinfo\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.953866 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.953829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-socket\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954056 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.953989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istiod-ca-cert\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954056 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954042    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-credential-socket\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954173 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-podinfo\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954173 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7px7j\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-kube-api-access-7px7j\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954281 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-envoy\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954281 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954210    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-socket\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954281 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-token\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954281 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-data\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954463 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-certs\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954463 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-credential-socket\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954591 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954567    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-certs\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954682 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-data\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.954783 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.954764    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istiod-ca-cert\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.956457 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.956433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-envoy\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.956720 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.956703    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-podinfo\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.963541 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.963517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-token\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:05.963660 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:05.963639    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7px7j\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-kube-api-access-7px7j\") pod \"e2e-shared-a-7266ad-openshift-default-659449d787-wnthk\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") " pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:06.035933 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.035861    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:06.092611 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.092586    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:06.224531 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.224506    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"]
Jul 10 13:27:06.226477 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:27:06.226443    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5245d25a_cf8b_417f_a0f7_e077d3efaad7.slice/crio-c5ced4679bbed132ba2f3253e4b5f2b0eeb0430224ca9f0071b1dedc5053e158 WatchSource:0}: Error finding container c5ced4679bbed132ba2f3253e4b5f2b0eeb0430224ca9f0071b1dedc5053e158: Status 404 returned error can't find the container with id c5ced4679bbed132ba2f3253e4b5f2b0eeb0430224ca9f0071b1dedc5053e158
Jul 10 13:27:06.228545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.228515    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:27:06.228624 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.228574    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:27:06.228624 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.228602    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:27:06.866024 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.865989    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" event={"ID":"5245d25a-cf8b-417f-a0f7-e077d3efaad7","Type":"ContainerStarted","Data":"e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205"}
Jul 10 13:27:06.866381 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.866039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" event={"ID":"5245d25a-cf8b-417f-a0f7-e077d3efaad7","Type":"ContainerStarted","Data":"c5ced4679bbed132ba2f3253e4b5f2b0eeb0430224ca9f0071b1dedc5053e158"}
Jul 10 13:27:06.889500 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:06.889450    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" podStartSLOduration=1.8894319419999999 podStartE2EDuration="1.889431942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:06.888363313 +0000 UTC m=+2474.406283581" watchObservedRunningTime="2026-07-10 13:27:06.889431942 +0000 UTC m=+2474.407352211"
Jul 10 13:27:07.093525 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:07.093490    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:07.097925 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:07.097903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:07.870536 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:07.870506    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:07.871305 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:07.871290    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:08.759760 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:08.759727    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:08.859714 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:08.859672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:08.960113 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:08.960079    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:09.112327 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:09.112231    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:09.423105 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:09.423022    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:09.523660 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:09.523619    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:09.991448 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:09.991418    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:27:13.242865 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:13.242830    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:13.570068 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:13.569978    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:13.854861 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:13.854768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:14.000170 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:14.000141    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:16.878245 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:16.878214    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:16.972085 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:16.972052    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:17.135197 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:17.135115    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:17.507008 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:17.506973    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:17.608004 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:17.607973    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:17.708772 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:17.708739    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:21.365134 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:21.365086    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:23.912971 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:23.912930    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 10 13:27:23.913325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:23.912998    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 10 13:27:24.475034 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:24.475001    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:27:24.942921 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:24.942898    2577 generic.go:356] "Generic (PLEG): container finished" podID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerID="e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205" exitCode=0
Jul 10 13:27:24.943244 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:24.942979    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" event={"ID":"5245d25a-cf8b-417f-a0f7-e077d3efaad7","Type":"ContainerDied","Data":"e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205"}
Jul 10 13:27:24.943374 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:24.943352    2577 scope.go:117] "RemoveContainer" containerID="e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205"
Jul 10 13:27:24.949937 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:24.949842    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:27:24.950033 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:24.949985    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:27:24.950033 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:24.950021    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"}
Jul 10 13:27:25.949681 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:25.949646    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" event={"ID":"5245d25a-cf8b-417f-a0f7-e077d3efaad7","Type":"ContainerStarted","Data":"582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c"}
Jul 10 13:27:26.093348 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:26.093314    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:26.093544 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:26.093523    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 10 13:27:26.093606 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:26.093585    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 10 13:27:27.093210 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:27.093175    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 10 13:27:27.093602 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:27.093238    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 10 13:27:28.093474 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:28.093437    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 10 13:27:28.093904 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:28.093502    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 10 13:27:29.093169 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:29.093133    2577 patch_prober.go:28] interesting pod/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body=
Jul 10 13:27:29.093345 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:29.093191    2577 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused"
Jul 10 13:27:30.096856 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:30.096824    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:30.097270 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:30.097059    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:30.097699 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:30.097683    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:27:30.296094 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:30.296065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:30.401680 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:30.401604    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:34.728810 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:34.728773    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:34.823714 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:34.823675    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:38.331690 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:38.331655    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:38.432834 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:38.432783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:46.770431 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.770393    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"]
Jul 10 13:27:46.770837 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.770691    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy"
Jul 10 13:27:46.770837 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.770703    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8a1ddee-c902-4f98-8991-d27607117839" containerName="istio-proxy"
Jul 10 13:27:46.773540 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.773522    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.779295 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.779270    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"openshift-service-ca.crt\""
Jul 10 13:27:46.779429 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.779307    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"kube-root-ca.crt\""
Jul 10 13:27:46.780414 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.780394    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"default-dockercfg-5jq52\""
Jul 10 13:27:46.780509 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.780418    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"auth-test-model-7266ad-kserve-self-signed-certs\""
Jul 10 13:27:46.788144 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.788122    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"]
Jul 10 13:27:46.788144 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.788134    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8ef748-fcca-4949-93a6-e29c719d100d-tls-certs\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.788316 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.788168    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-home\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.788316 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.788196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-tmp-dir\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.788316 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.788263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-dshm\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.788497 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.788345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sjgv\" (UniqueName: \"kubernetes.io/projected/7c8ef748-fcca-4949-93a6-e29c719d100d-kube-api-access-6sjgv\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.788497 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.788379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-model-cache\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.820493 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.820458    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:27:46.888721 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.888690    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-tmp-dir\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.888881 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.888734    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-dshm\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.888881 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.888769    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sjgv\" (UniqueName: \"kubernetes.io/projected/7c8ef748-fcca-4949-93a6-e29c719d100d-kube-api-access-6sjgv\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.888881 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.888786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-model-cache\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.888881 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.888853    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8ef748-fcca-4949-93a6-e29c719d100d-tls-certs\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.889103 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.888975    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-home\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.889161 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.889127    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-tmp-dir\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.889235 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.889213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-model-cache\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.889318 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.889299    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-home\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.891000 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.890980    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-dshm\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.891269 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.891253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8ef748-fcca-4949-93a6-e29c719d100d-tls-certs\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:46.898060 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:46.898041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sjgv\" (UniqueName: \"kubernetes.io/projected/7c8ef748-fcca-4949-93a6-e29c719d100d-kube-api-access-6sjgv\") pod \"auth-test-model-7266ad-kserve-7f988b6c9f-6brzs\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") " pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:47.083157 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:47.083055    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:47.212502 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:47.212477    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"]
Jul 10 13:27:47.214739 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:27:47.214710    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7c8ef748_fcca_4949_93a6_e29c719d100d.slice/crio-cbfb1544d1766ad095a69e7e053ea9a6bda795cd8987646f22005f089a1bdcd6 WatchSource:0}: Error finding container cbfb1544d1766ad095a69e7e053ea9a6bda795cd8987646f22005f089a1bdcd6: Status 404 returned error can't find the container with id cbfb1544d1766ad095a69e7e053ea9a6bda795cd8987646f22005f089a1bdcd6
Jul 10 13:27:48.041574 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:48.041542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs" event={"ID":"7c8ef748-fcca-4949-93a6-e29c719d100d","Type":"ContainerStarted","Data":"5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4"}
Jul 10 13:27:48.041574 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:48.041582    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs" event={"ID":"7c8ef748-fcca-4949-93a6-e29c719d100d","Type":"ContainerStarted","Data":"cbfb1544d1766ad095a69e7e053ea9a6bda795cd8987646f22005f089a1bdcd6"}
Jul 10 13:27:48.060834 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:48.060769    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs" podStartSLOduration=2.060753261 podStartE2EDuration="2.060753261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:27:48.059463803 +0000 UTC m=+2515.577384082" watchObservedRunningTime="2026-07-10 13:27:48.060753261 +0000 UTC m=+2515.578673527"
Jul 10 13:27:50.297522 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:50.297478    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:27:57.083294 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:57.083253    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:57.083943 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:57.083315    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:57.095560 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:57.095536    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:27:58.094163 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:27:58.094137    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:28:28.186135 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.186102    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"]
Jul 10 13:28:28.189364 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.189346    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.192264 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.192244    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"kube-root-ca.crt\""
Jul 10 13:28:28.193231 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.193203    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"openshift-service-ca.crt\""
Jul 10 13:28:28.193332 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.193213    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"default-dockercfg-2grlr\""
Jul 10 13:28:28.193332 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.193217    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"auth-test-model-d5a846-kserve-self-signed-certs\""
Jul 10 13:28:28.198027 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.198002    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"]
Jul 10 13:28:28.217506 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.217479    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:28:28.329667 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.329643    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rsn6\" (UniqueName: \"kubernetes.io/projected/683127ca-fda6-4dd7-a312-0950af16dfc6-kube-api-access-9rsn6\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.329774 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.329682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-tmp-dir\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.329774 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.329717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/683127ca-fda6-4dd7-a312-0950af16dfc6-tls-certs\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.329774 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.329739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-model-cache\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.329774 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.329761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-dshm\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.329950 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.329789    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-home\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.430626 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.430599    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-tmp-dir\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.430725 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.430636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/683127ca-fda6-4dd7-a312-0950af16dfc6-tls-certs\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.430725 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.430655    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-model-cache\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.430725 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.430685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-dshm\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.430725 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.430707    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-home\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.430918 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.430757    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rsn6\" (UniqueName: \"kubernetes.io/projected/683127ca-fda6-4dd7-a312-0950af16dfc6-kube-api-access-9rsn6\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.431000 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.430973    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-tmp-dir\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.431129 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.431090    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-model-cache\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.431183 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.431151    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-home\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.432929 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.432908    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-dshm\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.433256 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.433238    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/683127ca-fda6-4dd7-a312-0950af16dfc6-tls-certs\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.439160 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.439110    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rsn6\" (UniqueName: \"kubernetes.io/projected/683127ca-fda6-4dd7-a312-0950af16dfc6-kube-api-access-9rsn6\") pod \"auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") " pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.499699 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.499671    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:28.624353 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:28.624331    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"]
Jul 10 13:28:28.627041 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:28:28.627014    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod683127ca_fda6_4dd7_a312_0950af16dfc6.slice/crio-5a900d947b4e4b0f35667271a3ef6645ac6d94435b7044d4cfc3ad694ff74a4c WatchSource:0}: Error finding container 5a900d947b4e4b0f35667271a3ef6645ac6d94435b7044d4cfc3ad694ff74a4c: Status 404 returned error can't find the container with id 5a900d947b4e4b0f35667271a3ef6645ac6d94435b7044d4cfc3ad694ff74a4c
Jul 10 13:28:29.207432 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:29.207393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh" event={"ID":"683127ca-fda6-4dd7-a312-0950af16dfc6","Type":"ContainerStarted","Data":"e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16"}
Jul 10 13:28:29.207432 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:29.207437    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh" event={"ID":"683127ca-fda6-4dd7-a312-0950af16dfc6","Type":"ContainerStarted","Data":"5a900d947b4e4b0f35667271a3ef6645ac6d94435b7044d4cfc3ad694ff74a4c"}
Jul 10 13:28:29.225675 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:29.225627    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh" podStartSLOduration=1.225613826 podStartE2EDuration="1.225613826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:28:29.224261858 +0000 UTC m=+2556.742182138" watchObservedRunningTime="2026-07-10 13:28:29.225613826 +0000 UTC m=+2556.743534093"
Jul 10 13:28:32.102477 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:32.102446    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:28:38.500019 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:38.499973    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:38.500493 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:38.500059    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:38.512358 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:38.512335    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:39.257518 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:39.257488    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:28:54.675469 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:28:54.675425    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:29:13.777817 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:29:13.777756    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:29:15.485378 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:29:15.485286    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:29:28.680472 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:29:28.680436    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:29:41.688824 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:29:41.688755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:29:41.787469 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:29:41.787444    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:29:48.684237 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:29:48.684204    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:30:05.910299 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:30:05.910260    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:30:23.997577 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:30:23.997542    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:30:38.478828 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:30:38.477830    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:30:54.084512 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:30:54.084481    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:31:11.779999 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:11.779961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:31:21.561985 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:21.561951    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"]
Jul 10 13:31:21.670634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:21.670603    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:31:22.362252 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:22.362220    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"]
Jul 10 13:31:22.986154 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:22.986121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:31:26.587150 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:26.587114    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:31:32.386194 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.386160    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"]
Jul 10 13:31:32.389349 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.389328    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.391976 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.391956    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"sub-test-model-7266ad-kserve-self-signed-certs\""
Jul 10 13:31:32.399688 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.399664    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"]
Jul 10 13:31:32.420266 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.420242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:31:32.527454 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.527407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4684f79-acea-48f8-8533-f6866c9fffaf-tls-certs\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.527625 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.527466    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-dshm\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.527625 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.527500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-home\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.527625 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.527519    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbz2t\" (UniqueName: \"kubernetes.io/projected/e4684f79-acea-48f8-8533-f6866c9fffaf-kube-api-access-hbz2t\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.527625 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.527594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-model-cache\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.527779 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.527665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-tmp-dir\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.628975 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.628938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-dshm\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.629178 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.628985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-home\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.629178 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.629007    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbz2t\" (UniqueName: \"kubernetes.io/projected/e4684f79-acea-48f8-8533-f6866c9fffaf-kube-api-access-hbz2t\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.629178 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.629033    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-model-cache\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.629178 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.629062    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-tmp-dir\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.629178 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.629113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4684f79-acea-48f8-8533-f6866c9fffaf-tls-certs\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.629459 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.629433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-model-cache\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.629512 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.629489    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-home\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.629512 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.629504    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-tmp-dir\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.631315 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.631292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-dshm\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.631481 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.631464    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4684f79-acea-48f8-8533-f6866c9fffaf-tls-certs\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.637730 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.637678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbz2t\" (UniqueName: \"kubernetes.io/projected/e4684f79-acea-48f8-8533-f6866c9fffaf-kube-api-access-hbz2t\") pod \"sub-test-model-7266ad-kserve-6dd6d4665f-8qffc\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") " pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.698597 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.698557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:32.825366 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.825337    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"]
Jul 10 13:31:32.827928 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:31:32.827898    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4684f79_acea_48f8_8533_f6866c9fffaf.slice/crio-2787ad4ee0902120498ac437f3b7b8f0c4ca8645c08d0a8ed4de8b233294284f WatchSource:0}: Error finding container 2787ad4ee0902120498ac437f3b7b8f0c4ca8645c08d0a8ed4de8b233294284f: Status 404 returned error can't find the container with id 2787ad4ee0902120498ac437f3b7b8f0c4ca8645c08d0a8ed4de8b233294284f
Jul 10 13:31:32.961673 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.961641    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc" event={"ID":"e4684f79-acea-48f8-8533-f6866c9fffaf","Type":"ContainerStarted","Data":"d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150"}
Jul 10 13:31:32.961875 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.961680    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc" event={"ID":"e4684f79-acea-48f8-8533-f6866c9fffaf","Type":"ContainerStarted","Data":"2787ad4ee0902120498ac437f3b7b8f0c4ca8645c08d0a8ed4de8b233294284f"}
Jul 10 13:31:32.978346 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:32.978297    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc" podStartSLOduration=0.978281207 podStartE2EDuration="978.281207ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:31:32.977828199 +0000 UTC m=+2740.495748469" watchObservedRunningTime="2026-07-10 13:31:32.978281207 +0000 UTC m=+2740.496201453"
Jul 10 13:31:36.581362 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.581321    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs" podUID="7c8ef748-fcca-4949-93a6-e29c719d100d" containerName="main" containerID="cri-o://5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4" gracePeriod=45
Jul 10 13:31:36.822115 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.822092    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:31:36.964893 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.964851    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-dshm\") pod \"7c8ef748-fcca-4949-93a6-e29c719d100d\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") "
Jul 10 13:31:36.964893 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.964900    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-home\") pod \"7c8ef748-fcca-4949-93a6-e29c719d100d\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") "
Jul 10 13:31:36.965149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.964922    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sjgv\" (UniqueName: \"kubernetes.io/projected/7c8ef748-fcca-4949-93a6-e29c719d100d-kube-api-access-6sjgv\") pod \"7c8ef748-fcca-4949-93a6-e29c719d100d\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") "
Jul 10 13:31:36.965149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.964975    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8ef748-fcca-4949-93a6-e29c719d100d-tls-certs\") pod \"7c8ef748-fcca-4949-93a6-e29c719d100d\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") "
Jul 10 13:31:36.965149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.965015    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-tmp-dir\") pod \"7c8ef748-fcca-4949-93a6-e29c719d100d\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") "
Jul 10 13:31:36.965149 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.965043    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-model-cache\") pod \"7c8ef748-fcca-4949-93a6-e29c719d100d\" (UID: \"7c8ef748-fcca-4949-93a6-e29c719d100d\") "
Jul 10 13:31:36.965379 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.965142    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-home" (OuterVolumeSpecName: "home") pod "7c8ef748-fcca-4949-93a6-e29c719d100d" (UID: "7c8ef748-fcca-4949-93a6-e29c719d100d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:31:36.965379 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.965264    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7c8ef748-fcca-4949-93a6-e29c719d100d" (UID: "7c8ef748-fcca-4949-93a6-e29c719d100d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:31:36.965379 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.965328    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-model-cache" (OuterVolumeSpecName: "model-cache") pod "7c8ef748-fcca-4949-93a6-e29c719d100d" (UID: "7c8ef748-fcca-4949-93a6-e29c719d100d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:31:36.965379 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.965370    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:36.965536 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.965396    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:36.967165 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.967135    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c8ef748-fcca-4949-93a6-e29c719d100d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7c8ef748-fcca-4949-93a6-e29c719d100d" (UID: "7c8ef748-fcca-4949-93a6-e29c719d100d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:31:36.967270 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.967172    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c8ef748-fcca-4949-93a6-e29c719d100d-kube-api-access-6sjgv" (OuterVolumeSpecName: "kube-api-access-6sjgv") pod "7c8ef748-fcca-4949-93a6-e29c719d100d" (UID: "7c8ef748-fcca-4949-93a6-e29c719d100d"). InnerVolumeSpecName "kube-api-access-6sjgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:31:36.967270 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.967221    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-dshm" (OuterVolumeSpecName: "dshm") pod "7c8ef748-fcca-4949-93a6-e29c719d100d" (UID: "7c8ef748-fcca-4949-93a6-e29c719d100d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:31:36.980050 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.980025    2577 generic.go:356] "Generic (PLEG): container finished" podID="7c8ef748-fcca-4949-93a6-e29c719d100d" containerID="5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4" exitCode=0
Jul 10 13:31:36.980167 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.980065    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"
Jul 10 13:31:36.980167 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.980100    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs" event={"ID":"7c8ef748-fcca-4949-93a6-e29c719d100d","Type":"ContainerDied","Data":"5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4"}
Jul 10 13:31:36.980167 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.980144    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs" event={"ID":"7c8ef748-fcca-4949-93a6-e29c719d100d","Type":"ContainerDied","Data":"cbfb1544d1766ad095a69e7e053ea9a6bda795cd8987646f22005f089a1bdcd6"}
Jul 10 13:31:36.980167 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.980162    2577 scope.go:117] "RemoveContainer" containerID="5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4"
Jul 10 13:31:36.988217 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.988200    2577 scope.go:117] "RemoveContainer" containerID="5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4"
Jul 10 13:31:36.988466 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:31:36.988447    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4\": container with ID starting with 5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4 not found: ID does not exist" containerID="5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4"
Jul 10 13:31:36.988527 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:36.988473    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4"} err="failed to get container status \"5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4\": rpc error: code = NotFound desc = could not find container \"5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4\": container with ID starting with 5a8280406764bc53182ca3aba7df217f1d2a7b916fffdd387438274ed9adbec4 not found: ID does not exist"
Jul 10 13:31:37.001115 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.001095    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"]
Jul 10 13:31:37.008060 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.008039    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/auth-test-model-7266ad-kserve-7f988b6c9f-6brzs"]
Jul 10 13:31:37.065983 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.065959    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.065983 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.065979    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c8ef748-fcca-4949-93a6-e29c719d100d-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.066111 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.065988    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sjgv\" (UniqueName: \"kubernetes.io/projected/7c8ef748-fcca-4949-93a6-e29c719d100d-kube-api-access-6sjgv\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.066111 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.065997    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c8ef748-fcca-4949-93a6-e29c719d100d-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.156788 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.156760    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c8ef748-fcca-4949-93a6-e29c719d100d" path="/var/lib/kubelet/pods/7c8ef748-fcca-4949-93a6-e29c719d100d/volumes"
Jul 10 13:31:37.383621 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.383518    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh" podUID="683127ca-fda6-4dd7-a312-0950af16dfc6" containerName="main" containerID="cri-o://e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16" gracePeriod=45
Jul 10 13:31:37.631460 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.631437    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:31:37.670113 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670045    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-model-cache\") pod \"683127ca-fda6-4dd7-a312-0950af16dfc6\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") "
Jul 10 13:31:37.670113 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670075    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-home\") pod \"683127ca-fda6-4dd7-a312-0950af16dfc6\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") "
Jul 10 13:31:37.670113 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670099    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rsn6\" (UniqueName: \"kubernetes.io/projected/683127ca-fda6-4dd7-a312-0950af16dfc6-kube-api-access-9rsn6\") pod \"683127ca-fda6-4dd7-a312-0950af16dfc6\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") "
Jul 10 13:31:37.670331 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670140    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/683127ca-fda6-4dd7-a312-0950af16dfc6-tls-certs\") pod \"683127ca-fda6-4dd7-a312-0950af16dfc6\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") "
Jul 10 13:31:37.670331 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670188    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-tmp-dir\") pod \"683127ca-fda6-4dd7-a312-0950af16dfc6\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") "
Jul 10 13:31:37.670331 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670239    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-dshm\") pod \"683127ca-fda6-4dd7-a312-0950af16dfc6\" (UID: \"683127ca-fda6-4dd7-a312-0950af16dfc6\") "
Jul 10 13:31:37.670493 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670369    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-home" (OuterVolumeSpecName: "home") pod "683127ca-fda6-4dd7-a312-0950af16dfc6" (UID: "683127ca-fda6-4dd7-a312-0950af16dfc6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:31:37.670493 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670381    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-model-cache" (OuterVolumeSpecName: "model-cache") pod "683127ca-fda6-4dd7-a312-0950af16dfc6" (UID: "683127ca-fda6-4dd7-a312-0950af16dfc6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:31:37.670677 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670511    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "683127ca-fda6-4dd7-a312-0950af16dfc6" (UID: "683127ca-fda6-4dd7-a312-0950af16dfc6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:31:37.670677 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670517    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.670677 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.670608    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.672448 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.672419    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/683127ca-fda6-4dd7-a312-0950af16dfc6-kube-api-access-9rsn6" (OuterVolumeSpecName: "kube-api-access-9rsn6") pod "683127ca-fda6-4dd7-a312-0950af16dfc6" (UID: "683127ca-fda6-4dd7-a312-0950af16dfc6"). InnerVolumeSpecName "kube-api-access-9rsn6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:31:37.672763 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.672741    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-dshm" (OuterVolumeSpecName: "dshm") pod "683127ca-fda6-4dd7-a312-0950af16dfc6" (UID: "683127ca-fda6-4dd7-a312-0950af16dfc6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:31:37.672763 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.672747    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/683127ca-fda6-4dd7-a312-0950af16dfc6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "683127ca-fda6-4dd7-a312-0950af16dfc6" (UID: "683127ca-fda6-4dd7-a312-0950af16dfc6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:31:37.771265 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.771233    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.771265 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.771258    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/683127ca-fda6-4dd7-a312-0950af16dfc6-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.771265 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.771268    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rsn6\" (UniqueName: \"kubernetes.io/projected/683127ca-fda6-4dd7-a312-0950af16dfc6-kube-api-access-9rsn6\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.771491 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.771278    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/683127ca-fda6-4dd7-a312-0950af16dfc6-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:31:37.987073 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.987033    2577 generic.go:356] "Generic (PLEG): container finished" podID="683127ca-fda6-4dd7-a312-0950af16dfc6" containerID="e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16" exitCode=0
Jul 10 13:31:37.987073 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.987073    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"
Jul 10 13:31:37.987322 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.987087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh" event={"ID":"683127ca-fda6-4dd7-a312-0950af16dfc6","Type":"ContainerDied","Data":"e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16"}
Jul 10 13:31:37.987322 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.987124    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh" event={"ID":"683127ca-fda6-4dd7-a312-0950af16dfc6","Type":"ContainerDied","Data":"5a900d947b4e4b0f35667271a3ef6645ac6d94435b7044d4cfc3ad694ff74a4c"}
Jul 10 13:31:37.987322 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.987144    2577 scope.go:117] "RemoveContainer" containerID="e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16"
Jul 10 13:31:37.995676 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.995658    2577 scope.go:117] "RemoveContainer" containerID="e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16"
Jul 10 13:31:37.995915 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:31:37.995894    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16\": container with ID starting with e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16 not found: ID does not exist" containerID="e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16"
Jul 10 13:31:37.995993 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:37.995927    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16"} err="failed to get container status \"e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16\": rpc error: code = NotFound desc = could not find container \"e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16\": container with ID starting with e98a4a59bfbdda65169b36527571ca7b8bb9c9448edea400860c3eca1bdd5a16 not found: ID does not exist"
Jul 10 13:31:38.010005 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:38.009982    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"]
Jul 10 13:31:38.014030 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:38.014009    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/auth-test-model-d5a846-kserve-7f6d7cd6c-hx5hh"]
Jul 10 13:31:38.479494 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:38.479460    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:31:39.162074 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:39.162042    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="683127ca-fda6-4dd7-a312-0950af16dfc6" path="/var/lib/kubelet/pods/683127ca-fda6-4dd7-a312-0950af16dfc6/volumes"
Jul 10 13:31:42.699545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:42.699500    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:42.700102 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:42.699564    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:42.712038 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:42.712017    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:43.020473 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:43.020391    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:31:52.962937 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:31:52.962908    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:32:04.173490 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.173451    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"]
Jul 10 13:32:04.174014 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.173889    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c8ef748-fcca-4949-93a6-e29c719d100d" containerName="main"
Jul 10 13:32:04.174014 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.173907    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c8ef748-fcca-4949-93a6-e29c719d100d" containerName="main"
Jul 10 13:32:04.174014 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.173921    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="683127ca-fda6-4dd7-a312-0950af16dfc6" containerName="main"
Jul 10 13:32:04.174014 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.173929    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="683127ca-fda6-4dd7-a312-0950af16dfc6" containerName="main"
Jul 10 13:32:04.174228 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.174026    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c8ef748-fcca-4949-93a6-e29c719d100d" containerName="main"
Jul 10 13:32:04.174228 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.174040    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="683127ca-fda6-4dd7-a312-0950af16dfc6" containerName="main"
Jul 10 13:32:04.176903 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.176883    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.180830 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.180788    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"sub-test-model-d5a846-kserve-self-signed-certs\""
Jul 10 13:32:04.180940 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.180920    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"default-dockercfg-2grlr\""
Jul 10 13:32:04.181039 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.181021    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"kube-root-ca.crt\""
Jul 10 13:32:04.181113 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.181026    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"openshift-service-ca.crt\""
Jul 10 13:32:04.185831 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.185794    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"]
Jul 10 13:32:04.212213 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.212178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:32:04.267728 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.267693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-home\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.267728 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.267730    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bedf175a-5039-48ea-9792-54ddf67aee5f-tls-certs\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.267965 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.267823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jtrq\" (UniqueName: \"kubernetes.io/projected/bedf175a-5039-48ea-9792-54ddf67aee5f-kube-api-access-9jtrq\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.267965 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.267886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-tmp-dir\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.267965 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.267925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-model-cache\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.267965 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.267943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-dshm\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369223 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369192    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-model-cache\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369223 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-dshm\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369429 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369275    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-home\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369429 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bedf175a-5039-48ea-9792-54ddf67aee5f-tls-certs\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369429 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369319    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jtrq\" (UniqueName: \"kubernetes.io/projected/bedf175a-5039-48ea-9792-54ddf67aee5f-kube-api-access-9jtrq\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369562 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369455    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-tmp-dir\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369641 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369619    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-model-cache\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369708 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-home\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.369844 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.369824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-tmp-dir\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.371545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.371523    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-dshm\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.371782 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.371765    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bedf175a-5039-48ea-9792-54ddf67aee5f-tls-certs\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.377867 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.377847    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jtrq\" (UniqueName: \"kubernetes.io/projected/bedf175a-5039-48ea-9792-54ddf67aee5f-kube-api-access-9jtrq\") pod \"sub-test-model-d5a846-kserve-75bcf6ddc5-9296j\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") " pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.486500 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.486406    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:04.613698 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:04.613667    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"]
Jul 10 13:32:04.616289 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:32:04.616261    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbedf175a_5039_48ea_9792_54ddf67aee5f.slice/crio-21e64d7d0ae185987bd4d0d2a8ba813de18f42ba542eaef501ec4d057aa36817 WatchSource:0}: Error finding container 21e64d7d0ae185987bd4d0d2a8ba813de18f42ba542eaef501ec4d057aa36817: Status 404 returned error can't find the container with id 21e64d7d0ae185987bd4d0d2a8ba813de18f42ba542eaef501ec4d057aa36817
Jul 10 13:32:05.112260 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:05.112219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j" event={"ID":"bedf175a-5039-48ea-9792-54ddf67aee5f","Type":"ContainerStarted","Data":"6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162"}
Jul 10 13:32:05.112454 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:05.112268    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j" event={"ID":"bedf175a-5039-48ea-9792-54ddf67aee5f","Type":"ContainerStarted","Data":"21e64d7d0ae185987bd4d0d2a8ba813de18f42ba542eaef501ec4d057aa36817"}
Jul 10 13:32:05.132092 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:05.132049    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j" podStartSLOduration=1.132031316 podStartE2EDuration="1.132031316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:32:05.130109537 +0000 UTC m=+2772.648029805" watchObservedRunningTime="2026-07-10 13:32:05.132031316 +0000 UTC m=+2772.649951582"
Jul 10 13:32:08.876290 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:08.876255    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:32:14.486713 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:14.486680    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:14.487194 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:14.486728    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:14.498905 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:14.498884    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:15.166053 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:15.166020    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:32:24.682409 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:24.682377    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:32:31.231144 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:31.231109    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:32:31.328325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:31.328295    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:32:39.078973 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:39.078938    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:32:39.180733 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:39.180701    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:32:43.483837 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:32:43.483791    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:33:01.489794 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:01.489760    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:33:10.994495 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:10.994464    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"]
Jul 10 13:33:11.015597 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:11.015569    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:33:11.793041 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:11.793010    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"]
Jul 10 13:33:11.815878 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:11.815783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:33:20.686831 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:20.685370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:33:25.188326 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:25.188296    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:33:26.014083 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.014048    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc" podUID="e4684f79-acea-48f8-8533-f6866c9fffaf" containerName="main" containerID="cri-o://d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150" gracePeriod=45
Jul 10 13:33:26.260634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.260613    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:33:26.423655 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.423632    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-model-cache\") pod \"e4684f79-acea-48f8-8533-f6866c9fffaf\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") "
Jul 10 13:33:26.423793 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.423680    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4684f79-acea-48f8-8533-f6866c9fffaf-tls-certs\") pod \"e4684f79-acea-48f8-8533-f6866c9fffaf\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") "
Jul 10 13:33:26.423793 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.423697    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbz2t\" (UniqueName: \"kubernetes.io/projected/e4684f79-acea-48f8-8533-f6866c9fffaf-kube-api-access-hbz2t\") pod \"e4684f79-acea-48f8-8533-f6866c9fffaf\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") "
Jul 10 13:33:26.423793 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.423716    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-home\") pod \"e4684f79-acea-48f8-8533-f6866c9fffaf\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") "
Jul 10 13:33:26.423971 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.423852    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-tmp-dir\") pod \"e4684f79-acea-48f8-8533-f6866c9fffaf\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") "
Jul 10 13:33:26.423971 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.423927    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-dshm\") pod \"e4684f79-acea-48f8-8533-f6866c9fffaf\" (UID: \"e4684f79-acea-48f8-8533-f6866c9fffaf\") "
Jul 10 13:33:26.423971 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.423940    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-model-cache" (OuterVolumeSpecName: "model-cache") pod "e4684f79-acea-48f8-8533-f6866c9fffaf" (UID: "e4684f79-acea-48f8-8533-f6866c9fffaf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:33:26.423971 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.423955    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-home" (OuterVolumeSpecName: "home") pod "e4684f79-acea-48f8-8533-f6866c9fffaf" (UID: "e4684f79-acea-48f8-8533-f6866c9fffaf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:33:26.424175 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.424138    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e4684f79-acea-48f8-8533-f6866c9fffaf" (UID: "e4684f79-acea-48f8-8533-f6866c9fffaf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:33:26.424250 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.424232    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:26.424303 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.424255    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:26.424303 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.424268    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:26.425814 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.425779    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4684f79-acea-48f8-8533-f6866c9fffaf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e4684f79-acea-48f8-8533-f6866c9fffaf" (UID: "e4684f79-acea-48f8-8533-f6866c9fffaf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:33:26.425892 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.425864    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4684f79-acea-48f8-8533-f6866c9fffaf-kube-api-access-hbz2t" (OuterVolumeSpecName: "kube-api-access-hbz2t") pod "e4684f79-acea-48f8-8533-f6866c9fffaf" (UID: "e4684f79-acea-48f8-8533-f6866c9fffaf"). InnerVolumeSpecName "kube-api-access-hbz2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:33:26.425929 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.425889    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-dshm" (OuterVolumeSpecName: "dshm") pod "e4684f79-acea-48f8-8533-f6866c9fffaf" (UID: "e4684f79-acea-48f8-8533-f6866c9fffaf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:33:26.452209 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.452185    2577 generic.go:356] "Generic (PLEG): container finished" podID="e4684f79-acea-48f8-8533-f6866c9fffaf" containerID="d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150" exitCode=0
Jul 10 13:33:26.452308 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.452215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc" event={"ID":"e4684f79-acea-48f8-8533-f6866c9fffaf","Type":"ContainerDied","Data":"d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150"}
Jul 10 13:33:26.452308 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.452235    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"
Jul 10 13:33:26.452308 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.452262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc" event={"ID":"e4684f79-acea-48f8-8533-f6866c9fffaf","Type":"ContainerDied","Data":"2787ad4ee0902120498ac437f3b7b8f0c4ca8645c08d0a8ed4de8b233294284f"}
Jul 10 13:33:26.452308 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.452287    2577 scope.go:117] "RemoveContainer" containerID="d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150"
Jul 10 13:33:26.460330 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.460306    2577 scope.go:117] "RemoveContainer" containerID="d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150"
Jul 10 13:33:26.460594 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:33:26.460574    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150\": container with ID starting with d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150 not found: ID does not exist" containerID="d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150"
Jul 10 13:33:26.460661 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.460603    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150"} err="failed to get container status \"d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150\": rpc error: code = NotFound desc = could not find container \"d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150\": container with ID starting with d28f634df5e7d40acbc2e703b72a04baf9aa515c9c0a7e89f55c9c99d5640150 not found: ID does not exist"
Jul 10 13:33:26.478316 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.478291    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"]
Jul 10 13:33:26.482516 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.482493    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/sub-test-model-7266ad-kserve-6dd6d4665f-8qffc"]
Jul 10 13:33:26.525327 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.525306    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4684f79-acea-48f8-8533-f6866c9fffaf-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:26.525327 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.525325    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbz2t\" (UniqueName: \"kubernetes.io/projected/e4684f79-acea-48f8-8533-f6866c9fffaf-kube-api-access-hbz2t\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:26.525446 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.525334    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e4684f79-acea-48f8-8533-f6866c9fffaf-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:26.812136 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:26.812044    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j" podUID="bedf175a-5039-48ea-9792-54ddf67aee5f" containerName="main" containerID="cri-o://6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162" gracePeriod=45
Jul 10 13:33:27.056043 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.056021    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:33:27.156558 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.156491    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4684f79-acea-48f8-8533-f6866c9fffaf" path="/var/lib/kubelet/pods/e4684f79-acea-48f8-8533-f6866c9fffaf/volumes"
Jul 10 13:33:27.232439 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232415    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-model-cache\") pod \"bedf175a-5039-48ea-9792-54ddf67aee5f\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") "
Jul 10 13:33:27.232555 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232463    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-home\") pod \"bedf175a-5039-48ea-9792-54ddf67aee5f\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") "
Jul 10 13:33:27.232555 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232486    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jtrq\" (UniqueName: \"kubernetes.io/projected/bedf175a-5039-48ea-9792-54ddf67aee5f-kube-api-access-9jtrq\") pod \"bedf175a-5039-48ea-9792-54ddf67aee5f\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") "
Jul 10 13:33:27.232555 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232515    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-dshm\") pod \"bedf175a-5039-48ea-9792-54ddf67aee5f\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") "
Jul 10 13:33:27.232555 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232529    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-tmp-dir\") pod \"bedf175a-5039-48ea-9792-54ddf67aee5f\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") "
Jul 10 13:33:27.232773 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232558    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bedf175a-5039-48ea-9792-54ddf67aee5f-tls-certs\") pod \"bedf175a-5039-48ea-9792-54ddf67aee5f\" (UID: \"bedf175a-5039-48ea-9792-54ddf67aee5f\") "
Jul 10 13:33:27.232773 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232694    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-model-cache" (OuterVolumeSpecName: "model-cache") pod "bedf175a-5039-48ea-9792-54ddf67aee5f" (UID: "bedf175a-5039-48ea-9792-54ddf67aee5f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:33:27.232903 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232789    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bedf175a-5039-48ea-9792-54ddf67aee5f" (UID: "bedf175a-5039-48ea-9792-54ddf67aee5f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:33:27.232903 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232696    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-home" (OuterVolumeSpecName: "home") pod "bedf175a-5039-48ea-9792-54ddf67aee5f" (UID: "bedf175a-5039-48ea-9792-54ddf67aee5f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:33:27.232903 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.232866    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:27.234709 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.234687    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bedf175a-5039-48ea-9792-54ddf67aee5f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bedf175a-5039-48ea-9792-54ddf67aee5f" (UID: "bedf175a-5039-48ea-9792-54ddf67aee5f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:33:27.234815 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.234709    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-dshm" (OuterVolumeSpecName: "dshm") pod "bedf175a-5039-48ea-9792-54ddf67aee5f" (UID: "bedf175a-5039-48ea-9792-54ddf67aee5f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:33:27.234815 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.234711    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bedf175a-5039-48ea-9792-54ddf67aee5f-kube-api-access-9jtrq" (OuterVolumeSpecName: "kube-api-access-9jtrq") pod "bedf175a-5039-48ea-9792-54ddf67aee5f" (UID: "bedf175a-5039-48ea-9792-54ddf67aee5f"). InnerVolumeSpecName "kube-api-access-9jtrq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:33:27.333479 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.333456    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bedf175a-5039-48ea-9792-54ddf67aee5f-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:27.333479 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.333477    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:27.333790 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.333486    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jtrq\" (UniqueName: \"kubernetes.io/projected/bedf175a-5039-48ea-9792-54ddf67aee5f-kube-api-access-9jtrq\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:27.333790 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.333494    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:27.333790 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.333502    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bedf175a-5039-48ea-9792-54ddf67aee5f-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:33:27.458512 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.458484    2577 generic.go:356] "Generic (PLEG): container finished" podID="bedf175a-5039-48ea-9792-54ddf67aee5f" containerID="6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162" exitCode=0
Jul 10 13:33:27.458680 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.458525    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j" event={"ID":"bedf175a-5039-48ea-9792-54ddf67aee5f","Type":"ContainerDied","Data":"6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162"}
Jul 10 13:33:27.458680 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.458537    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"
Jul 10 13:33:27.458680 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.458569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j" event={"ID":"bedf175a-5039-48ea-9792-54ddf67aee5f","Type":"ContainerDied","Data":"21e64d7d0ae185987bd4d0d2a8ba813de18f42ba542eaef501ec4d057aa36817"}
Jul 10 13:33:27.458680 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.458587    2577 scope.go:117] "RemoveContainer" containerID="6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162"
Jul 10 13:33:27.467264 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.467248    2577 scope.go:117] "RemoveContainer" containerID="6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162"
Jul 10 13:33:27.467515 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:33:27.467495    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162\": container with ID starting with 6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162 not found: ID does not exist" containerID="6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162"
Jul 10 13:33:27.467565 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.467523    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162"} err="failed to get container status \"6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162\": rpc error: code = NotFound desc = could not find container \"6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162\": container with ID starting with 6a7ed1ff4a886e798d15989086e6ab1809cb1ec929d5c4e0eadd748920c22162 not found: ID does not exist"
Jul 10 13:33:27.479041 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.479021    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"]
Jul 10 13:33:27.485395 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:27.485372    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/sub-test-model-d5a846-kserve-75bcf6ddc5-9296j"]
Jul 10 13:33:29.156410 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:29.156368    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bedf175a-5039-48ea-9792-54ddf67aee5f" path="/var/lib/kubelet/pods/bedf175a-5039-48ea-9792-54ddf67aee5f/volumes"
Jul 10 13:33:30.168619 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.168586    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"]
Jul 10 13:33:30.169005 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.168882    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bedf175a-5039-48ea-9792-54ddf67aee5f" containerName="main"
Jul 10 13:33:30.169005 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.168894    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bedf175a-5039-48ea-9792-54ddf67aee5f" containerName="main"
Jul 10 13:33:30.169005 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.168912    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4684f79-acea-48f8-8533-f6866c9fffaf" containerName="main"
Jul 10 13:33:30.169005 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.168917    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4684f79-acea-48f8-8533-f6866c9fffaf" containerName="main"
Jul 10 13:33:30.169005 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.168961    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bedf175a-5039-48ea-9792-54ddf67aee5f" containerName="main"
Jul 10 13:33:30.169005 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.168972    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4684f79-acea-48f8-8533-f6866c9fffaf" containerName="main"
Jul 10 13:33:30.172905 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.172889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.176611 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.176589    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"default-dockercfg-5jq52\""
Jul 10 13:33:30.176731 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.176619    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"openshift-service-ca.crt\""
Jul 10 13:33:30.176731 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.176634    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"rate-test-model-7266ad-kserve-self-signed-certs\""
Jul 10 13:33:30.176731 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.176684    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-7266ad\"/\"kube-root-ca.crt\""
Jul 10 13:33:30.181687 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.181662    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"]
Jul 10 13:33:30.188103 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.188076    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:33:30.357240 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.357205    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pfs7\" (UniqueName: \"kubernetes.io/projected/388c5722-4dec-47c8-832f-fef89f471752-kube-api-access-9pfs7\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.357456 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.357257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-home\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.357456 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.357316    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-model-cache\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.357456 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.357336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/388c5722-4dec-47c8-832f-fef89f471752-tls-certs\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.357456 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.357387    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-dshm\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.357456 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.357412    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-tmp-dir\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.458860 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.458826    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pfs7\" (UniqueName: \"kubernetes.io/projected/388c5722-4dec-47c8-832f-fef89f471752-kube-api-access-9pfs7\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.459042 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.458880    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-home\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.459042 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.458996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-model-cache\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.459042 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.459028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/388c5722-4dec-47c8-832f-fef89f471752-tls-certs\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.459277 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.459071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-dshm\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.459277 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.459104    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-tmp-dir\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.459387 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.459366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-home\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.459435 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.459424    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-model-cache\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.459474 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.459433    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-tmp-dir\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.461265 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.461235    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-dshm\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.461430 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.461413    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/388c5722-4dec-47c8-832f-fef89f471752-tls-certs\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.467295 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.467274    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pfs7\" (UniqueName: \"kubernetes.io/projected/388c5722-4dec-47c8-832f-fef89f471752-kube-api-access-9pfs7\") pod \"rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") " pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.482854 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.482832    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:30.614239 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:30.614088    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"]
Jul 10 13:33:30.616906 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:33:30.616870    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod388c5722_4dec_47c8_832f_fef89f471752.slice/crio-a759f3b2bd3b00c379338dea10dcdca8692412b1a6a87a26d39368bcaf463992 WatchSource:0}: Error finding container a759f3b2bd3b00c379338dea10dcdca8692412b1a6a87a26d39368bcaf463992: Status 404 returned error can't find the container with id a759f3b2bd3b00c379338dea10dcdca8692412b1a6a87a26d39368bcaf463992
Jul 10 13:33:31.478934 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:31.478900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q" event={"ID":"388c5722-4dec-47c8-832f-fef89f471752","Type":"ContainerStarted","Data":"a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b"}
Jul 10 13:33:31.479398 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:31.478945    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q" event={"ID":"388c5722-4dec-47c8-832f-fef89f471752","Type":"ContainerStarted","Data":"a759f3b2bd3b00c379338dea10dcdca8692412b1a6a87a26d39368bcaf463992"}
Jul 10 13:33:31.498694 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:31.498648    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q" podStartSLOduration=1.498633682 podStartE2EDuration="1.498633682s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:33:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:33:31.497354214 +0000 UTC m=+2859.015274501" watchObservedRunningTime="2026-07-10 13:33:31.498633682 +0000 UTC m=+2859.016553949"
Jul 10 13:33:36.278170 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:36.278136    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:33:40.483462 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:40.483424    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:40.483885 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:40.483478    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:40.495445 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:40.495422    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:40.527166 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:40.527140    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:33:56.924761 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:56.924726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:33:57.383085 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.382993    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"]
Jul 10 13:33:57.387384 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.387362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.390019 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.389997    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"kube-root-ca.crt\""
Jul 10 13:33:57.391076 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.391041    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"openshift-service-ca.crt\""
Jul 10 13:33:57.391203 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.391082    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"default-dockercfg-2grlr\""
Jul 10 13:33:57.391203 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.391123    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-d5a846\"/\"rate-test-model-d5a846-kserve-self-signed-certs\""
Jul 10 13:33:57.397413 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.397393    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"]
Jul 10 13:33:57.421225 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.421206    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:33:57.481481 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.481454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-dshm\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.481574 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.481507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/478333fc-537b-4f6d-b03a-daa44350812c-tls-certs\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.481574 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.481562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-home\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.481651 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.481594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8g8n\" (UniqueName: \"kubernetes.io/projected/478333fc-537b-4f6d-b03a-daa44350812c-kube-api-access-v8g8n\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.481651 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.481628    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-model-cache\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.481716 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.481695    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-tmp-dir\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.582392 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.582366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-dshm\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.582546 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.582416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/478333fc-537b-4f6d-b03a-daa44350812c-tls-certs\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.582546 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.582441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-home\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.582546 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.582471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8g8n\" (UniqueName: \"kubernetes.io/projected/478333fc-537b-4f6d-b03a-daa44350812c-kube-api-access-v8g8n\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.582546 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.582513    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-model-cache\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.582786 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.582577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-tmp-dir\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.583015 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.582995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-model-cache\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.583085 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.583011    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-tmp-dir\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.583183 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.583167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-home\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.584836 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.584788    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-dshm\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.585221 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.585194    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/478333fc-537b-4f6d-b03a-daa44350812c-tls-certs\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.591613 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.591585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8g8n\" (UniqueName: \"kubernetes.io/projected/478333fc-537b-4f6d-b03a-daa44350812c-kube-api-access-v8g8n\") pod \"rate-test-model-d5a846-kserve-54fc9ff779-55lbt\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") " pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.697930 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.697903    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:33:57.823767 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:57.823742    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"]
Jul 10 13:33:57.825473 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:33:57.825447    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod478333fc_537b_4f6d_b03a_daa44350812c.slice/crio-391627b47d0f96cdabf08f6a3894f585eb108aa18b20f334910375aad6badf49 WatchSource:0}: Error finding container 391627b47d0f96cdabf08f6a3894f585eb108aa18b20f334910375aad6badf49: Status 404 returned error can't find the container with id 391627b47d0f96cdabf08f6a3894f585eb108aa18b20f334910375aad6badf49
Jul 10 13:33:58.595171 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:58.595135    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt" event={"ID":"478333fc-537b-4f6d-b03a-daa44350812c","Type":"ContainerStarted","Data":"d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98"}
Jul 10 13:33:58.595171 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:58.595174    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt" event={"ID":"478333fc-537b-4f6d-b03a-daa44350812c","Type":"ContainerStarted","Data":"391627b47d0f96cdabf08f6a3894f585eb108aa18b20f334910375aad6badf49"}
Jul 10 13:33:58.613718 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:33:58.613667    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt" podStartSLOduration=1.613651692 podStartE2EDuration="1.613651692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 13:33:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:33:58.611513948 +0000 UTC m=+2886.129434240" watchObservedRunningTime="2026-07-10 13:33:58.613651692 +0000 UTC m=+2886.131571959"
Jul 10 13:34:02.079234 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:02.079196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:34:07.698566 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:07.698524    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:34:07.699001 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:07.698607    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:34:07.711234 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:07.711214    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:34:08.648822 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:08.648777    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:34:25.397607 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:25.397572    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:34:42.481182 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:42.481141    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:34:42.563487 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:42.563456    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:34:42.667224 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:42.667192    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:34:56.039005 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:56.038971    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"]
Jul 10 13:34:56.062789 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:56.062756    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:34:56.965851 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:56.965817    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"]
Jul 10 13:34:56.986477 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:34:56.986434    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:00.785424 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:00.785393    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:35:11.058010 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.057953    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q" podUID="388c5722-4dec-47c8-832f-fef89f471752" containerName="main" containerID="cri-o://a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b" gracePeriod=45
Jul 10 13:35:11.302856 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.302831    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:35:11.381261 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381186    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-home\") pod \"388c5722-4dec-47c8-832f-fef89f471752\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") "
Jul 10 13:35:11.381261 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381219    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-tmp-dir\") pod \"388c5722-4dec-47c8-832f-fef89f471752\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") "
Jul 10 13:35:11.381261 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381254    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-model-cache\") pod \"388c5722-4dec-47c8-832f-fef89f471752\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") "
Jul 10 13:35:11.381529 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381299    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pfs7\" (UniqueName: \"kubernetes.io/projected/388c5722-4dec-47c8-832f-fef89f471752-kube-api-access-9pfs7\") pod \"388c5722-4dec-47c8-832f-fef89f471752\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") "
Jul 10 13:35:11.381529 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381318    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/388c5722-4dec-47c8-832f-fef89f471752-tls-certs\") pod \"388c5722-4dec-47c8-832f-fef89f471752\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") "
Jul 10 13:35:11.381529 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381376    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-dshm\") pod \"388c5722-4dec-47c8-832f-fef89f471752\" (UID: \"388c5722-4dec-47c8-832f-fef89f471752\") "
Jul 10 13:35:11.381529 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381465    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-home" (OuterVolumeSpecName: "home") pod "388c5722-4dec-47c8-832f-fef89f471752" (UID: "388c5722-4dec-47c8-832f-fef89f471752"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:11.381529 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381479    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "388c5722-4dec-47c8-832f-fef89f471752" (UID: "388c5722-4dec-47c8-832f-fef89f471752"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:11.381529 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381521    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-model-cache" (OuterVolumeSpecName: "model-cache") pod "388c5722-4dec-47c8-832f-fef89f471752" (UID: "388c5722-4dec-47c8-832f-fef89f471752"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:11.381785 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381597    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:11.381785 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381615    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:11.381785 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.381629    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:11.383477 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.383446    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/388c5722-4dec-47c8-832f-fef89f471752-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "388c5722-4dec-47c8-832f-fef89f471752" (UID: "388c5722-4dec-47c8-832f-fef89f471752"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:35:11.383593 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.383498    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-dshm" (OuterVolumeSpecName: "dshm") pod "388c5722-4dec-47c8-832f-fef89f471752" (UID: "388c5722-4dec-47c8-832f-fef89f471752"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:11.383593 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.383522    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/388c5722-4dec-47c8-832f-fef89f471752-kube-api-access-9pfs7" (OuterVolumeSpecName: "kube-api-access-9pfs7") pod "388c5722-4dec-47c8-832f-fef89f471752" (UID: "388c5722-4dec-47c8-832f-fef89f471752"). InnerVolumeSpecName "kube-api-access-9pfs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:35:11.482038 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.482005    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/388c5722-4dec-47c8-832f-fef89f471752-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:11.482038 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.482031    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/388c5722-4dec-47c8-832f-fef89f471752-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:11.482038 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.482044    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pfs7\" (UniqueName: \"kubernetes.io/projected/388c5722-4dec-47c8-832f-fef89f471752-kube-api-access-9pfs7\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:11.894423 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.894380    2577 generic.go:356] "Generic (PLEG): container finished" podID="388c5722-4dec-47c8-832f-fef89f471752" containerID="a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b" exitCode=0
Jul 10 13:35:11.894634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.894446    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"
Jul 10 13:35:11.894634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.894449    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q" event={"ID":"388c5722-4dec-47c8-832f-fef89f471752","Type":"ContainerDied","Data":"a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b"}
Jul 10 13:35:11.894634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.894565    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q" event={"ID":"388c5722-4dec-47c8-832f-fef89f471752","Type":"ContainerDied","Data":"a759f3b2bd3b00c379338dea10dcdca8692412b1a6a87a26d39368bcaf463992"}
Jul 10 13:35:11.894634 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.894583    2577 scope.go:117] "RemoveContainer" containerID="a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b"
Jul 10 13:35:11.903213 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.903199    2577 scope.go:117] "RemoveContainer" containerID="a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b"
Jul 10 13:35:11.903459 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:35:11.903439    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b\": container with ID starting with a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b not found: ID does not exist" containerID="a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b"
Jul 10 13:35:11.903555 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.903465    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b"} err="failed to get container status \"a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b\": rpc error: code = NotFound desc = could not find container \"a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b\": container with ID starting with a503c54b226ed13e4bca0f8500bc67d16865faa01a06f3a140c54713d192743b not found: ID does not exist"
Jul 10 13:35:11.916432 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.916412    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"]
Jul 10 13:35:11.920047 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.920026    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-7266ad/rate-test-model-7266ad-kserve-6bc8c4486c-xgf5q"]
Jul 10 13:35:11.985384 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:11.985352    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt" podUID="478333fc-537b-4f6d-b03a-daa44350812c" containerName="main" containerID="cri-o://d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98" gracePeriod=45
Jul 10 13:35:12.235468 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.235445    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:35:12.390654 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.390624    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-home\") pod \"478333fc-537b-4f6d-b03a-daa44350812c\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") "
Jul 10 13:35:12.390839 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.390661    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8g8n\" (UniqueName: \"kubernetes.io/projected/478333fc-537b-4f6d-b03a-daa44350812c-kube-api-access-v8g8n\") pod \"478333fc-537b-4f6d-b03a-daa44350812c\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") "
Jul 10 13:35:12.390839 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.390714    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-dshm\") pod \"478333fc-537b-4f6d-b03a-daa44350812c\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") "
Jul 10 13:35:12.390839 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.390758    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-model-cache\") pod \"478333fc-537b-4f6d-b03a-daa44350812c\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") "
Jul 10 13:35:12.390839 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.390785    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/478333fc-537b-4f6d-b03a-daa44350812c-tls-certs\") pod \"478333fc-537b-4f6d-b03a-daa44350812c\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") "
Jul 10 13:35:12.391016 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.390839    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-tmp-dir\") pod \"478333fc-537b-4f6d-b03a-daa44350812c\" (UID: \"478333fc-537b-4f6d-b03a-daa44350812c\") "
Jul 10 13:35:12.391016 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.390904    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-home" (OuterVolumeSpecName: "home") pod "478333fc-537b-4f6d-b03a-daa44350812c" (UID: "478333fc-537b-4f6d-b03a-daa44350812c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:12.391102 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.391037    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-model-cache" (OuterVolumeSpecName: "model-cache") pod "478333fc-537b-4f6d-b03a-daa44350812c" (UID: "478333fc-537b-4f6d-b03a-daa44350812c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:12.391147 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.391118    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "478333fc-537b-4f6d-b03a-daa44350812c" (UID: "478333fc-537b-4f6d-b03a-daa44350812c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:12.391211 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.391175    2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-model-cache\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:12.391211 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.391189    2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-home\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:12.392882 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.392857    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-dshm" (OuterVolumeSpecName: "dshm") pod "478333fc-537b-4f6d-b03a-daa44350812c" (UID: "478333fc-537b-4f6d-b03a-daa44350812c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:12.392882 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.392873    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478333fc-537b-4f6d-b03a-daa44350812c-kube-api-access-v8g8n" (OuterVolumeSpecName: "kube-api-access-v8g8n") pod "478333fc-537b-4f6d-b03a-daa44350812c" (UID: "478333fc-537b-4f6d-b03a-daa44350812c"). InnerVolumeSpecName "kube-api-access-v8g8n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:35:12.393033 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.392915    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/478333fc-537b-4f6d-b03a-daa44350812c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "478333fc-537b-4f6d-b03a-daa44350812c" (UID: "478333fc-537b-4f6d-b03a-daa44350812c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 10 13:35:12.492133 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.492100    2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/478333fc-537b-4f6d-b03a-daa44350812c-tls-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:12.492133 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.492131    2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-tmp-dir\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:12.492133 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.492141    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8g8n\" (UniqueName: \"kubernetes.io/projected/478333fc-537b-4f6d-b03a-daa44350812c-kube-api-access-v8g8n\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:12.492325 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.492149    2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/478333fc-537b-4f6d-b03a-daa44350812c-dshm\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:12.899849 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.899752    2577 generic.go:356] "Generic (PLEG): container finished" podID="478333fc-537b-4f6d-b03a-daa44350812c" containerID="d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98" exitCode=0
Jul 10 13:35:12.899849 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.899793    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"
Jul 10 13:35:12.899849 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.899836    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt" event={"ID":"478333fc-537b-4f6d-b03a-daa44350812c","Type":"ContainerDied","Data":"d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98"}
Jul 10 13:35:12.900079 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.899878    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt" event={"ID":"478333fc-537b-4f6d-b03a-daa44350812c","Type":"ContainerDied","Data":"391627b47d0f96cdabf08f6a3894f585eb108aa18b20f334910375aad6badf49"}
Jul 10 13:35:12.900079 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.899903    2577 scope.go:117] "RemoveContainer" containerID="d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98"
Jul 10 13:35:12.908156 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.908139    2577 scope.go:117] "RemoveContainer" containerID="d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98"
Jul 10 13:35:12.908391 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:35:12.908372    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98\": container with ID starting with d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98 not found: ID does not exist" containerID="d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98"
Jul 10 13:35:12.908452 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.908402    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98"} err="failed to get container status \"d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98\": rpc error: code = NotFound desc = could not find container \"d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98\": container with ID starting with d86797e015bfa7d130ba66367a1e401fec7afc8a8fc013353211dc105460aa98 not found: ID does not exist"
Jul 10 13:35:12.920624 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.920599    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"]
Jul 10 13:35:12.924569 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:12.924548    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-d5a846/rate-test-model-d5a846-kserve-54fc9ff779-55lbt"]
Jul 10 13:35:13.156529 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:13.156452    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="388c5722-4dec-47c8-832f-fef89f471752" path="/var/lib/kubelet/pods/388c5722-4dec-47c8-832f-fef89f471752/volumes"
Jul 10 13:35:13.156857 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:13.156843    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="478333fc-537b-4f6d-b03a-daa44350812c" path="/var/lib/kubelet/pods/478333fc-537b-4f6d-b03a-daa44350812c/volumes"
Jul 10 13:35:16.594704 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:16.594632    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:35:28.840624 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.840588    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7376-140175642413744"]
Jul 10 13:35:28.841057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.840924    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478333fc-537b-4f6d-b03a-daa44350812c" containerName="main"
Jul 10 13:35:28.841057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.840936    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="478333fc-537b-4f6d-b03a-daa44350812c" containerName="main"
Jul 10 13:35:28.841057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.840952    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="388c5722-4dec-47c8-832f-fef89f471752" containerName="main"
Jul 10 13:35:28.841057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.840957    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="388c5722-4dec-47c8-832f-fef89f471752" containerName="main"
Jul 10 13:35:28.841057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.841020    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="478333fc-537b-4f6d-b03a-daa44350812c" containerName="main"
Jul 10 13:35:28.841057 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.841029    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="388c5722-4dec-47c8-832f-fef89f471752" containerName="main"
Jul 10 13:35:28.845230 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.845214    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:28.848466 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.848442    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-8s9xp\""
Jul 10 13:35:28.850570 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.850547    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7376-140175642413744"]
Jul 10 13:35:28.918174 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:28.918148    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d72bn\" (UniqueName: \"kubernetes.io/projected/cf10bd3a-c53f-48b6-b197-69ee2dbd971a-kube-api-access-d72bn\") pod \"test-curl-7376-140175642413744\" (UID: \"cf10bd3a-c53f-48b6-b197-69ee2dbd971a\") " pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:29.018557 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:29.018532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d72bn\" (UniqueName: \"kubernetes.io/projected/cf10bd3a-c53f-48b6-b197-69ee2dbd971a-kube-api-access-d72bn\") pod \"test-curl-7376-140175642413744\" (UID: \"cf10bd3a-c53f-48b6-b197-69ee2dbd971a\") " pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:29.026420 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:29.026394    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d72bn\" (UniqueName: \"kubernetes.io/projected/cf10bd3a-c53f-48b6-b197-69ee2dbd971a-kube-api-access-d72bn\") pod \"test-curl-7376-140175642413744\" (UID: \"cf10bd3a-c53f-48b6-b197-69ee2dbd971a\") " pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:29.154341 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:29.154281    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:29.279036 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:29.279013    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7376-140175642413744"]
Jul 10 13:35:29.281434 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:35:29.281402    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf10bd3a_c53f_48b6_b197_69ee2dbd971a.slice/crio-b90f575f9f81e90b7aff5feb7dcad4df88622580558b3c974a2b105f37e1c4ab WatchSource:0}: Error finding container b90f575f9f81e90b7aff5feb7dcad4df88622580558b3c974a2b105f37e1c4ab: Status 404 returned error can't find the container with id b90f575f9f81e90b7aff5feb7dcad4df88622580558b3c974a2b105f37e1c4ab
Jul 10 13:35:29.283060 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:29.283040    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 10 13:35:29.976460 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:29.976434    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7376-140175642413744" event={"ID":"cf10bd3a-c53f-48b6-b197-69ee2dbd971a","Type":"ContainerStarted","Data":"b90f575f9f81e90b7aff5feb7dcad4df88622580558b3c974a2b105f37e1c4ab"}
Jul 10 13:35:30.982368 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:30.982331    2577 generic.go:356] "Generic (PLEG): container finished" podID="cf10bd3a-c53f-48b6-b197-69ee2dbd971a" containerID="1c4ad579e99f741c0e47ccb36cea4d399308b362204bebdb519d405b3f1ce116" exitCode=0
Jul 10 13:35:30.982754 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:30.982419    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7376-140175642413744" event={"ID":"cf10bd3a-c53f-48b6-b197-69ee2dbd971a","Type":"ContainerDied","Data":"1c4ad579e99f741c0e47ccb36cea4d399308b362204bebdb519d405b3f1ce116"}
Jul 10 13:35:32.123493 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.123465    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:32.142545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.142506    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d72bn\" (UniqueName: \"kubernetes.io/projected/cf10bd3a-c53f-48b6-b197-69ee2dbd971a-kube-api-access-d72bn\") pod \"cf10bd3a-c53f-48b6-b197-69ee2dbd971a\" (UID: \"cf10bd3a-c53f-48b6-b197-69ee2dbd971a\") "
Jul 10 13:35:32.144630 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.144601    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf10bd3a-c53f-48b6-b197-69ee2dbd971a-kube-api-access-d72bn" (OuterVolumeSpecName: "kube-api-access-d72bn") pod "cf10bd3a-c53f-48b6-b197-69ee2dbd971a" (UID: "cf10bd3a-c53f-48b6-b197-69ee2dbd971a"). InnerVolumeSpecName "kube-api-access-d72bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:35:32.145355 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.145333    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7376-140175642413744_cf10bd3a-c53f-48b6-b197-69ee2dbd971a/test-curl-7376-140175642413744/0.log"
Jul 10 13:35:32.167981 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.167857    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7376-140175642413744"]
Jul 10 13:35:32.169202 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.169179    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7376-140175642413744"]
Jul 10 13:35:32.243227 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.243167    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d72bn\" (UniqueName: \"kubernetes.io/projected/cf10bd3a-c53f-48b6-b197-69ee2dbd971a-kube-api-access-d72bn\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:32.297104 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.297068    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7376-140175642412592"]
Jul 10 13:35:32.297411 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.297398    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf10bd3a-c53f-48b6-b197-69ee2dbd971a" containerName="test-curl-7376-140175642413744"
Jul 10 13:35:32.297455 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.297413    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf10bd3a-c53f-48b6-b197-69ee2dbd971a" containerName="test-curl-7376-140175642413744"
Jul 10 13:35:32.297493 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.297480    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf10bd3a-c53f-48b6-b197-69ee2dbd971a" containerName="test-curl-7376-140175642413744"
Jul 10 13:35:32.300316 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.300301    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642412592"
Jul 10 13:35:32.308873 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.308841    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7376-140175642412592"]
Jul 10 13:35:32.343928 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.343896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fxpr\" (UniqueName: \"kubernetes.io/projected/c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f-kube-api-access-7fxpr\") pod \"test-curl-7376-140175642412592\" (UID: \"c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f\") " pod="openshift-ingress/test-curl-7376-140175642412592"
Jul 10 13:35:32.444329 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.444288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fxpr\" (UniqueName: \"kubernetes.io/projected/c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f-kube-api-access-7fxpr\") pod \"test-curl-7376-140175642412592\" (UID: \"c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f\") " pod="openshift-ingress/test-curl-7376-140175642412592"
Jul 10 13:35:32.452614 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.452591    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fxpr\" (UniqueName: \"kubernetes.io/projected/c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f-kube-api-access-7fxpr\") pod \"test-curl-7376-140175642412592\" (UID: \"c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f\") " pod="openshift-ingress/test-curl-7376-140175642412592"
Jul 10 13:35:32.616545 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.616476    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642412592"
Jul 10 13:35:32.740578 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.740554    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7376-140175642412592"]
Jul 10 13:35:32.742844 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:35:32.742820    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2b426ee_4cd1_4f29_b46a_e2eb6bc4424f.slice/crio-d40057a0c532cbf3cdf1b8d275870a0d508954bd3c519029c0b1cd7c7e502839 WatchSource:0}: Error finding container d40057a0c532cbf3cdf1b8d275870a0d508954bd3c519029c0b1cd7c7e502839: Status 404 returned error can't find the container with id d40057a0c532cbf3cdf1b8d275870a0d508954bd3c519029c0b1cd7c7e502839
Jul 10 13:35:32.993861 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.993830    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b90f575f9f81e90b7aff5feb7dcad4df88622580558b3c974a2b105f37e1c4ab"
Jul 10 13:35:32.993861 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.993841    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:32.994956 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:32.994930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7376-140175642412592" event={"ID":"c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f","Type":"ContainerStarted","Data":"d40057a0c532cbf3cdf1b8d275870a0d508954bd3c519029c0b1cd7c7e502839"}
Jul 10 13:35:33.004609 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:35:33.004580    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7376-140175642413744\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="cf10bd3a-c53f-48b6-b197-69ee2dbd971a" pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:33.155368 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:35:33.155334    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7376-140175642413744\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="cf10bd3a-c53f-48b6-b197-69ee2dbd971a" pod="openshift-ingress/test-curl-7376-140175642413744"
Jul 10 13:35:33.156438 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:33.156417    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf10bd3a-c53f-48b6-b197-69ee2dbd971a" path="/var/lib/kubelet/pods/cf10bd3a-c53f-48b6-b197-69ee2dbd971a/volumes"
Jul 10 13:35:34.000343 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:34.000310    2577 generic.go:356] "Generic (PLEG): container finished" podID="c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f" containerID="01c8cd210d54a14811c841b2f5255bef2371240dafd1578fcf9410f71b424029" exitCode=0
Jul 10 13:35:34.000516 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:34.000382    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7376-140175642412592" event={"ID":"c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f","Type":"ContainerDied","Data":"01c8cd210d54a14811c841b2f5255bef2371240dafd1578fcf9410f71b424029"}
Jul 10 13:35:35.136179 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:35.136152    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642412592"
Jul 10 13:35:35.158213 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:35.158191    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7376-140175642412592_c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f/test-curl-7376-140175642412592/0.log"
Jul 10 13:35:35.165969 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:35.165951    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7fxpr\" (UniqueName: \"kubernetes.io/projected/c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f-kube-api-access-7fxpr\") pod \"c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f\" (UID: \"c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f\") "
Jul 10 13:35:35.167916 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:35.167892    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f-kube-api-access-7fxpr" (OuterVolumeSpecName: "kube-api-access-7fxpr") pod "c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f" (UID: "c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f"). InnerVolumeSpecName "kube-api-access-7fxpr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:35:35.181047 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:35.181025    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7376-140175642412592"]
Jul 10 13:35:35.184782 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:35.184761    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7376-140175642412592"]
Jul 10 13:35:35.267243 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:35.267182    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7fxpr\" (UniqueName: \"kubernetes.io/projected/c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f-kube-api-access-7fxpr\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:36.009259 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:36.009229    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642412592"
Jul 10 13:35:36.009433 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:36.009235    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d40057a0c532cbf3cdf1b8d275870a0d508954bd3c519029c0b1cd7c7e502839"
Jul 10 13:35:36.018875 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:35:36.018849    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7376-140175642412592\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f" pod="openshift-ingress/test-curl-7376-140175642412592"
Jul 10 13:35:37.156296 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:37.156268    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f" path="/var/lib/kubelet/pods/c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f/volumes"
Jul 10 13:35:44.337919 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.337879    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/test-curl-7376-140175642516192"]
Jul 10 13:35:44.338398 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.338319    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f" containerName="test-curl-7376-140175642412592"
Jul 10 13:35:44.338398 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.338337    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f" containerName="test-curl-7376-140175642412592"
Jul 10 13:35:44.338526 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.338417    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2b426ee-4cd1-4f29-b46a-e2eb6bc4424f" containerName="test-curl-7376-140175642412592"
Jul 10 13:35:44.341411 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.341388    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642516192"
Jul 10 13:35:44.343791 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.343772    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-dockercfg-8s9xp\""
Jul 10 13:35:44.347165 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.347144    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7376-140175642516192"]
Jul 10 13:35:44.443602 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.443576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m97h\" (UniqueName: \"kubernetes.io/projected/75535cbd-7396-4c9a-9ef8-2f9e46bb323f-kube-api-access-8m97h\") pod \"test-curl-7376-140175642516192\" (UID: \"75535cbd-7396-4c9a-9ef8-2f9e46bb323f\") " pod="openshift-ingress/test-curl-7376-140175642516192"
Jul 10 13:35:44.544548 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.544516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m97h\" (UniqueName: \"kubernetes.io/projected/75535cbd-7396-4c9a-9ef8-2f9e46bb323f-kube-api-access-8m97h\") pod \"test-curl-7376-140175642516192\" (UID: \"75535cbd-7396-4c9a-9ef8-2f9e46bb323f\") " pod="openshift-ingress/test-curl-7376-140175642516192"
Jul 10 13:35:44.553522 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.553502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m97h\" (UniqueName: \"kubernetes.io/projected/75535cbd-7396-4c9a-9ef8-2f9e46bb323f-kube-api-access-8m97h\") pod \"test-curl-7376-140175642516192\" (UID: \"75535cbd-7396-4c9a-9ef8-2f9e46bb323f\") " pod="openshift-ingress/test-curl-7376-140175642516192"
Jul 10 13:35:44.651854 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.651764    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642516192"
Jul 10 13:35:44.775758 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:44.775732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/test-curl-7376-140175642516192"]
Jul 10 13:35:44.778002 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:35:44.777975    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75535cbd_7396_4c9a_9ef8_2f9e46bb323f.slice/crio-430c229bd3873583de95b569ec8443cd50cf7c5bdad736b8fe4def01d9b311e5 WatchSource:0}: Error finding container 430c229bd3873583de95b569ec8443cd50cf7c5bdad736b8fe4def01d9b311e5: Status 404 returned error can't find the container with id 430c229bd3873583de95b569ec8443cd50cf7c5bdad736b8fe4def01d9b311e5
Jul 10 13:35:45.046771 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:45.046735    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7376-140175642516192" event={"ID":"75535cbd-7396-4c9a-9ef8-2f9e46bb323f","Type":"ContainerStarted","Data":"430c229bd3873583de95b569ec8443cd50cf7c5bdad736b8fe4def01d9b311e5"}
Jul 10 13:35:46.052669 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:46.052639    2577 generic.go:356] "Generic (PLEG): container finished" podID="75535cbd-7396-4c9a-9ef8-2f9e46bb323f" containerID="6039aa0b8a566c476a0fe76c651c0c10db714ecd15aed7cce0701b2c22080185" exitCode=0
Jul 10 13:35:46.053071 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:46.052729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/test-curl-7376-140175642516192" event={"ID":"75535cbd-7396-4c9a-9ef8-2f9e46bb323f","Type":"ContainerDied","Data":"6039aa0b8a566c476a0fe76c651c0c10db714ecd15aed7cce0701b2c22080185"}
Jul 10 13:35:47.190703 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.190681    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642516192"
Jul 10 13:35:47.213184 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.213153    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_test-curl-7376-140175642516192_75535cbd-7396-4c9a-9ef8-2f9e46bb323f/test-curl-7376-140175642516192/0.log"
Jul 10 13:35:47.234388 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.234365    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/test-curl-7376-140175642516192"]
Jul 10 13:35:47.237962 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.237941    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/test-curl-7376-140175642516192"]
Jul 10 13:35:47.269304 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.269283    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8m97h\" (UniqueName: \"kubernetes.io/projected/75535cbd-7396-4c9a-9ef8-2f9e46bb323f-kube-api-access-8m97h\") pod \"75535cbd-7396-4c9a-9ef8-2f9e46bb323f\" (UID: \"75535cbd-7396-4c9a-9ef8-2f9e46bb323f\") "
Jul 10 13:35:47.271211 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.271190    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75535cbd-7396-4c9a-9ef8-2f9e46bb323f-kube-api-access-8m97h" (OuterVolumeSpecName: "kube-api-access-8m97h") pod "75535cbd-7396-4c9a-9ef8-2f9e46bb323f" (UID: "75535cbd-7396-4c9a-9ef8-2f9e46bb323f"). InnerVolumeSpecName "kube-api-access-8m97h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:35:47.370911 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.370839    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8m97h\" (UniqueName: \"kubernetes.io/projected/75535cbd-7396-4c9a-9ef8-2f9e46bb323f-kube-api-access-8m97h\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:47.480438 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.480406    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:47.883291 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.883259    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:47.983220 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:47.983182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:48.067541 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:48.067511    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="430c229bd3873583de95b569ec8443cd50cf7c5bdad736b8fe4def01d9b311e5"
Jul 10 13:35:48.067727 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:48.067547    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/test-curl-7376-140175642516192"
Jul 10 13:35:48.078532 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:35:48.078485    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7376-140175642516192\" is forbidden: User \"system:node:ip-10-0-134-90.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-134-90.ec2.internal' and this object" podUID="75535cbd-7396-4c9a-9ef8-2f9e46bb323f" pod="openshift-ingress/test-curl-7376-140175642516192"
Jul 10 13:35:48.083859 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:48.083838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:48.189295 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:48.189263    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:49.156969 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:49.156928    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75535cbd-7396-4c9a-9ef8-2f9e46bb323f" path="/var/lib/kubelet/pods/75535cbd-7396-4c9a-9ef8-2f9e46bb323f/volumes"
Jul 10 13:35:51.971398 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:51.971367    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:35:53.775598 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:53.775550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:53.859249 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:53.859205    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:54.086146 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:54.086075    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"]
Jul 10 13:35:54.086329 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:54.086308    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy" containerID="cri-o://582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c" gracePeriod=30
Jul 10 13:35:54.144221 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:54.144189    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:54.316086 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:54.316051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:54.564369 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:54.564337    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:54.893906 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:54.893823    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:55.046653 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:55.046623    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:55.144828 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:55.144720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:55.347673 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:55.347638    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:35:59.339115 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.339089    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:35:59.465265 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465227    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-token\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465428 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465289    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istiod-ca-cert\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465428 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465320    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-data\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465428 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465351    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-certs\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465428 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465410    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-socket\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465446    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7px7j\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-kube-api-access-7px7j\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465484    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-envoy\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465530    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-credential-socket\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465618 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465561    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-podinfo\") pod \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\" (UID: \"5245d25a-cf8b-417f-a0f7-e077d3efaad7\") "
Jul 10 13:35:59.465853 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465712    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:59.465853 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465710    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 10 13:35:59.465979 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465851    2577 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istiod-ca-cert\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:59.465979 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.465869    2577 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-certs\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:59.466084 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.466008    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:59.466084 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.466036    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:59.466347 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.466323    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-data" (OuterVolumeSpecName: "istio-data") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:59.467698 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.467660    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-kube-api-access-7px7j" (OuterVolumeSpecName: "kube-api-access-7px7j") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "kube-api-access-7px7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:35:59.467874 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.467750    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 10 13:35:59.467943 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.467919    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 10 13:35:59.467981 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.467945    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5245d25a-cf8b-417f-a0f7-e077d3efaad7" (UID: "5245d25a-cf8b-417f-a0f7-e077d3efaad7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 10 13:35:59.566757 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.566733    2577 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-workload-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:59.566757 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.566754    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7px7j\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-kube-api-access-7px7j\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:59.566930 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.566764    2577 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-envoy\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:59.566930 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.566772    2577 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-credential-socket\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:59.566930 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.566780    2577 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-podinfo\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:59.566930 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.566788    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-token\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:35:59.566930 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:35:59.566795    2577 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5245d25a-cf8b-417f-a0f7-e077d3efaad7-istio-data\") on node \"ip-10-0-134-90.ec2.internal\" DevicePath \"\""
Jul 10 13:36:00.120481 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.120443    2577 generic.go:356] "Generic (PLEG): container finished" podID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerID="582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c" exitCode=0
Jul 10 13:36:00.120673 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.120501    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"
Jul 10 13:36:00.120673 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.120533    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" event={"ID":"5245d25a-cf8b-417f-a0f7-e077d3efaad7","Type":"ContainerDied","Data":"582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c"}
Jul 10 13:36:00.120673 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.120603    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk" event={"ID":"5245d25a-cf8b-417f-a0f7-e077d3efaad7","Type":"ContainerDied","Data":"c5ced4679bbed132ba2f3253e4b5f2b0eeb0430224ca9f0071b1dedc5053e158"}
Jul 10 13:36:00.120673 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.120633    2577 scope.go:117] "RemoveContainer" containerID="582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c"
Jul 10 13:36:00.129388 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.129373    2577 scope.go:117] "RemoveContainer" containerID="e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205"
Jul 10 13:36:00.136934 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.136916    2577 scope.go:117] "RemoveContainer" containerID="582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c"
Jul 10 13:36:00.137163 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:36:00.137145    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c\": container with ID starting with 582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c not found: ID does not exist" containerID="582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c"
Jul 10 13:36:00.137204 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.137172    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c"} err="failed to get container status \"582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c\": rpc error: code = NotFound desc = could not find container \"582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c\": container with ID starting with 582e96ff85c6c98985bac8fa68f36b6192216c680e6e026620f2c6d7ba80947c not found: ID does not exist"
Jul 10 13:36:00.137204 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.137190    2577 scope.go:117] "RemoveContainer" containerID="e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205"
Jul 10 13:36:00.137446 ip-10-0-134-90 kubenswrapper[2577]: E0710 13:36:00.137429    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205\": container with ID starting with e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205 not found: ID does not exist" containerID="e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205"
Jul 10 13:36:00.137482 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.137452    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205"} err="failed to get container status \"e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205\": rpc error: code = NotFound desc = could not find container \"e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205\": container with ID starting with e11a63092b780f44d45a3249bfa6158ad43806f9c4ee2f4eb73d865273ee9205 not found: ID does not exist"
Jul 10 13:36:00.143623 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.143604    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"]
Jul 10 13:36:00.148579 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:00.148561    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7266ad-openshift-default-659449d787-wnthk"]
Jul 10 13:36:01.045741 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:01.045709    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:36:01.115999 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:01.115973    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:36:01.157002 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:01.156973    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" path="/var/lib/kubelet/pods/5245d25a-cf8b-417f-a0f7-e077d3efaad7/volumes"
Jul 10 13:36:01.339455 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:01.339369    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:36:01.564425 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:01.564372    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:36:04.372467 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:04.372433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-2xbjm"]
Jul 10 13:36:07.602089 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:07.602062    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6798dbc-h8zrk_e3333c65-569c-4dc0-a524-85d28ffab103/copy-manifests/0.log"
Jul 10 13:36:07.609015 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:07.608994    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6798dbc-h8zrk_e3333c65-569c-4dc0-a524-85d28ffab103/manager/0.log"
Jul 10 13:36:09.820620 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:09.820592    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-t2ftc_284074a6-12ad-4d3a-ae71-892e68c8e8ad/kuadrant-console-plugin/0.log"
Jul 10 13:36:10.253734 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:10.253707    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2xbjm_b219d4ef-0665-402a-bbc1-b2baf2b7fcdd/limitador/0.log"
Jul 10 13:36:11.022292 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:11.022263    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779ffb979b-c8f9s_3e375fb7-59e1-4272-acfa-c3a9afb7e93c/kube-auth-proxy/0.log"
Jul 10 13:36:12.327288 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:12.327265    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbshbcq_9bde213d-ab21-47c1-a74e-ae5521a12638/main/0.log"
Jul 10 13:36:12.560262 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:12.560233    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-wfm4f_3ce888d9-8971-4227-8e1f-ad2cb4869f8a/main/0.log"
Jul 10 13:36:16.201471 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:16.201436    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:36:16.319690 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:16.319657    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log" limit=1024
Jul 10 13:36:19.225953 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:19.225923    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k7rxk_0b926a5b-58aa-4b93-bec4-f0728adbdd7f/global-pull-secret-syncer/0.log"
Jul 10 13:36:19.324763 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:19.324735    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6plxw_ae5e1017-100f-4a1f-bdbc-19095d60dbca/konnectivity-agent/0.log"
Jul 10 13:36:19.443328 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:19.443296    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-90.ec2.internal_2216e064274bc03d8f6db46798e4f858/haproxy/0.log"
Jul 10 13:36:24.538453 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:24.538424    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-t2ftc_284074a6-12ad-4d3a-ae71-892e68c8e8ad/kuadrant-console-plugin/0.log"
Jul 10 13:36:24.866820 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:24.866730    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-2xbjm_b219d4ef-0665-402a-bbc1-b2baf2b7fcdd/limitador/0.log"
Jul 10 13:36:26.888296 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:26.888256    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-9qxrz_92aea24c-593a-4d02-b2bc-da3cf03686a5/cluster-monitoring-operator/0.log"
Jul 10 13:36:27.033524 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:27.033499    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7bdf578946-xwvjb_5f67ca0c-a309-405f-9ee0-492309a88f35/metrics-server/0.log"
Jul 10 13:36:27.231762 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:27.231739    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nvm47_7e95c17c-db0b-4eb3-8d6f-8845add347fd/node-exporter/0.log"
Jul 10 13:36:27.258402 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:27.258379    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nvm47_7e95c17c-db0b-4eb3-8d6f-8845add347fd/kube-rbac-proxy/0.log"
Jul 10 13:36:27.284788 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:27.284765    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nvm47_7e95c17c-db0b-4eb3-8d6f-8845add347fd/init-textfile/0.log"
Jul 10 13:36:29.518526 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.518496    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"]
Jul 10 13:36:29.518968 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.518910    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75535cbd-7396-4c9a-9ef8-2f9e46bb323f" containerName="test-curl-7376-140175642516192"
Jul 10 13:36:29.518968 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.518929    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="75535cbd-7396-4c9a-9ef8-2f9e46bb323f" containerName="test-curl-7376-140175642516192"
Jul 10 13:36:29.518968 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.518956    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy"
Jul 10 13:36:29.518968 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.518965    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy"
Jul 10 13:36:29.519125 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.518975    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy"
Jul 10 13:36:29.519125 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.518986    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy"
Jul 10 13:36:29.519125 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.519056    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy"
Jul 10 13:36:29.519125 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.519067    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5245d25a-cf8b-417f-a0f7-e077d3efaad7" containerName="istio-proxy"
Jul 10 13:36:29.519125 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.519081    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="75535cbd-7396-4c9a-9ef8-2f9e46bb323f" containerName="test-curl-7376-140175642516192"
Jul 10 13:36:29.522351 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.522335    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.524702 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.524686    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qthfs\"/\"default-dockercfg-x4wbf\""
Jul 10 13:36:29.524963 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.524944    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qthfs\"/\"openshift-service-ca.crt\""
Jul 10 13:36:29.525897 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.525882    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qthfs\"/\"kube-root-ca.crt\""
Jul 10 13:36:29.532650 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.532630    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"]
Jul 10 13:36:29.612538 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.612512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-sys\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.612675 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.612555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-podres\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.612675 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.612574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vwlx\" (UniqueName: \"kubernetes.io/projected/ce30fb2d-1962-4243-b980-3bf4f9167e94-kube-api-access-9vwlx\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.612675 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.612636    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-lib-modules\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.612675 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.612654    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-proc\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.713904 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.713879    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-lib-modules\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.713904 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.713907    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-proc\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.714062 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.713939    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-sys\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.714062 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.713989    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-podres\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.714062 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.714012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-proc\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.714062 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.714016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vwlx\" (UniqueName: \"kubernetes.io/projected/ce30fb2d-1962-4243-b980-3bf4f9167e94-kube-api-access-9vwlx\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.714195 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.714062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-lib-modules\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.714195 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.714078    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-sys\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.714195 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.714127    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ce30fb2d-1962-4243-b980-3bf4f9167e94-podres\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.722443 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.722417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vwlx\" (UniqueName: \"kubernetes.io/projected/ce30fb2d-1962-4243-b980-3bf4f9167e94-kube-api-access-9vwlx\") pod \"perf-node-gather-daemonset-2kn6x\" (UID: \"ce30fb2d-1962-4243-b980-3bf4f9167e94\") " pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.831940 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.831869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:29.957308 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:29.957284    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"]
Jul 10 13:36:29.959969 ip-10-0-134-90 kubenswrapper[2577]: W0710 13:36:29.959942    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podce30fb2d_1962_4243_b980_3bf4f9167e94.slice/crio-1d075de9799544e79977a2c22848750671306e19ab6f5e24925ebd822826252f WatchSource:0}: Error finding container 1d075de9799544e79977a2c22848750671306e19ab6f5e24925ebd822826252f: Status 404 returned error can't find the container with id 1d075de9799544e79977a2c22848750671306e19ab6f5e24925ebd822826252f
Jul 10 13:36:30.242871 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:30.242835    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x" event={"ID":"ce30fb2d-1962-4243-b980-3bf4f9167e94","Type":"ContainerStarted","Data":"2feb1b1ca5e0b763e23b8d71fdc6a180bff774bb34919475ca2064c01c4a8d9d"}
Jul 10 13:36:30.243048 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:30.242887    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x" event={"ID":"ce30fb2d-1962-4243-b980-3bf4f9167e94","Type":"ContainerStarted","Data":"1d075de9799544e79977a2c22848750671306e19ab6f5e24925ebd822826252f"}
Jul 10 13:36:30.243048 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:30.242970    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:30.258947 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:30.258906    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x" podStartSLOduration=1.258893161 podStartE2EDuration="1.258893161s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 13:36:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 13:36:30.258456136 +0000 UTC m=+3037.776376404" watchObservedRunningTime="2026-07-10 13:36:30.258893161 +0000 UTC m=+3037.776813431"
Jul 10 13:36:31.079730 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:31.079700    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-h7rjv_ec3569b1-bfbe-4cb1-823e-6b468c59632e/volume-data-source-validator/0.log"
Jul 10 13:36:32.099827 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:32.099779    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8qvp_9643749b-477e-4002-9e90-589c3afb740c/dns/0.log"
Jul 10 13:36:32.124654 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:32.124630    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m8qvp_9643749b-477e-4002-9e90-589c3afb740c/kube-rbac-proxy/0.log"
Jul 10 13:36:32.271566 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:32.271537    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mdmm5_469f0fde-1dcd-4d2e-aee1-24a1a72c892f/dns-node-resolver/0.log"
Jul 10 13:36:32.858391 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:32.858360    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7ngx9_45fd9958-6924-45b1-8e9a-c1bb4067094f/node-ca/0.log"
Jul 10 13:36:34.106493 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:34.106468    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779ffb979b-c8f9s_3e375fb7-59e1-4272-acfa-c3a9afb7e93c/kube-auth-proxy/0.log"
Jul 10 13:36:35.025020 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:35.024993    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8tb5d_a89af1cd-d7aa-4849-82a5-b0917e58f819/serve-healthcheck-canary/0.log"
Jul 10 13:36:35.576422 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:35.576394    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44mnv_9e070fe7-3e7c-479f-aa6e-0015db407326/kube-rbac-proxy/0.log"
Jul 10 13:36:35.598141 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:35.598120    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44mnv_9e070fe7-3e7c-479f-aa6e-0015db407326/exporter/0.log"
Jul 10 13:36:35.619543 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:35.619523    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-44mnv_9e070fe7-3e7c-479f-aa6e-0015db407326/extractor/0.log"
Jul 10 13:36:36.256384 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:36.256356    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qthfs/perf-node-gather-daemonset-2kn6x"
Jul 10 13:36:38.751582 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:38.751555    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6798dbc-h8zrk_e3333c65-569c-4dc0-a524-85d28ffab103/manager/0.log"
Jul 10 13:36:38.773922 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:38.773898    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6798dbc-h8zrk_e3333c65-569c-4dc0-a524-85d28ffab103/copy-manifests/0.log"
Jul 10 13:36:39.765268 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:39.765241    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779ffb979b-c8f9s_3e375fb7-59e1-4272-acfa-c3a9afb7e93c/kube-auth-proxy/0.log"
Jul 10 13:36:40.248687 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:40.248659    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86f6864fb7-dmvv4_5091ef3b-9789-456d-9d6e-7435ea2c7011/manager/0.log"
Jul 10 13:36:40.303455 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:40.303427    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-h6b6x_424c4831-dea6-4e67-9a4a-e070281f15d7/openshift-lws-operator/0.log"
Jul 10 13:36:41.408512 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:41.408429    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-779ffb979b-c8f9s_3e375fb7-59e1-4272-acfa-c3a9afb7e93c/kube-auth-proxy/0.log"
Jul 10 13:36:45.540315 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:45.540280    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-27gkr_d55714b6-b762-4a5f-b5e1-cd28150a65fe/migrator/0.log"
Jul 10 13:36:45.570425 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:45.570393    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-27gkr_d55714b6-b762-4a5f-b5e1-cd28150a65fe/graceful-termination/0.log"
Jul 10 13:36:47.119161 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:47.119135    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l96bp_f6510c54-bb9d-41b4-b3b2-03503728255f/kube-multus-additional-cni-plugins/0.log"
Jul 10 13:36:47.192032 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:47.192003    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l96bp_f6510c54-bb9d-41b4-b3b2-03503728255f/egress-router-binary-copy/0.log"
Jul 10 13:36:47.254555 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:47.254522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l96bp_f6510c54-bb9d-41b4-b3b2-03503728255f/cni-plugins/0.log"
Jul 10 13:36:47.286791 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:47.286770    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l96bp_f6510c54-bb9d-41b4-b3b2-03503728255f/bond-cni-plugin/0.log"
Jul 10 13:36:47.313568 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:47.313551    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l96bp_f6510c54-bb9d-41b4-b3b2-03503728255f/routeoverride-cni/0.log"
Jul 10 13:36:47.336521 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:47.336498    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l96bp_f6510c54-bb9d-41b4-b3b2-03503728255f/whereabouts-cni-bincopy/0.log"
Jul 10 13:36:47.370403 ip-10-0-134-90 kubenswrapper[2577]: I0710 13:36:47.370342    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l96bp_f6510c54-bb9d-41b4-b3b2-03503728255f/whereabouts-cni/0.log"