Jul 30 22:46:01.469868 ip-10-0-135-246 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 22:46:01.469876 ip-10-0-135-246 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 22:46:01.469883 ip-10-0-135-246 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 22:46:01.470105 ip-10-0-135-246 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 22:46:10.846761 ip-10-0-135-246 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 22:46:10.846777 ip-10-0-135-246 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot fffd5d88fbe0468289e5f857b8ba9f7e --
Jul 30 22:47:56.173548 ip-10-0-135-246 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 22:47:56.475938 ip-10-0-135-246 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:47:56.475938 ip-10-0-135-246 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 22:47:56.475938 ip-10-0-135-246 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:47:56.475938 ip-10-0-135-246 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 22:47:56.475938 ip-10-0-135-246 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 22:47:56.477438 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.477316    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 22:47:56.482366 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482348    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:47:56.482366 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482365    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482371    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482375    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482379    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482382    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482385    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482388    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482391    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482395    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482398    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482400    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482405    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482408    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482410    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482413    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482416    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482419    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482423    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482425    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482428    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:47:56.482440 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482431    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482433    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482437    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482440    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482443    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482446    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482449    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482452    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482456    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482459    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482462    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482465    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482468    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482471    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482474    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482477    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482479    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482482    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482485    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482488    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:47:56.482959 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482491    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482494    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482497    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482500    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482503    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482506    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482509    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482511    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482514    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482517    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482519    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482522    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482525    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482528    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482531    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482534    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482537    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482540    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482543    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:47:56.483502 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482548    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482554    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482558    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482562    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482565    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482569    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482572    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482575    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482580    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482585    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482588    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482591    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482594    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482597    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482600    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482604    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482607    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482610    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482612    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:47:56.484006 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482615    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482618    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482621    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482624    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482627    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482629    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482632    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482635    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482638    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482642    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482645    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482647    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482651    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482654    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482657    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482660    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482663    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482666    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482668    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.482672    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:47:56.484513 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483457    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483466    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483469    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483474    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483478    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483481    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483484    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483487    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483490    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483493    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483495    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483498    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483502    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483504    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483508    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483510    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483513    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483517    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483521    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483524    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:47:56.485033 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483528    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483531    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483534    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483537    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483540    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483543    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483546    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483548    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483551    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483554    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483557    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483560    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483563    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483566    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483569    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483572    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483575    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483577    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483580    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483583    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:47:56.485613 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483586    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483588    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483591    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483593    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483596    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483599    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483601    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483604    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483607    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483610    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483613    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483616    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483619    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483622    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483625    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483628    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483630    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483633    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483636    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483639    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:47:56.486182 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483642    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483645    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483648    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483651    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483653    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483657    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483660    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483662    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483665    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483668    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483670    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483673    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483676    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483679    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483682    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483685    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483688    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483692    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483697    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:47:56.487184 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483700    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483705    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483708    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483711    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483716    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483719    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483722    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483725    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483728    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483731    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483733    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483736    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483739    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483742    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483744    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483747    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483749    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483752    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483755    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:47:56.487798 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.483760    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484177    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484183    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484186    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484189    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484191    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484194    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484197    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484201    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484203    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484207    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484209    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484213    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484216    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484219    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484223    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484227    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484230    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484233    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:47:56.488353 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484236    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484239    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484241    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484244    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484247    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484265    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484270    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484274    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484278    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484282    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484285    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484287    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484290    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484294    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484297    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484300    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484305    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484309    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484312    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:47:56.488894 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484315    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484318    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484321    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484324    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484327    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484330    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484336    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484338    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484342    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484345    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484348    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484350    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484353    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484356    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484359    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484363    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484366    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484369    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484372    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484374    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:47:56.489418 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484377    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484380    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484383    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484386    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484389    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484391    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484394    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484397    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484400    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484403    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484406    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484409    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484412    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484415    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484418    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484421    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484423    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484426    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484430    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:47:56.489946 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484433    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484438    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484442    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484445    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484449    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484452    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484455    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484458    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484460    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484464    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484468    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484471    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484474    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484477    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484479    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484482    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484485    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484488    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484490    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:47:56.490517 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484493    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484496    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484499    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.484501    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484588    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484598    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484609    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484617    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484622    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484625    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484630    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484635    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484640    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484643    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484647    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484651    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484654    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484658    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484661    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484665    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484668    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.484671    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485180    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485186    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 22:47:56.491003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485190    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485194    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485214    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485219    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485223    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485227    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485231    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485234    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485237    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485241    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485244    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485249    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485270    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485275    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485279    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485287    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485293    2561 flags.go:64] FLAG: --enable-server="true"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485297    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485305    2561 flags.go:64] FLAG: --event-burst="100"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485309    2561 flags.go:64] FLAG: --event-qps="50"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485313    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485316    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485320    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485325    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 22:47:56.491645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485328    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485331    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485335    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485338    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485341    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485344    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485347    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485352    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485355    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485358    2561 flags.go:64] FLAG: --feature-gates=""
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485362    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485366    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485369    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485372    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485376    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485379    2561 flags.go:64] FLAG: --help="false"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485382    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485386    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485390    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485393    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485398    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485402    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485405    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 22:47:56.492301 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485408    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485411    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485414    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485418    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485421    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485425    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485428    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485431    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485434    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485437    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485441    2561 flags.go:64] FLAG: --lock-file=""
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485444    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485447    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485450    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485456    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485459    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485465    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485468    2561 flags.go:64] FLAG: --logging-format="text"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485471    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485474    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485478    2561 flags.go:64] FLAG: --manifest-url=""
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485481    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485485    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485488    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485493    2561 flags.go:64] FLAG: --max-pods="110"
Jul 30 22:47:56.492931 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485497    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485501    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485504    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485507    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485510    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485514    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485518    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485531    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485534    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485537    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485541    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485544    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485551    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485554    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485557    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485560    2561 flags.go:64] FLAG: --port="10250"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485564    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485567    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09d7b1df730a2cbbf"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485571    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485574    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485577    2561 flags.go:64] FLAG: --register-node="true"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485580    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485584    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485588    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 30 22:47:56.493618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485592    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485594    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485599    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485602    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485605    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485608    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485611    2561 flags.go:64] FLAG: --runonce="false"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485614    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485618    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485623    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485626    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485629    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485633    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485636    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485641    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485644    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485647    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485650    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485653    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485657    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485660    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485663    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485669    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485672    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485676    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 22:47:56.494411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485681    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485684    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485687    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485690    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485693    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485696    2561 flags.go:64] FLAG: --v="2"
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485702    2561 flags.go:64] FLAG: --version="false"
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485707    2561 flags.go:64] FLAG: --vmodule=""
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485711    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.485715    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485844    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485848    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485852    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485855    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485858    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485861    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485866    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485868    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485872    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485875    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485878    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485880    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:47:56.495082 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485884    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485887    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485889    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485892    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485896    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485899    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485902    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485905    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485908    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485911    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485913    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485916    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485919    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485921    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485924    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485927    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485931    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485933    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485936    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:47:56.495700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485939    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485942    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485944    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485947    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485950    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485953    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485956    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485960    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485963    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485965    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485969    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485972    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485975    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.485977    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.486027    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.486080    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.486088    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.486095    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.486101    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487319    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:47:56.496203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487403    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487415    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487425    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487433    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487442    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487451    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487459    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487468    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487476    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487485    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487494    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487502    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487518    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487527    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487540    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487552    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487560    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487569    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487578    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:47:56.496778 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487586    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487594    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487602    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487610    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487618    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487631    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487638    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487647    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487654    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487681    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487689    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487697    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487713    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487722    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487747    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487755    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487762    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487775    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487783    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487793    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:47:56.497313 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487800    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487807    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487813    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487817    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487822    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487830    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487852    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487972    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.487981    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.488474    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.495938    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.495957    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.496700    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.496709    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 22:47:56.497846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496780    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496787    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496791    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496795    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496798    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496801    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496804    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496807    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496809    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496813    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496815    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496818    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496821    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496826    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496830    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496833    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496837    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496840    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496843    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496846    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:47:56.498230 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496849    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496852    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496855    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496859    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496863    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496866    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496868    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496871    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496874    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496878    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496881    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496884    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496887    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496890    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496893    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496895    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496899    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496902    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496905    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:47:56.498792 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496908    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496911    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496914    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496917    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496920    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496923    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496925    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496928    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496930    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496934    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496938    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496941    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496944    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496947    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496950    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496952    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496955    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496958    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496961    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496964    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:47:56.499321 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496967    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496969    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496974    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496978    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496982    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496985    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496988    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496991    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496994    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496997    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.496999    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497002    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497005    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497008    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497011    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497013    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497016    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497019    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497022    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497025    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:47:56.499857 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497028    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497030    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497033    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497035    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497038    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497041    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497044    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497046    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497049    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497052    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497055    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497058    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497060    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497063    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497068    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497071    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497074    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497077    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497080    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:47:56.500404 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497083    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.497089    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497222    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497227    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497230    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497233    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497236    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497239    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497242    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497245    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497248    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497265    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497268    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497271    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497274    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 22:47:56.500909 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497277    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497280    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497283    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497286    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497289    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497291    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497294    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497297    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497300    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497303    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497306    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497309    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497312    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497316    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497319    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497322    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497326    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497328    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497331    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497334    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 22:47:56.501323 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497337    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497340    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497343    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497346    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497348    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497351    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497354    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497356    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497359    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497362    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497365    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497368    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497371    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497373    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497376    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497379    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497382    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497385    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497388    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497390    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 22:47:56.501846 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497393    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497396    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497399    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497403    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497407    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497412    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497418    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497421    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497424    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497427    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497430    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497433    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497436    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497439    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497441    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497444    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497447    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497449    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 22:47:56.502398 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497452    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497455    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497458    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497460    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497463    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497466    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497468    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497471    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497474    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497476    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497479    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497481    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497484    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497487    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497490    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497493    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497496    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497499    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497501    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497506    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 22:47:56.502869 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497509    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497513    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497516    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497519    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497522    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497525    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497528    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:56.497530    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.497536    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.497694    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.499876    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.501208    2561 server.go:1019] "Starting client certificate rotation"
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.501324    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 22:47:56.503415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.501363    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 22:47:56.503763 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.503579    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 22:47:56.506474 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.506455    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 22:47:56.515878 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.515857    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 30 22:47:56.518939 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.518918    2561 log.go:25] "Validated CRI v1 image API"
Jul 30 22:47:56.520574 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.520554    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 22:47:56.522815 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.522790    2561 fs.go:135] Filesystem UUIDs: map[47de7559-e8ce-4978-90a9-bfa9e006f603:/dev/nvme0n1p4 4c638036-2c34-4f5e-94c3-fd9ed04feee9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 30 22:47:56.522892 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.522812    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 22:47:56.527463 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.527343    2561 manager.go:216] Machine: {Timestamp:2026-07-30 22:47:56.526795515 +0000 UTC m=+0.257940693 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099630 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c679a5630163b0a97fbb84c2375a0 SystemUUID:ec2c679a-5630-163b-0a97-fbb84c2375a0 BootID:fffd5d88-fbe0-4682-89e5-f857b8ba9f7e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ea:a0:2a:e2:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ea:a0:2a:e2:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:be:fa:3c:cb:67:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 22:47:56.527463 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.527455    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 22:47:56.527581 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.527543    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 22:47:56.530048 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.530016    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 22:47:56.530206 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.530052    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-246.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 22:47:56.530678 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.530666    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 22:47:56.530720 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.530680    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 22:47:56.530720 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.530689    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 22:47:56.531384 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.531372    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 22:47:56.532167 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.532154    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 22:47:56.535721 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.535703    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 22:47:56.536854 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.536838    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 22:47:56.537036 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.537026    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 22:47:56.537075 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.537062    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 22:47:56.537075 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.537074    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 22:47:56.537134 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.537091    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 22:47:56.537134 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.537101    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 30 22:47:56.537134 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.537110    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 22:47:56.537553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.537540    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 22:47:56.537597 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.537568    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 22:47:56.539750 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.539733    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 22:47:56.541184 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.541166    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 22:47:56.541297 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.541208    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 22:47:56.542238 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542223    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 22:47:56.542331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542244    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 22:47:56.542331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542269    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 22:47:56.542331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542278    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 22:47:56.542331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542292    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 22:47:56.542331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542301    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 22:47:56.542331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542313    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 22:47:56.542331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542322    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 22:47:56.542331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542334    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 22:47:56.542597 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542346    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 22:47:56.542597 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542360    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 22:47:56.542597 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542381    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 22:47:56.543002 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.542990    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 22:47:56.543057 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.543004    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 22:47:56.546530 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.546514    2561 server.go:1268] "Started kubelet"
Jul 30 22:47:56.547082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.546656    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 22:47:56.547082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.546761    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 22:47:56.547082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.546784    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 22:47:56.547528 ip-10-0-135-246 systemd[1]: Started Kubernetes Kubelet.
Jul 30 22:47:56.547878 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.547857    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 22:47:56.548997 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.548980    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 22:47:56.551445 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.551424    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 22:47:56.551553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.551534    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-246.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 22:47:56.551633 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.551604    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 22:47:56.551810 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.551780    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 22:47:56.552214 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.551455    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-246.ec2.internal.18c732d7102de33d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-246.ec2.internal,UID:ip-10-0-135-246.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-246.ec2.internal,},FirstTimestamp:2026-07-30 22:47:56.546491197 +0000 UTC m=+0.277636353,LastTimestamp:2026-07-30 22:47:56.546491197 +0000 UTC m=+0.277636353,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-246.ec2.internal,}"
Jul 30 22:47:56.553247 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.553231    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 22:47:56.553336 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.553268    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 22:47:56.553387 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.553355    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:56.554385 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.554231    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 22:47:56.554385 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.554266    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 22:47:56.554627 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.554571    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 22:47:56.554627 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.554585    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 22:47:56.554735 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.554695    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 22:47:56.556550 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.556516    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-246.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 22:47:56.557429 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.557407    2561 factory.go:55] Registering systemd factory
Jul 30 22:47:56.557532 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.557522    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 30 22:47:56.557863 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.557833    2561 factory.go:153] Registering CRI-O factory
Jul 30 22:47:56.557863 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.557866    2561 factory.go:223] Registration of the crio container factory successfully
Jul 30 22:47:56.558000 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.557932    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 22:47:56.558000 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.557962    2561 factory.go:103] Registering Raw factory
Jul 30 22:47:56.558000 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.557984    2561 manager.go:1196] Started watching for new ooms in manager
Jul 30 22:47:56.558617 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.558601    2561 manager.go:349] Starting recovery of all containers
Jul 30 22:47:56.564725 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.564688    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mdbbp"
Jul 30 22:47:56.567353 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.567325    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 22:47:56.570069 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.570049    2561 manager.go:354] Recovery completed
Jul 30 22:47:56.574619 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.574602    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:47:56.574911 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.574894    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mdbbp"
Jul 30 22:47:56.577083 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.577062    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:47:56.577151 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.577097    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:47:56.577151 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.577109    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:47:56.577787 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.577763    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 22:47:56.577864 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.577788    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 22:47:56.577864 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.577809    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 22:47:56.577864 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.577779    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:47:56.578827 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.578803    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:47:56.578919 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.578846    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:47:56.578919 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.578865    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:47:56.580214 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.580083    2561 policy_none.go:49] "None policy: Start"
Jul 30 22:47:56.580312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.580219    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 22:47:56.580312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.580234    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 22:47:56.582406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.582393    2561 policy_none.go:47] "Start"
Jul 30 22:47:56.625210 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.625193    2561 manager.go:337] "Starting Device Plugin manager"
Jul 30 22:47:56.625355 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.625237    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 22:47:56.625355 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.625267    2561 server.go:87] "Starting device plugin registration server"
Jul 30 22:47:56.625600 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.625584    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 22:47:56.625660 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.625603    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 22:47:56.625727 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.625705    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 22:47:56.625832 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.625811    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 22:47:56.625832 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.625830    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 22:47:56.626504 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.626483    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 22:47:56.626622 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.626529    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:56.689306 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.689268    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 22:47:56.691744 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.690505    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 22:47:56.691744 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.690541    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 22:47:56.691744 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.690566    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 22:47:56.691744 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.690602    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 22:47:56.692861 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.692841    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:47:56.726133 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.726062    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:47:56.727511 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.727495    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:47:56.727575 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.727527    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:47:56.727575 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.727538    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:47:56.727575 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.727563    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.733457 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.733441    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.733516 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.733467    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-246.ec2.internal\": node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:56.756080 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.756051    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:56.790838 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.790802    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal"]
Jul 30 22:47:56.790952 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.790892    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:47:56.792540 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.792520    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:47:56.792639 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.792552    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:47:56.792639 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.792563    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:47:56.795098 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.795085    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:47:56.795271 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.795244    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.795315 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.795277    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:47:56.797040 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.797025    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:47:56.797122 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.797057    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:47:56.797122 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.797073    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:47:56.799399 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.799379    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:47:56.799399 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.799409    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:47:56.799571 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.799425    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:47:56.801611 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.801585    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.801670 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.801617    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 22:47:56.802407 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.802388    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 22:47:56.802477 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.802426    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 22:47:56.802477 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.802445    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeHasSufficientPID"
Jul 30 22:47:56.827096 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.827071    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-246.ec2.internal\" not found" node="ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.831925 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.831904    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-246.ec2.internal\" not found" node="ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.856955 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.856925    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:56.857051 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.856985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4cfe13614e7c33dd0a3bc6a4f5cae04c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-246.ec2.internal\" (UID: \"4cfe13614e7c33dd0a3bc6a4f5cae04c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.857051 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.857013    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9840aa10ef2499cc2bee42276bbb30ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal\" (UID: \"9840aa10ef2499cc2bee42276bbb30ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.857051 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.857032    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9840aa10ef2499cc2bee42276bbb30ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal\" (UID: \"9840aa10ef2499cc2bee42276bbb30ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.957054 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:56.957020    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:56.957130 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.957101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9840aa10ef2499cc2bee42276bbb30ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal\" (UID: \"9840aa10ef2499cc2bee42276bbb30ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.957201 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.957168    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9840aa10ef2499cc2bee42276bbb30ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal\" (UID: \"9840aa10ef2499cc2bee42276bbb30ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.957239 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.957206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9840aa10ef2499cc2bee42276bbb30ae-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal\" (UID: \"9840aa10ef2499cc2bee42276bbb30ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.957276 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.957251    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9840aa10ef2499cc2bee42276bbb30ae-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal\" (UID: \"9840aa10ef2499cc2bee42276bbb30ae\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.957314 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.957254    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4cfe13614e7c33dd0a3bc6a4f5cae04c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-246.ec2.internal\" (UID: \"4cfe13614e7c33dd0a3bc6a4f5cae04c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:56.957314 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:56.957280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4cfe13614e7c33dd0a3bc6a4f5cae04c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-246.ec2.internal\" (UID: \"4cfe13614e7c33dd0a3bc6a4f5cae04c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:57.057278 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:57.057235    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:57.134427 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.134382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:57.134529 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.134382    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:57.157357 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:57.157321    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:57.258340 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:57.258296    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:57.359406 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:57.359344    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:57.459507 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:57.459475    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:57.503245 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.503210    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 22:47:57.503726 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.503393    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 22:47:57.559602 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:57.559564    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-246.ec2.internal\" not found"
Jul 30 22:47:57.562955 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.562929    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:47:57.580155 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.580111    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 22:42:57 +0000 UTC" deadline="2028-05-05 23:24:25.448834794 +0000 UTC"
Jul 30 22:47:57.580155 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.580143    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15480h36m27.868695281s"
Jul 30 22:47:57.653987 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.653909    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:57.666993 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.666966    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 22:47:57.668357 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.668342    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal"
Jul 30 22:47:57.678586 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.678564    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 22:47:57.742509 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.742481    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:47:57.747717 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:57.747683    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cfe13614e7c33dd0a3bc6a4f5cae04c.slice/crio-0f477146cf9063fefb7f7829547cdcda9c36d61aae2bcdd11d2abc3c0d6b16dd WatchSource:0}: Error finding container 0f477146cf9063fefb7f7829547cdcda9c36d61aae2bcdd11d2abc3c0d6b16dd: Status 404 returned error can't find the container with id 0f477146cf9063fefb7f7829547cdcda9c36d61aae2bcdd11d2abc3c0d6b16dd
Jul 30 22:47:57.748009 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:57.747988    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9840aa10ef2499cc2bee42276bbb30ae.slice/crio-38665a40c23b8dc86eb3f93c678ffd2d8fe295439b95602ede8a6275adbfc531 WatchSource:0}: Error finding container 38665a40c23b8dc86eb3f93c678ffd2d8fe295439b95602ede8a6275adbfc531: Status 404 returned error can't find the container with id 38665a40c23b8dc86eb3f93c678ffd2d8fe295439b95602ede8a6275adbfc531
Jul 30 22:47:57.752526 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.752503    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:47:57.813123 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:57.813085    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:47:58.539563 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.539527    2561 apiserver.go:52] "Watching apiserver"
Jul 30 22:47:58.549309 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.549277    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 22:47:58.550746 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.550715    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-8pcqq","openshift-ovn-kubernetes/ovnkube-node-r9ng2","kube-system/global-pull-secret-syncer-d8n59","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9","openshift-cluster-node-tuning-operator/tuned-tjgsx","openshift-dns/node-resolver-sp85s","openshift-image-registry/node-ca-h7x6m","openshift-multus/multus-additional-cni-plugins-nkwfs","openshift-multus/multus-v7q6m","openshift-network-diagnostics/network-check-target-hmftj","kube-system/konnectivity-agent-7xvpc","kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal","openshift-multus/network-metrics-daemon-bgxlv"]
Jul 30 22:47:58.553351 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.553329    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.554364 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.553602    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 22:47:58.556178 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.555938    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:47:58.557312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.556609    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-qwbkl\""
Jul 30 22:47:58.557312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.556793    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 22:47:58.557312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.556850    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 22:47:58.557312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.556614    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 22:47:58.558565 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.558373    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.558565 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.558434    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:47:58.558565 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.558487    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r2khm\""
Jul 30 22:47:58.558833 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.558720    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 22:47:58.558833 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.558732    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 22:47:58.561113 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.560774    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.562367 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.562348    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 22:47:58.564596 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.564041    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 22:47:58.564596 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.564134    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.565007 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.564985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0368f3cc-331e-49ed-8f80-1e7d09393a2a-host\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.565071 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.565007    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 22:47:58.565071 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.565031    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0368f3cc-331e-49ed-8f80-1e7d09393a2a-serviceca\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.565289 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.565247    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 22:47:58.565289 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.565276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pn72s\" (UniqueName: \"kubernetes.io/projected/0368f3cc-331e-49ed-8f80-1e7d09393a2a-kube-api-access-pn72s\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.565411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.565336    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f759e4a2-4e9d-4456-b684-9943f027f047-agent-certs\") pod \"konnectivity-agent-7xvpc\" (UID: \"f759e4a2-4e9d-4456-b684-9943f027f047\") " pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:47:58.565687 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.565551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f759e4a2-4e9d-4456-b684-9943f027f047-konnectivity-ca\") pod \"konnectivity-agent-7xvpc\" (UID: \"f759e4a2-4e9d-4456-b684-9943f027f047\") " pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:47:58.565786 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.565705    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jdjh7\""
Jul 30 22:47:58.567588 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.567372    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 22:47:58.567588 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.567416    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:47:58.567588 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.567372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s45r8\""
Jul 30 22:47:58.568425 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.568399    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 22:47:58.568782 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.568765    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.571558 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.571538    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 22:47:58.571907 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.571887    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 22:47:58.572116 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.572098    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.572250 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.572228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6fg8\""
Jul 30 22:47:58.573768 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.573419    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:47:58.573768 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.573551    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:47:58.574626 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.574583    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 22:47:58.574626 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.574600    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 22:47:58.575072 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.574901    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 22:47:58.575452 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.575430    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 22:47:58.575546 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.575463    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hzw64\""
Jul 30 22:47:58.576126 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.576104    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.578754 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.578735    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:47:58.578992 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.578969    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:47:58.579366 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.579329    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 22:47:58.579366 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.579349    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 22:47:58.579767 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.579747    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v9266\""
Jul 30 22:47:58.580786 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.580766    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 22:47:58.581066 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.581043    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 22:47:58.581158 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.581137    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 22:47:58.581313 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.581062    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 22:47:58.581621 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.581574    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.584470 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.584038    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.584470 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.584371    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bmgmq\""
Jul 30 22:47:58.584664 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.584642    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 22:47:58.584744 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.584673    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:47:58.584744 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.584720    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 22:47:58.588271 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.588238    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g2hsb\""
Jul 30 22:47:58.588473 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.588455    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 22:47:58.588675 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.588657    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 22:47:58.593299 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.593277    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rsbzv"
Jul 30 22:47:58.603072 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.603046    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rsbzv"
Jul 30 22:47:58.655999 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.655967    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 22:47:58.667066 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.667035    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5n4n\" (UniqueName: \"kubernetes.io/projected/0e06f91a-f547-4816-b176-e90084c00748-kube-api-access-l5n4n\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.667259 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.667086    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-run-netns\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.667259 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.667124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-ovn\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.667259 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.667145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-lib-modules\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.667259 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.667175    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-systemd-units\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.667499 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.667320    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-var-lib-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.667499 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.667403    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.667499 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.667436    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovn-node-metrics-cert\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.668271 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysconfig\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.668427 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668314    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysctl-d\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.668427 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-systemd\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.668553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-conf-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.668553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668464    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.668553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668480    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.668553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668495    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-log-socket\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.668553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f759e4a2-4e9d-4456-b684-9943f027f047-konnectivity-ca\") pod \"konnectivity-agent-7xvpc\" (UID: \"f759e4a2-4e9d-4456-b684-9943f027f047\") " pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:47:58.668553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9trlv\" (UniqueName: \"kubernetes.io/projected/49293965-a5f8-4825-b015-1e7d7ba69ef1-kube-api-access-9trlv\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-k8s-cni-cncf-io\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-kubelet\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668622    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysctl-conf\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668638    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-run\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-hosts-file\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668706    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668733    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgg6l\" (UniqueName: \"kubernetes.io/projected/b790639c-32af-4aab-abf8-7a439dc26f30-kube-api-access-zgg6l\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668750    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668799    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-cni-netd\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668841    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0368f3cc-331e-49ed-8f80-1e7d09393a2a-host\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668869    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-tuned\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.668897 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668891    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsxs2\" (UniqueName: \"kubernetes.io/projected/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-kube-api-access-vsxs2\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668929    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-os-release\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.668951    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjnhn\" (UniqueName: \"kubernetes.io/projected/7f69e055-9413-4d8b-aea3-6789cb4129ff-kube-api-access-cjnhn\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669010    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0368f3cc-331e-49ed-8f80-1e7d09393a2a-host\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-registration-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-node-log\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669128    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovnkube-config\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-var-lib-kubelet\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f759e4a2-4e9d-4456-b684-9943f027f047-konnectivity-ca\") pod \"konnectivity-agent-7xvpc\" (UID: \"f759e4a2-4e9d-4456-b684-9943f027f047\") " pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49293965-a5f8-4825-b015-1e7d7ba69ef1-tmp\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669266    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-systemd\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669295    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f759e4a2-4e9d-4456-b684-9943f027f047-agent-certs\") pod \"konnectivity-agent-7xvpc\" (UID: \"f759e4a2-4e9d-4456-b684-9943f027f047\") " pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669316    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-kubernetes\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-sys\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-host\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669359    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.669544 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669388    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-os-release\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-cni-bin\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669461    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-system-cni-dir\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669500    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-cnibin\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669528    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669553    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669626    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-device-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669631    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-kubelet\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-slash\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-daemon-config\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07fa440e-a582-4b5e-b055-87da66d02efc-dbus\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669757    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-sys-fs\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669778    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-hostroot\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-host-slash\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669824    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-cnibin\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.670406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-socket-dir-parent\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669873    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovnkube-script-lib\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-475kw\" (UniqueName: \"kubernetes.io/projected/8b888a2e-796d-487a-aa2d-3ca83419dc48-kube-api-access-475kw\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669922    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-tmp-dir\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07fa440e-a582-4b5e-b055-87da66d02efc-kubelet-config\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-cni-bin\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.669989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7r5c\" (UniqueName: \"kubernetes.io/projected/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-kube-api-access-j7r5c\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-system-cni-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-etc-kubernetes\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x5lg\" (UniqueName: \"kubernetes.io/projected/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-kube-api-access-6x5lg\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-modprobe-d\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-cni-multus\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670172    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-socket-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-etc-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670236    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-cni-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670260    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-cni-binary-copy\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-netns\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.671323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-multus-certs\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.672171 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670352    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-env-overrides\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.672171 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670376    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0368f3cc-331e-49ed-8f80-1e7d09393a2a-serviceca\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.672171 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670393    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pn72s\" (UniqueName: \"kubernetes.io/projected/0368f3cc-331e-49ed-8f80-1e7d09393a2a-kube-api-access-pn72s\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.672171 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:47:58.672171 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670430    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-iptables-alerter-script\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.672171 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.672171 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.670883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0368f3cc-331e-49ed-8f80-1e7d09393a2a-serviceca\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.674922 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.674894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f759e4a2-4e9d-4456-b684-9943f027f047-agent-certs\") pod \"konnectivity-agent-7xvpc\" (UID: \"f759e4a2-4e9d-4456-b684-9943f027f047\") " pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:47:58.680192 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.680052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pn72s\" (UniqueName: \"kubernetes.io/projected/0368f3cc-331e-49ed-8f80-1e7d09393a2a-kube-api-access-pn72s\") pod \"node-ca-h7x6m\" (UID: \"0368f3cc-331e-49ed-8f80-1e7d09393a2a\") " pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.695678 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.695619    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal" event={"ID":"9840aa10ef2499cc2bee42276bbb30ae","Type":"ContainerStarted","Data":"38665a40c23b8dc86eb3f93c678ffd2d8fe295439b95602ede8a6275adbfc531"}
Jul 30 22:47:58.697076 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.697043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal" event={"ID":"4cfe13614e7c33dd0a3bc6a4f5cae04c","Type":"ContainerStarted","Data":"0f477146cf9063fefb7f7829547cdcda9c36d61aae2bcdd11d2abc3c0d6b16dd"}
Jul 30 22:47:58.770951 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.770905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-systemd\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.770951 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.770951    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-kubernetes\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.771226 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-kubernetes\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.771226 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771030    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-systemd\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.771226 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771095    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-sys\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.771226 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771126    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-host\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.771226 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.771226 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-sys\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.771226 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771226    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-os-release\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-host\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771253    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-cni-bin\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771281    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-system-cni-dir\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-cnibin\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771314    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-os-release\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771332    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-cnibin\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771395    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771402    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-cni-bin\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771358    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-system-cni-dir\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771446    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-device-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-run-ovn-kubernetes\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-kubelet\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-slash\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.771612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-daemon-config\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771567    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07fa440e-a582-4b5e-b055-87da66d02efc-dbus\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771571    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-kubelet\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-sys-fs\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-hostroot\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-host-slash\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771650    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-cnibin\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-socket-dir-parent\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771683    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovnkube-script-lib\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771718    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-475kw\" (UniqueName: \"kubernetes.io/projected/8b888a2e-796d-487a-aa2d-3ca83419dc48-kube-api-access-475kw\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771722    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/07fa440e-a582-4b5e-b055-87da66d02efc-dbus\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-tmp-dir\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771765    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-slash\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07fa440e-a582-4b5e-b055-87da66d02efc-kubelet-config\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/07fa440e-a582-4b5e-b055-87da66d02efc-kubelet-config\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-cni-bin\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771830    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.772465 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771845    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-device-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7r5c\" (UniqueName: \"kubernetes.io/projected/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-kube-api-access-j7r5c\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771881    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-sys-fs\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-system-cni-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-host-slash\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.771989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-system-cni-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772006    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-cnibin\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772033    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-cni-bin\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772091    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-socket-dir-parent\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772098    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-etc-kubernetes\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-etc-kubernetes\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x5lg\" (UniqueName: \"kubernetes.io/projected/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-kube-api-access-6x5lg\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772181    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-modprobe-d\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772196    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-hostroot\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-cni-multus\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-socket-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772286    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-etc-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.773331 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-cni-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772314    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-cni-multus\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772335    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-cni-binary-copy\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772357    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-tmp-dir\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772360    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-netns\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772398    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-multus-certs\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-etc-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772418    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-daemon-config\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772432    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-env-overrides\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-modprobe-d\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-multus-certs\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-iptables-alerter-script\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772509    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-cni-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772550    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5n4n\" (UniqueName: \"kubernetes.io/projected/0e06f91a-f547-4816-b176-e90084c00748-kube-api-access-l5n4n\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772552    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-netns\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.774298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-socket-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-run-netns\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-ovn\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-lib-modules\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-systemd-units\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-var-lib-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovn-node-metrics-cert\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772700    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovnkube-script-lib\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysconfig\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772742    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysconfig\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772763    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysctl-d\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-systemd\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772821    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-env-overrides\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772817    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-conf-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772882    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-var-lib-openvswitch\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772889    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.775166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772894    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-cni-binary-copy\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772917    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772929    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-systemd-units\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-log-socket\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772949    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-run-ovn\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772976    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9trlv\" (UniqueName: \"kubernetes.io/projected/49293965-a5f8-4825-b015-1e7d7ba69ef1-kube-api-access-9trlv\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-lib-modules\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773006    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-systemd\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773022    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-kubelet-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773041    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-run-netns\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773079    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-log-socket\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.772959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-multus-conf-dir\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773118    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-k8s-cni-cncf-io\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773120    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-iptables-alerter-script\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773146    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-kubelet\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773157    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.776082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773170    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7f69e055-9413-4d8b-aea3-6789cb4129ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773176    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysctl-conf\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773207    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-run\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773221    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-run-k8s-cni-cncf-io\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773245    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-host-var-lib-kubelet\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773274    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-run\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773299    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-hosts-file\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysctl-conf\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773358    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgg6l\" (UniqueName: \"kubernetes.io/projected/b790639c-32af-4aab-abf8-7a439dc26f30-kube-api-access-zgg6l\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-hosts-file\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-sysctl-d\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.773464    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-cni-netd\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.773542    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs podName:b790639c-32af-4aab-abf8-7a439dc26f30 nodeName:}" failed. No retries permitted until 2026-07-30 22:47:59.273521719 +0000 UTC m=+3.004666860 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs") pod "network-metrics-daemon-bgxlv" (UID: "b790639c-32af-4aab-abf8-7a439dc26f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-host-cni-netd\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773581    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-tuned\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.776942 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.773611    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.773661    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret podName:07fa440e-a582-4b5e-b055-87da66d02efc nodeName:}" failed. No retries permitted until 2026-07-30 22:47:59.273644076 +0000 UTC m=+3.004789237 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret") pod "global-pull-secret-syncer-d8n59" (UID: "07fa440e-a582-4b5e-b055-87da66d02efc") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsxs2\" (UniqueName: \"kubernetes.io/projected/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-kube-api-access-vsxs2\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-os-release\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjnhn\" (UniqueName: \"kubernetes.io/projected/7f69e055-9413-4d8b-aea3-6789cb4129ff-kube-api-access-cjnhn\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-registration-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-node-log\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773809    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovnkube-config\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-var-lib-kubelet\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773860    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49293965-a5f8-4825-b015-1e7d7ba69ef1-tmp\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773862    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-registration-dir\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773873    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7f69e055-9413-4d8b-aea3-6789cb4129ff-os-release\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773884    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773970    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0e06f91a-f547-4816-b176-e90084c00748-etc-selinux\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.773974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49293965-a5f8-4825-b015-1e7d7ba69ef1-var-lib-kubelet\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.774020    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8b888a2e-796d-487a-aa2d-3ca83419dc48-node-log\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.777918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.774912    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovnkube-config\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.778738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.776006    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8b888a2e-796d-487a-aa2d-3ca83419dc48-ovn-node-metrics-cert\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.778738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.776515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49293965-a5f8-4825-b015-1e7d7ba69ef1-etc-tuned\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.778738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.776567    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49293965-a5f8-4825-b015-1e7d7ba69ef1-tmp\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.783344 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.783315    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:47:58.783458 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.783353    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:47:58.783458 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.783367    2561 projected.go:196] Error preparing data for projected volume kube-api-access-qjdrg for pod openshift-network-diagnostics/network-check-target-hmftj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:47:58.783458 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:58.783442    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg podName:8f23b63e-77ff-4825-92a3-e041a40e5d9b nodeName:}" failed. No retries permitted until 2026-07-30 22:47:59.283421894 +0000 UTC m=+3.014567074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qjdrg" (UniqueName: "kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg") pod "network-check-target-hmftj" (UID: "8f23b63e-77ff-4825-92a3-e041a40e5d9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:47:58.784187 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.784135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9trlv\" (UniqueName: \"kubernetes.io/projected/49293965-a5f8-4825-b015-1e7d7ba69ef1-kube-api-access-9trlv\") pod \"tuned-tjgsx\" (UID: \"49293965-a5f8-4825-b015-1e7d7ba69ef1\") " pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.784986 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.784958    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-475kw\" (UniqueName: \"kubernetes.io/projected/8b888a2e-796d-487a-aa2d-3ca83419dc48-kube-api-access-475kw\") pod \"ovnkube-node-r9ng2\" (UID: \"8b888a2e-796d-487a-aa2d-3ca83419dc48\") " pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.786745 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.786696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5n4n\" (UniqueName: \"kubernetes.io/projected/0e06f91a-f547-4816-b176-e90084c00748-kube-api-access-l5n4n\") pod \"aws-ebs-csi-driver-node-v6mv9\" (UID: \"0e06f91a-f547-4816-b176-e90084c00748\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.787312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.787290    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7r5c\" (UniqueName: \"kubernetes.io/projected/ba709bd6-d174-40cb-ae9a-61a7d4e6fa01-kube-api-access-j7r5c\") pod \"iptables-alerter-8pcqq\" (UID: \"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01\") " pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.787620 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.787598    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjnhn\" (UniqueName: \"kubernetes.io/projected/7f69e055-9413-4d8b-aea3-6789cb4129ff-kube-api-access-cjnhn\") pod \"multus-additional-cni-plugins-nkwfs\" (UID: \"7f69e055-9413-4d8b-aea3-6789cb4129ff\") " pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:58.787708 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.787649    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgg6l\" (UniqueName: \"kubernetes.io/projected/b790639c-32af-4aab-abf8-7a439dc26f30-kube-api-access-zgg6l\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:47:58.788302 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.788266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x5lg\" (UniqueName: \"kubernetes.io/projected/ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b-kube-api-access-6x5lg\") pod \"multus-v7q6m\" (UID: \"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b\") " pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.789951 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.789893    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsxs2\" (UniqueName: \"kubernetes.io/projected/05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1-kube-api-access-vsxs2\") pod \"node-resolver-sp85s\" (UID: \"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1\") " pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.868222 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.868153    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h7x6m"
Jul 30 22:47:58.878405 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.878375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:47:58.896071 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.896044    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9"
Jul 30 22:47:58.904078 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.904048    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tjgsx"
Jul 30 22:47:58.912190 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.912167    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sp85s"
Jul 30 22:47:58.921320 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.921298    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-v7q6m"
Jul 30 22:47:58.929414 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.929390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:47:58.939427 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.939404    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8pcqq"
Jul 30 22:47:58.946411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:58.946386    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nkwfs"
Jul 30 22:47:59.278132 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:59.278092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:47:59.278132 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:59.278129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:47:59.278402 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.278280    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:47:59.278402 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.278334    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:47:59.278402 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.278360    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs podName:b790639c-32af-4aab-abf8-7a439dc26f30 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:00.278342331 +0000 UTC m=+4.009487471 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs") pod "network-metrics-daemon-bgxlv" (UID: "b790639c-32af-4aab-abf8-7a439dc26f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:47:59.278402 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.278391    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret podName:07fa440e-a582-4b5e-b055-87da66d02efc nodeName:}" failed. No retries permitted until 2026-07-30 22:48:00.27837824 +0000 UTC m=+4.009523382 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret") pod "global-pull-secret-syncer-d8n59" (UID: "07fa440e-a582-4b5e-b055-87da66d02efc") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:47:59.379575 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:59.379535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:47:59.379730 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.379671    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:47:59.379730 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.379686    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:47:59.379730 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.379695    2561 projected.go:196] Error preparing data for projected volume kube-api-access-qjdrg for pod openshift-network-diagnostics/network-check-target-hmftj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:47:59.379847 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.379747    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg podName:8f23b63e-77ff-4825-92a3-e041a40e5d9b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:00.37973369 +0000 UTC m=+4.110878831 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjdrg" (UniqueName: "kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg") pod "network-check-target-hmftj" (UID: "8f23b63e-77ff-4825-92a3-e041a40e5d9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:47:59.606981 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:59.606861    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 22:42:58 +0000 UTC" deadline="2028-05-03 21:14:14.959187036 +0000 UTC"
Jul 30 22:47:59.606981 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:59.606917    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15430h26m15.352274313s"
Jul 30 22:47:59.690938 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:47:59.690897    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:47:59.691145 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:47:59.691057    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:47:59.784018 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.783992    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05200788_aeb2_44d0_b9bc_0f4ad6a3fbf1.slice/crio-67a2dbd8f3dcfe35eab0745b52e211d452b28e4b63de93b996c3b5cf6a1e37fb WatchSource:0}: Error finding container 67a2dbd8f3dcfe35eab0745b52e211d452b28e4b63de93b996c3b5cf6a1e37fb: Status 404 returned error can't find the container with id 67a2dbd8f3dcfe35eab0745b52e211d452b28e4b63de93b996c3b5cf6a1e37fb
Jul 30 22:47:59.785948 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.785907    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba709bd6_d174_40cb_ae9a_61a7d4e6fa01.slice/crio-ca53af6f76334dc53ed6514778c9296d4d8ba0b265fdc32c6b7d93f7fa58ec31 WatchSource:0}: Error finding container ca53af6f76334dc53ed6514778c9296d4d8ba0b265fdc32c6b7d93f7fa58ec31: Status 404 returned error can't find the container with id ca53af6f76334dc53ed6514778c9296d4d8ba0b265fdc32c6b7d93f7fa58ec31
Jul 30 22:47:59.786840 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.786816    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0de2f3_ae28_4f2a_86cd_1fe157f3e88b.slice/crio-421f215fc94f370e0a460057a1abfeb1fde024cc778d844b08662f9d2def9242 WatchSource:0}: Error finding container 421f215fc94f370e0a460057a1abfeb1fde024cc778d844b08662f9d2def9242: Status 404 returned error can't find the container with id 421f215fc94f370e0a460057a1abfeb1fde024cc778d844b08662f9d2def9242
Jul 30 22:47:59.788345 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.788317    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b888a2e_796d_487a_aa2d_3ca83419dc48.slice/crio-c148ab5e6f642666c50c8a114429b7053be79ff2ec342eb72802dd44110605a1 WatchSource:0}: Error finding container c148ab5e6f642666c50c8a114429b7053be79ff2ec342eb72802dd44110605a1: Status 404 returned error can't find the container with id c148ab5e6f642666c50c8a114429b7053be79ff2ec342eb72802dd44110605a1
Jul 30 22:47:59.789342 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.789318    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49293965_a5f8_4825_b015_1e7d7ba69ef1.slice/crio-e8ae9139e153dfe70e0aa432daa70e5e03812ee24f2e30c21f6b7927232b0f17 WatchSource:0}: Error finding container e8ae9139e153dfe70e0aa432daa70e5e03812ee24f2e30c21f6b7927232b0f17: Status 404 returned error can't find the container with id e8ae9139e153dfe70e0aa432daa70e5e03812ee24f2e30c21f6b7927232b0f17
Jul 30 22:47:59.790511 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.790476    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e06f91a_f547_4816_b176_e90084c00748.slice/crio-af48ae7d7b1a826c18447244a4398d5e02d4204c03777951a896d3b554e3a019 WatchSource:0}: Error finding container af48ae7d7b1a826c18447244a4398d5e02d4204c03777951a896d3b554e3a019: Status 404 returned error can't find the container with id af48ae7d7b1a826c18447244a4398d5e02d4204c03777951a896d3b554e3a019
Jul 30 22:47:59.793719 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.793656    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0368f3cc_331e_49ed_8f80_1e7d09393a2a.slice/crio-8f49b23204685f46d790c3c88ac0cc1ae2da2c17396b5d71abd9fb91ee44c9de WatchSource:0}: Error finding container 8f49b23204685f46d790c3c88ac0cc1ae2da2c17396b5d71abd9fb91ee44c9de: Status 404 returned error can't find the container with id 8f49b23204685f46d790c3c88ac0cc1ae2da2c17396b5d71abd9fb91ee44c9de
Jul 30 22:47:59.795072 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.795046    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf759e4a2_4e9d_4456_b684_9943f027f047.slice/crio-475ba52eeb5a2b24adc18080daa04eda239ee7e0a52e360175f03bf21d36c680 WatchSource:0}: Error finding container 475ba52eeb5a2b24adc18080daa04eda239ee7e0a52e360175f03bf21d36c680: Status 404 returned error can't find the container with id 475ba52eeb5a2b24adc18080daa04eda239ee7e0a52e360175f03bf21d36c680
Jul 30 22:47:59.796054 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:47:59.796033    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f69e055_9413_4d8b_aea3_6789cb4129ff.slice/crio-991133c950a4f04db76a40505503fc2bd6f979b87304a8ba20e15c5f0dfe9130 WatchSource:0}: Error finding container 991133c950a4f04db76a40505503fc2bd6f979b87304a8ba20e15c5f0dfe9130: Status 404 returned error can't find the container with id 991133c950a4f04db76a40505503fc2bd6f979b87304a8ba20e15c5f0dfe9130
Jul 30 22:48:00.288250 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.287925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:00.288434 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.288283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:00.288434 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.288098    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:00.288570 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.288553    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs podName:b790639c-32af-4aab-abf8-7a439dc26f30 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:02.288533844 +0000 UTC m=+6.019678991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs") pod "network-metrics-daemon-bgxlv" (UID: "b790639c-32af-4aab-abf8-7a439dc26f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:00.290559 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.288423    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:00.290559 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.288949    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret podName:07fa440e-a582-4b5e-b055-87da66d02efc nodeName:}" failed. No retries permitted until 2026-07-30 22:48:02.288930392 +0000 UTC m=+6.020075537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret") pod "global-pull-secret-syncer-d8n59" (UID: "07fa440e-a582-4b5e-b055-87da66d02efc") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:00.389720 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.389678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:00.389902 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.389857    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:48:00.389902 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.389882    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:48:00.389902 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.389896    2561 projected.go:196] Error preparing data for projected volume kube-api-access-qjdrg for pod openshift-network-diagnostics/network-check-target-hmftj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:00.390091 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.389965    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg podName:8f23b63e-77ff-4825-92a3-e041a40e5d9b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:02.389944891 +0000 UTC m=+6.121090054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjdrg" (UniqueName: "kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg") pod "network-check-target-hmftj" (UID: "8f23b63e-77ff-4825-92a3-e041a40e5d9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:00.608128 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.607996    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 22:42:58 +0000 UTC" deadline="2028-02-13 22:13:43.305676021 +0000 UTC"
Jul 30 22:48:00.608128 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.608041    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13511h25m42.69764074s"
Jul 30 22:48:00.691939 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.691484    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:00.691939 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.691635    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:00.691939 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.691722    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:00.691939 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:00.691814    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:00.732576 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.732535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9" event={"ID":"0e06f91a-f547-4816-b176-e90084c00748","Type":"ContainerStarted","Data":"af48ae7d7b1a826c18447244a4398d5e02d4204c03777951a896d3b554e3a019"}
Jul 30 22:48:00.746626 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.746517    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjgsx" event={"ID":"49293965-a5f8-4825-b015-1e7d7ba69ef1","Type":"ContainerStarted","Data":"e8ae9139e153dfe70e0aa432daa70e5e03812ee24f2e30c21f6b7927232b0f17"}
Jul 30 22:48:00.756553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.756514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8pcqq" event={"ID":"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01","Type":"ContainerStarted","Data":"ca53af6f76334dc53ed6514778c9296d4d8ba0b265fdc32c6b7d93f7fa58ec31"}
Jul 30 22:48:00.767142 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.767104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sp85s" event={"ID":"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1","Type":"ContainerStarted","Data":"67a2dbd8f3dcfe35eab0745b52e211d452b28e4b63de93b996c3b5cf6a1e37fb"}
Jul 30 22:48:00.786286 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.785352    2561 generic.go:356] "Generic (PLEG): container finished" podID="9840aa10ef2499cc2bee42276bbb30ae" containerID="7aa8d46e676c628ff5366da5381bcfbc46cdda58fb573e4ea2e242251b255273" exitCode=0
Jul 30 22:48:00.786286 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.785456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal" event={"ID":"9840aa10ef2499cc2bee42276bbb30ae","Type":"ContainerDied","Data":"7aa8d46e676c628ff5366da5381bcfbc46cdda58fb573e4ea2e242251b255273"}
Jul 30 22:48:00.812087 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.811972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerStarted","Data":"991133c950a4f04db76a40505503fc2bd6f979b87304a8ba20e15c5f0dfe9130"}
Jul 30 22:48:00.827552 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.826833    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7x6m" event={"ID":"0368f3cc-331e-49ed-8f80-1e7d09393a2a","Type":"ContainerStarted","Data":"8f49b23204685f46d790c3c88ac0cc1ae2da2c17396b5d71abd9fb91ee44c9de"}
Jul 30 22:48:00.840379 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.840336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"c148ab5e6f642666c50c8a114429b7053be79ff2ec342eb72802dd44110605a1"}
Jul 30 22:48:00.858834 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.858562    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v7q6m" event={"ID":"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b","Type":"ContainerStarted","Data":"421f215fc94f370e0a460057a1abfeb1fde024cc778d844b08662f9d2def9242"}
Jul 30 22:48:00.865497 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.864969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal" event={"ID":"4cfe13614e7c33dd0a3bc6a4f5cae04c","Type":"ContainerStarted","Data":"c22ce6c3f9ef96503b06ec4b7e537d102d503504c8692df74f0a92bcdad152f6"}
Jul 30 22:48:00.876385 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:00.876294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7xvpc" event={"ID":"f759e4a2-4e9d-4456-b684-9943f027f047","Type":"ContainerStarted","Data":"475ba52eeb5a2b24adc18080daa04eda239ee7e0a52e360175f03bf21d36c680"}
Jul 30 22:48:01.690856 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:01.690814    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:01.691383 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:01.691046    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:01.897378 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:01.897330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal" event={"ID":"9840aa10ef2499cc2bee42276bbb30ae","Type":"ContainerStarted","Data":"9f0e3b8262bd234f0d8b286563574136304f3a55d7f2120760b867a1eabdbbf1"}
Jul 30 22:48:01.918760 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:01.918690    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-246.ec2.internal" podStartSLOduration=3.918663849 podStartE2EDuration="3.918663849s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:00.90693339 +0000 UTC m=+4.638078555" watchObservedRunningTime="2026-07-30 22:48:01.918663849 +0000 UTC m=+5.649809015"
Jul 30 22:48:02.309945 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:02.309906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:02.310159 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:02.310021    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:02.310159 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.310089    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:02.310159 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.310138    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:02.310415 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.310197    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret podName:07fa440e-a582-4b5e-b055-87da66d02efc nodeName:}" failed. No retries permitted until 2026-07-30 22:48:06.31016177 +0000 UTC m=+10.041306912 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret") pod "global-pull-secret-syncer-d8n59" (UID: "07fa440e-a582-4b5e-b055-87da66d02efc") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:02.310415 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.310219    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs podName:b790639c-32af-4aab-abf8-7a439dc26f30 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:06.310207566 +0000 UTC m=+10.041352709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs") pod "network-metrics-daemon-bgxlv" (UID: "b790639c-32af-4aab-abf8-7a439dc26f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:02.412092 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:02.411403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:02.412092 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.411568    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:48:02.412092 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.411605    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:48:02.412092 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.411618    2561 projected.go:196] Error preparing data for projected volume kube-api-access-qjdrg for pod openshift-network-diagnostics/network-check-target-hmftj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:02.412092 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.411720    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg podName:8f23b63e-77ff-4825-92a3-e041a40e5d9b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:06.411660985 +0000 UTC m=+10.142806127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjdrg" (UniqueName: "kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg") pod "network-check-target-hmftj" (UID: "8f23b63e-77ff-4825-92a3-e041a40e5d9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:02.697962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:02.697882    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:02.698489 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.698028    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:02.698489 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:02.698420    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:02.698611 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:02.698522    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:03.691591 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:03.691118    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:03.691591 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:03.691269    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:04.691725 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:04.691691    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:04.692168 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:04.691855    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:04.692357 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:04.692286    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:04.692429 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:04.692387    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:05.691251 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:05.691216    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:05.691439 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:05.691344    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:06.347228 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:06.347167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:06.347688 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:06.347236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:06.347688 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.347375    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:06.347688 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.347401    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:06.347688 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.347458    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs podName:b790639c-32af-4aab-abf8-7a439dc26f30 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:14.347435849 +0000 UTC m=+18.078581011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs") pod "network-metrics-daemon-bgxlv" (UID: "b790639c-32af-4aab-abf8-7a439dc26f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:06.347688 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.347480    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret podName:07fa440e-a582-4b5e-b055-87da66d02efc nodeName:}" failed. No retries permitted until 2026-07-30 22:48:14.34746978 +0000 UTC m=+18.078614924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret") pod "global-pull-secret-syncer-d8n59" (UID: "07fa440e-a582-4b5e-b055-87da66d02efc") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:06.448606 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:06.448561    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:06.448776 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.448750    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:48:06.448851 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.448778    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:48:06.448851 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.448791    2561 projected.go:196] Error preparing data for projected volume kube-api-access-qjdrg for pod openshift-network-diagnostics/network-check-target-hmftj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:06.448950 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.448853    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg podName:8f23b63e-77ff-4825-92a3-e041a40e5d9b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:14.448834607 +0000 UTC m=+18.179979749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjdrg" (UniqueName: "kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg") pod "network-check-target-hmftj" (UID: "8f23b63e-77ff-4825-92a3-e041a40e5d9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:06.692730 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:06.691991    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:06.692730 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.692118    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:06.692730 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:06.692512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:06.692730 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:06.692633    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:07.690813 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:07.690732    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:07.691278 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:07.690863    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:08.691442 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:08.691405    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:08.691923 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:08.691404    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:08.691923 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:08.691551    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:08.691923 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:08.691619    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:09.690798 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:09.690762    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:09.690961 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:09.690898    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:10.693738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:10.693717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:10.694028 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:10.693825    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:10.694028 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:10.693873    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:10.694028 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:10.693954    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:11.691674 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:11.691639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:11.691859 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:11.691763    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:12.695008 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:12.694968    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:12.695474 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:12.694979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:12.695474 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:12.695084    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:12.695474 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:12.695220    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:13.691875 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:13.691835    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:13.692080 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:13.691970    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:14.408735 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:14.408694    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:14.408735 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:14.408741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:14.409331 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.408853    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:14.409331 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.408854    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:14.409331 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.408928    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret podName:07fa440e-a582-4b5e-b055-87da66d02efc nodeName:}" failed. No retries permitted until 2026-07-30 22:48:30.408911445 +0000 UTC m=+34.140056587 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret") pod "global-pull-secret-syncer-d8n59" (UID: "07fa440e-a582-4b5e-b055-87da66d02efc") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:14.409331 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.408950    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs podName:b790639c-32af-4aab-abf8-7a439dc26f30 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:30.408940702 +0000 UTC m=+34.140085842 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs") pod "network-metrics-daemon-bgxlv" (UID: "b790639c-32af-4aab-abf8-7a439dc26f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:14.509604 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:14.509575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:14.509812 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.509748    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:48:14.509812 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.509772    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:48:14.509812 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.509787    2561 projected.go:196] Error preparing data for projected volume kube-api-access-qjdrg for pod openshift-network-diagnostics/network-check-target-hmftj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:14.509983 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.509869    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg podName:8f23b63e-77ff-4825-92a3-e041a40e5d9b nodeName:}" failed. No retries permitted until 2026-07-30 22:48:30.509838729 +0000 UTC m=+34.240983870 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjdrg" (UniqueName: "kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg") pod "network-check-target-hmftj" (UID: "8f23b63e-77ff-4825-92a3-e041a40e5d9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:14.691569 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:14.691496    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:14.691721 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:14.691506    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:14.691721 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.691621    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:14.691835 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:14.691710    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:15.691530 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:15.691493    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:15.691973 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:15.691638    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:16.692459 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:16.692421    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:16.692969 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:16.692542    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:16.692969 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:16.692953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:16.693091 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:16.693073    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:17.691440 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:17.691396    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:17.691617 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:17.691526    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:18.694713 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.692979    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:18.694713 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:18.693406    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:18.694713 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.694565    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:18.694713 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:18.694668    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:18.934914 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.934654    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7xvpc" event={"ID":"f759e4a2-4e9d-4456-b684-9943f027f047","Type":"ContainerStarted","Data":"90aa99619fe96e5988d4edc97be8f761a4ea98a521c9e2fd6bc4ed76db5e55b5"}
Jul 30 22:48:18.936030 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.936007    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9" event={"ID":"0e06f91a-f547-4816-b176-e90084c00748","Type":"ContainerStarted","Data":"2ec6ae4317eba7046477dcc3479e9f2b9e0ecaffd2894c255f9abfc4c2050117"}
Jul 30 22:48:18.937546 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.937523    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tjgsx" event={"ID":"49293965-a5f8-4825-b015-1e7d7ba69ef1","Type":"ContainerStarted","Data":"3ce5135137683807efaf7c79786a2018e97942df3632d710d7184984255536cd"}
Jul 30 22:48:18.939064 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.939043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sp85s" event={"ID":"05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1","Type":"ContainerStarted","Data":"521b4675a66b2e469e5189903b267661c17ea3ed34c46d67dca3006b36823422"}
Jul 30 22:48:18.940650 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.940627    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f69e055-9413-4d8b-aea3-6789cb4129ff" containerID="b960e6b14b576d781ab4d48cd85a139455016971b6728477c2995f15e34dde87" exitCode=0
Jul 30 22:48:18.940749 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.940699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerDied","Data":"b960e6b14b576d781ab4d48cd85a139455016971b6728477c2995f15e34dde87"}
Jul 30 22:48:18.942274 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.942206    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h7x6m" event={"ID":"0368f3cc-331e-49ed-8f80-1e7d09393a2a","Type":"ContainerStarted","Data":"91e5433a46be6e60e59168909de4f28a31d6f3515671496846af99740b1602e9"}
Jul 30 22:48:18.944478 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.944460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"264e8b69798ecc6d832a7237b46c2bc9a31f327c723b88dbe31d0e6c3a8d592c"}
Jul 30 22:48:18.944724 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.944518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"0b5ab007a0b8a290ef224f5b047dec9770af47cec9d3b4c3a18f7bc06fa0ce0e"}
Jul 30 22:48:18.945772 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.945752    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-v7q6m" event={"ID":"ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b","Type":"ContainerStarted","Data":"820306764ed6160fd87530da3c5df99f41bf9ccb83bbe0649a24de9cf487c91a"}
Jul 30 22:48:18.954598 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.954485    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-246.ec2.internal" podStartSLOduration=20.954197541 podStartE2EDuration="20.954197541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:01.917754892 +0000 UTC m=+5.648900076" watchObservedRunningTime="2026-07-30 22:48:18.954197541 +0000 UTC m=+22.685342720"
Jul 30 22:48:18.956107 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.956062    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7xvpc" podStartSLOduration=6.95222374 podStartE2EDuration="21.956045528s" totalImagesPullingTime="15.003821788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:18.954914495 +0000 UTC m=+22.686059678" watchObservedRunningTime="2026-07-30 22:48:18.956045528 +0000 UTC m=+22.687190690"
Jul 30 22:48:18.970417 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.970368    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h7x6m" podStartSLOduration=3.233746031 podStartE2EDuration="21.970353042s" totalImagesPullingTime="18.736607011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:18.969988263 +0000 UTC m=+22.701133423" watchObservedRunningTime="2026-07-30 22:48:18.970353042 +0000 UTC m=+22.701498238"
Jul 30 22:48:18.989213 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:18.989138    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sp85s" podStartSLOduration=3.2480996109999998 podStartE2EDuration="21.989122062s" totalImagesPullingTime="18.741022451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:18.989034286 +0000 UTC m=+22.720179447" watchObservedRunningTime="2026-07-30 22:48:18.989122062 +0000 UTC m=+22.720267222"
Jul 30 22:48:19.067472 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.067431    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tjgsx" podStartSLOduration=3.310805395 podStartE2EDuration="22.067413795s" totalImagesPullingTime="18.7566084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:19.042365622 +0000 UTC m=+22.773510783" watchObservedRunningTime="2026-07-30 22:48:19.067413795 +0000 UTC m=+22.798558955"
Jul 30 22:48:19.067697 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.067670    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-v7q6m" podStartSLOduration=3.261328524 podStartE2EDuration="22.067663266s" totalImagesPullingTime="18.806334742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:19.067379503 +0000 UTC m=+22.798524663" watchObservedRunningTime="2026-07-30 22:48:19.067663266 +0000 UTC m=+22.798808426"
Jul 30 22:48:19.090084 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.090047    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:19.246371 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.246336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:19.366616 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.366521    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:19.464232 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.464198    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:19.563939 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.563903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:19.624573 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.624501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:19.690859 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.690823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:19.691032 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:19.690959    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:19.949724 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.949684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8pcqq" event={"ID":"ba709bd6-d174-40cb-ae9a-61a7d4e6fa01","Type":"ContainerStarted","Data":"32190b388874ce12dccbc5cf48556edede2d390f781833d64407d812ca283ca9"}
Jul 30 22:48:19.954758 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.954380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"f401e37528083648cc7eb024dbf78453baba4649bd33d82d16a5055f69b73185"}
Jul 30 22:48:19.954758 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.954462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"e4631984bc2c08b6cd308ddf834d3ffbb549efa5cda498ee60cec33fdd8be802"}
Jul 30 22:48:19.954758 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.954513    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"5db9690795b25be801abe3cacf181d72ab52e7b6f699c4aaa8d98a2bb2ccd429"}
Jul 30 22:48:19.954758 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.954560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"0577756b341448bd02e4b52fc4494b07827444e38048dca687cfd9b95af94448"}
Jul 30 22:48:19.973049 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.972640    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8pcqq" podStartSLOduration=4.227998607 podStartE2EDuration="22.972621682s" totalImagesPullingTime="18.744623075s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:19.972107478 +0000 UTC m=+23.703252639" watchObservedRunningTime="2026-07-30 22:48:19.972621682 +0000 UTC m=+23.703766843"
Jul 30 22:48:19.985145 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:19.985105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:20.041961 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.041928    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 22:48:20.082754 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.082723    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:20.310386 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.310350    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:48:20.310981 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.310957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:48:20.389500 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.389467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:20.456891 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.456856    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:20.619677 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.619592    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sp85s_05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1/dns-node-resolver/0.log"
Jul 30 22:48:20.637005 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.636878    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T22:48:20.041951675Z","UUID":"f5b9a961-d69b-4386-8681-a644fae71cc1","Handler":null,"Name":"","Endpoint":""}
Jul 30 22:48:20.639239 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.639207    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 22:48:20.639380 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.639261    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 22:48:20.690852 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.690814    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:20.690852 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.690823    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:20.691086 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:20.690939    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:20.691086 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:20.691069    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:20.768231 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.768193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:20.839148 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.839064    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:20.958878 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.958789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9" event={"ID":"0e06f91a-f547-4816-b176-e90084c00748","Type":"ContainerStarted","Data":"5cba052e2f9c30cc7743a443abafe51d4847a0640d8265ec25b7fdf7023a0316"}
Jul 30 22:48:20.959347 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.958960    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:48:20.959616 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:20.959516    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7xvpc"
Jul 30 22:48:21.029403 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:21.029370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:21.417805 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:21.417532    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7x6m_0368f3cc-331e-49ed-8f80-1e7d09393a2a/node-ca/0.log"
Jul 30 22:48:21.631845 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:21.631813    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:21.691215 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:21.691158    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:21.691394 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:21.691294    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:21.694807 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:21.694776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:21.963526 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:21.963435    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9" event={"ID":"0e06f91a-f547-4816-b176-e90084c00748","Type":"ContainerStarted","Data":"7e4fade7b9fd73b5f0399e5ff7dc016e7e90a4f3d5b5d9c4524831ae350a7313"}
Jul 30 22:48:21.967155 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:21.967122    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"57c514205c37677d706b416f2d624737874274a4eeb2fc5e965451a4fbcb7027"}
Jul 30 22:48:21.983661 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:21.983605    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-v6mv9" podStartSLOduration=4.010210232 podStartE2EDuration="24.983583807s" totalImagesPullingTime="20.973373575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:21.982636964 +0000 UTC m=+25.713782190" watchObservedRunningTime="2026-07-30 22:48:21.983583807 +0000 UTC m=+25.714728970"
Jul 30 22:48:22.690922 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:22.690879    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:22.691110 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:22.690879    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:22.691110 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:22.691030    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:22.691252 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:22.691100    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:22.796240 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:22.796193    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:23.484692 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.484523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:23.581011 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.580901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:23.679452 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.679417    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:23.691462 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.691396    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:23.691584 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:23.691508    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:23.873616 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.873576    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:23.975940 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.975853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" event={"ID":"8b888a2e-796d-487a-aa2d-3ca83419dc48","Type":"ContainerStarted","Data":"af1d4fd8e5a8ec24d47ab08c8069d8b9d1d992837fe7ac027e38c6077f9946be"}
Jul 30 22:48:23.976119 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.975988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:23.976119 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.976080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:48:23.977643 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.977621    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f69e055-9413-4d8b-aea3-6789cb4129ff" containerID="ca53e8adfef951a95ae6f1093fb772d2351f4f4febe008c64b62d2344a1f6e18" exitCode=0
Jul 30 22:48:23.977751 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.977651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerDied","Data":"ca53e8adfef951a95ae6f1093fb772d2351f4f4febe008c64b62d2344a1f6e18"}
Jul 30 22:48:23.991547 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:23.991517    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:48:24.039676 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.039626    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2" podStartSLOduration=8.234939376 podStartE2EDuration="27.039610184s" totalImagesPullingTime="18.804670808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:24.006981735 +0000 UTC m=+27.738126906" watchObservedRunningTime="2026-07-30 22:48:24.039610184 +0000 UTC m=+27.770755345"
Jul 30 22:48:24.082409 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.082381    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:24.178020 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.177990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:24.578207 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.577997    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:24.691828 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.691789    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:24.691989 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.691793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:24.691989 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:24.691904    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:24.692062 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:24.692020    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:24.888085 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.888054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:24.979585 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.979550    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:48:24.979780 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.979619    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:48:24.994340 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:24.994313    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:48:25.179895 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:25.179868    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:25.573754 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:25.573726    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:25.691218 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:25.691191    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:25.691584 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:25.691279    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:25.973775 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:25.973695    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:25.983452 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:25.983424    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f69e055-9413-4d8b-aea3-6789cb4129ff" containerID="3807d8a50e3bc6182f4dd53e9a6731e0f815bf610eef128df03edd6d11dfbcf1" exitCode=0
Jul 30 22:48:25.983599 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:25.983512    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerDied","Data":"3807d8a50e3bc6182f4dd53e9a6731e0f815bf610eef128df03edd6d11dfbcf1"}
Jul 30 22:48:26.050826 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:26.050778    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:26.382910 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:26.382876    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:26.576487 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:26.576459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:26.692561 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:26.692485    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:26.692922 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:26.692560    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:26.692922 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:26.692582    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:26.692922 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:26.692646    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:26.975031 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:26.974928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:27.372902 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:27.372871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:27.576195 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:27.576157    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:27.647122 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:27.647037    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:27.691052 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:27.691022    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:27.691145 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:27.691128    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:27.942014 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:27.941924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:27.990219 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:27.990168    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f69e055-9413-4d8b-aea3-6789cb4129ff" containerID="ca1ea45ae9a1c361a03fdeeaaa23c773da962b266a718277ab6bbefd91173640" exitCode=0
Jul 30 22:48:27.990397 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:27.990258    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerDied","Data":"ca1ea45ae9a1c361a03fdeeaaa23c773da962b266a718277ab6bbefd91173640"}
Jul 30 22:48:28.021641 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:28.021612    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:28.377068 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:28.377035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:28.577014 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:28.576976    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:28.694279 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:28.694193    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:28.694433 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:28.694330    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:28.694433 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:28.694388    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:28.694547 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:28.694492    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:28.971712 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:28.971621    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:29.373837 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:29.373784    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:29.655442 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:29.655357    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:29.691418 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:29.691387    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:29.691612 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:29.691507    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:29.754509 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:29.754472    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:29.885140 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:29.885109    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:29.960593 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:29.960504    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:30.058718 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.058682    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:30.159430 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.159396    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:30.260675 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.260636    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:30.371520 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.371491    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:30.428593 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.428554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:30.428790 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.428601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:30.428790 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.428722    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:30.428790 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.428790    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs podName:b790639c-32af-4aab-abf8-7a439dc26f30 nodeName:}" failed. No retries permitted until 2026-07-30 22:49:02.428774881 +0000 UTC m=+66.159920024 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs") pod "network-metrics-daemon-bgxlv" (UID: "b790639c-32af-4aab-abf8-7a439dc26f30") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 22:48:30.428954 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.428723    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:30.428954 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.428877    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret podName:07fa440e-a582-4b5e-b055-87da66d02efc nodeName:}" failed. No retries permitted until 2026-07-30 22:49:02.428859606 +0000 UTC m=+66.160004748 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret") pod "global-pull-secret-syncer-d8n59" (UID: "07fa440e-a582-4b5e-b055-87da66d02efc") : object "kube-system"/"original-pull-secret" not registered
Jul 30 22:48:30.529482 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.529408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:30.529621 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.529603    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 22:48:30.529661 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.529629    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 22:48:30.529661 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.529642    2561 projected.go:196] Error preparing data for projected volume kube-api-access-qjdrg for pod openshift-network-diagnostics/network-check-target-hmftj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:30.529731 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.529703    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg podName:8f23b63e-77ff-4825-92a3-e041a40e5d9b nodeName:}" failed. No retries permitted until 2026-07-30 22:49:02.529685676 +0000 UTC m=+66.260830829 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qjdrg" (UniqueName: "kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg") pod "network-check-target-hmftj" (UID: "8f23b63e-77ff-4825-92a3-e041a40e5d9b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 22:48:30.575985 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.575953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:30.636863 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.636828    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:30.691298 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.691268    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:30.691483 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.691268    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:30.691483 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.691412    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:30.691605 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:30.691487    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:30.740588 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.740549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:30.816269 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:30.816166    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.004770 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:31.004735    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.087809 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:31.087706    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.173383 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:31.173348    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.267767 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:31.267729    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.367240 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:31.367148    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.432341 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:31.432312    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:31.691794 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:31.691715    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:31.691955 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:31.691827    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:31.974454 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:31.974424    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:32.002333 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:32.002299    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerStarted","Data":"2d50aa29faa949028a9e1abcab9c76974e6d35953b81d7f9d70b297daa86ea6a"}
Jul 30 22:48:32.043404 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:32.043376    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:32.571447 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:32.571415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:32.693937 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:32.693908    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:32.694090 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:32.694025    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:32.694090 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:32.694077    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:32.694215 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:32.694192    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:32.780712 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:32.780677    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:32.969833 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:32.969735    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:33.007014 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:33.006982    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f69e055-9413-4d8b-aea3-6789cb4129ff" containerID="2d50aa29faa949028a9e1abcab9c76974e6d35953b81d7f9d70b297daa86ea6a" exitCode=0
Jul 30 22:48:33.007207 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:33.007038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerDied","Data":"2d50aa29faa949028a9e1abcab9c76974e6d35953b81d7f9d70b297daa86ea6a"}
Jul 30 22:48:33.159784 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:33.159750    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:33.217586 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:33.217556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:33.691356 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:33.691310    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:33.691742 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:33.691425    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:34.012248 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.012211    2561 generic.go:356] "Generic (PLEG): container finished" podID="7f69e055-9413-4d8b-aea3-6789cb4129ff" containerID="570705cd9b58e75c7b6011a21965add5fa226d120787b85ab4a32dc203d48882" exitCode=0
Jul 30 22:48:34.012420 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.012293    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerDied","Data":"570705cd9b58e75c7b6011a21965add5fa226d120787b85ab4a32dc203d48882"}
Jul 30 22:48:34.171982 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.171947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:34.372723 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.372633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:34.443196 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.443147    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:34.575105 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.575073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:34.691401 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.691327    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:34.691736 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:34.691444    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:34.691736 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.691497    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:34.691736 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:34.691581    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:34.769551 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:34.769519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:35.017508 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:35.017476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" event={"ID":"7f69e055-9413-4d8b-aea3-6789cb4129ff","Type":"ContainerStarted","Data":"e70e6011aec862680f74fbe9ee2ce6d4d5a1dbe86c6fe62c4301543fcbad8376"}
Jul 30 22:48:35.042147 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:35.042095    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nkwfs" podStartSLOduration=8.782230616 podStartE2EDuration="38.042081166s" totalImagesPullingTime="29.25985055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:35.041873913 +0000 UTC m=+38.773019074" watchObservedRunningTime="2026-07-30 22:48:35.042081166 +0000 UTC m=+38.773226327"
Jul 30 22:48:35.690761 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:35.690726    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:35.690937 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:35.690825    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:36.694293 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:36.694264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:36.694648 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:36.694264    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:36.694648 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:36.694369    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:36.694648 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:36.694438    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:37.691655 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:37.691622    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:37.691833 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:37.691721    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:38.691583 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:38.691550    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:38.691583 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:38.691581    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:38.692091 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:38.691682    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:38.692091 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:38.691756    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:39.691595 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:39.691558    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:39.691992 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:39.691661    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:40.694285 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:40.694253    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:40.694643 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:40.694253    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:40.694643 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:40.694363    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:40.694643 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:40.694435    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:41.691376 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:41.691339    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:41.691655 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:41.691447    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:42.597559 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:42.597530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:42.691594 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:42.691555    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:42.691782 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:42.691675    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:42.691782 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:42.691707    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:42.691782 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:42.691757    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:42.708110 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:42.708078    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:42.829607 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:42.829533    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:42.927607 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:42.927523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:43.046619 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.046589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:43.142919 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.142882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:43.352702 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.352669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:43.418079 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.417814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:43.584069 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.584043    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:43.691538 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.691503    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:43.692066 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:43.691599    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:43.851819 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.851788    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8n59"]
Jul 30 22:48:43.851983 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.851935    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:43.852069 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:43.852047    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:43.855342 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.855167    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgxlv"]
Jul 30 22:48:43.855501 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.855456    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:43.855605 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:43.855578    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:43.856096 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:43.856012    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmftj"]
Jul 30 22:48:44.037405 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:44.037374    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:44.037569 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:44.037478    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:44.793031 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:44.793002    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:44.852094 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:44.852063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:45.691347 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:45.691314    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:45.691347 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:45.691336    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:45.691536 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:45.691360    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:45.691536 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:45.691443    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:45.691536 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:45.691497    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:45.691632 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:45.691559    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:45.981157 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:45.981064    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:46.082053 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:46.082021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:46.165065 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:46.165035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:46.247249 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:46.247123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:47.601077 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:47.601035    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:47.691693 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:47.691655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:47.691886 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:47.691655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:47.691886 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:47.691775    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bgxlv" podUID="b790639c-32af-4aab-abf8-7a439dc26f30"
Jul 30 22:48:47.691886 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:47.691655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:47.691886 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:47.691859    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hmftj" podUID="8f23b63e-77ff-4825-92a3-e041a40e5d9b"
Jul 30 22:48:47.692031 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:47.691931    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-d8n59" podUID="07fa440e-a582-4b5e-b055-87da66d02efc"
Jul 30 22:48:47.701603 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:47.701562    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:48.139514 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.139488    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-246.ec2.internal" event="NodeReady"
Jul 30 22:48:48.139680 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.139625    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 22:48:48.190522 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.190488    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mh4q4"]
Jul 30 22:48:48.208403 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.208370    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m28hq"]
Jul 30 22:48:48.208580 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.208522    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.211105 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.211078    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4z2vv\""
Jul 30 22:48:48.211271 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.211242    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 22:48:48.211327 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.211308    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 22:48:48.211596 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.211576    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 22:48:48.211701 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.211600    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 22:48:48.222411 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.222391    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m28hq"]
Jul 30 22:48:48.222532 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.222422    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mh4q4"]
Jul 30 22:48:48.222532 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.222459    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cmxp4"]
Jul 30 22:48:48.222632 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.222595    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m28hq"
Jul 30 22:48:48.226406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.226386    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-zlg2h\""
Jul 30 22:48:48.226526 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.226417    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 22:48:48.226526 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.226481    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 22:48:48.226526 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.226495    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 22:48:48.240556 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.240532    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmxp4"]
Jul 30 22:48:48.240674 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.240630    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.243381 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.243363    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 22:48:48.243381 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.243374    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 22:48:48.243542 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.243411    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-g5cvn\""
Jul 30 22:48:48.259308 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-metrics-tls\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.259415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259311    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d615170-dc18-4245-b8d1-0af83fd6e73d-data-volume\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.259415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d615170-dc18-4245-b8d1-0af83fd6e73d-crio-socket\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.259415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259402    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-config-volume\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.259507 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259418    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bkq6\" (UniqueName: \"kubernetes.io/projected/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-kube-api-access-2bkq6\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.259507 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259477    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b188ffcf-dfa7-4025-ae4f-404a18d62c3e-cert\") pod \"ingress-canary-m28hq\" (UID: \"b188ffcf-dfa7-4025-ae4f-404a18d62c3e\") " pod="openshift-ingress-canary/ingress-canary-m28hq"
Jul 30 22:48:48.259572 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6g8d\" (UniqueName: \"kubernetes.io/projected/b188ffcf-dfa7-4025-ae4f-404a18d62c3e-kube-api-access-j6g8d\") pod \"ingress-canary-m28hq\" (UID: \"b188ffcf-dfa7-4025-ae4f-404a18d62c3e\") " pod="openshift-ingress-canary/ingress-canary-m28hq"
Jul 30 22:48:48.259572 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d615170-dc18-4245-b8d1-0af83fd6e73d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.259572 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d8lm\" (UniqueName: \"kubernetes.io/projected/5d615170-dc18-4245-b8d1-0af83fd6e73d-kube-api-access-2d8lm\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.259572 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-tmp-dir\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.259705 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.259591    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d615170-dc18-4245-b8d1-0af83fd6e73d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.337791 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.337698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:48.360906 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.360875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-config-volume\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.361021 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.360910    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bkq6\" (UniqueName: \"kubernetes.io/projected/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-kube-api-access-2bkq6\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.361021 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.360930    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b188ffcf-dfa7-4025-ae4f-404a18d62c3e-cert\") pod \"ingress-canary-m28hq\" (UID: \"b188ffcf-dfa7-4025-ae4f-404a18d62c3e\") " pod="openshift-ingress-canary/ingress-canary-m28hq"
Jul 30 22:48:48.361021 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.360946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6g8d\" (UniqueName: \"kubernetes.io/projected/b188ffcf-dfa7-4025-ae4f-404a18d62c3e-kube-api-access-j6g8d\") pod \"ingress-canary-m28hq\" (UID: \"b188ffcf-dfa7-4025-ae4f-404a18d62c3e\") " pod="openshift-ingress-canary/ingress-canary-m28hq"
Jul 30 22:48:48.361021 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.360970    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d615170-dc18-4245-b8d1-0af83fd6e73d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.361021 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.360993    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d8lm\" (UniqueName: \"kubernetes.io/projected/5d615170-dc18-4245-b8d1-0af83fd6e73d-kube-api-access-2d8lm\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.361291 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.361171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-tmp-dir\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.361291 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.361238    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d615170-dc18-4245-b8d1-0af83fd6e73d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.361389 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.361290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-metrics-tls\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.361389 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.361318    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d615170-dc18-4245-b8d1-0af83fd6e73d-data-volume\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.361389 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.361344    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d615170-dc18-4245-b8d1-0af83fd6e73d-crio-socket\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.362110 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.361782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5d615170-dc18-4245-b8d1-0af83fd6e73d-crio-socket\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.362110 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.362029    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-tmp-dir\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.362110 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.362031    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d615170-dc18-4245-b8d1-0af83fd6e73d-data-volume\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.362110 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.362103    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5d615170-dc18-4245-b8d1-0af83fd6e73d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.364201 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.362476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-config-volume\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.366597 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.366576    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5d615170-dc18-4245-b8d1-0af83fd6e73d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.366690 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.366630    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-metrics-tls\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.367769 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.367746    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b188ffcf-dfa7-4025-ae4f-404a18d62c3e-cert\") pod \"ingress-canary-m28hq\" (UID: \"b188ffcf-dfa7-4025-ae4f-404a18d62c3e\") " pod="openshift-ingress-canary/ingress-canary-m28hq"
Jul 30 22:48:48.369294 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.369276    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bkq6\" (UniqueName: \"kubernetes.io/projected/b48d8d89-2612-4fa2-a8a3-cf5ecd277009-kube-api-access-2bkq6\") pod \"dns-default-cmxp4\" (UID: \"b48d8d89-2612-4fa2-a8a3-cf5ecd277009\") " pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.369736 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.369720    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d8lm\" (UniqueName: \"kubernetes.io/projected/5d615170-dc18-4245-b8d1-0af83fd6e73d-kube-api-access-2d8lm\") pod \"insights-runtime-extractor-mh4q4\" (UID: \"5d615170-dc18-4245-b8d1-0af83fd6e73d\") " pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.370036 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.370005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6g8d\" (UniqueName: \"kubernetes.io/projected/b188ffcf-dfa7-4025-ae4f-404a18d62c3e-kube-api-access-j6g8d\") pod \"ingress-canary-m28hq\" (UID: \"b188ffcf-dfa7-4025-ae4f-404a18d62c3e\") " pod="openshift-ingress-canary/ingress-canary-m28hq"
Jul 30 22:48:48.519021 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.518988    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mh4q4"
Jul 30 22:48:48.530762 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.530725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m28hq"
Jul 30 22:48:48.549075 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.549053    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:48.733378 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.733196    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m28hq"]
Jul 30 22:48:48.736044 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.736015    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mh4q4"]
Jul 30 22:48:48.737749 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:48:48.737731    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb188ffcf_dfa7_4025_ae4f_404a18d62c3e.slice/crio-655710e0349308089fe51d699740164ab0333a3b931085e0dc3e6660a10c7d88 WatchSource:0}: Error finding container 655710e0349308089fe51d699740164ab0333a3b931085e0dc3e6660a10c7d88: Status 404 returned error can't find the container with id 655710e0349308089fe51d699740164ab0333a3b931085e0dc3e6660a10c7d88
Jul 30 22:48:48.739604 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:48:48.739575    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d615170_dc18_4245_b8d1_0af83fd6e73d.slice/crio-797529b61a1ce2a1c3c4c6ed3baec219ae0417dd4a561fbd41793df4cd5e8d70 WatchSource:0}: Error finding container 797529b61a1ce2a1c3c4c6ed3baec219ae0417dd4a561fbd41793df4cd5e8d70: Status 404 returned error can't find the container with id 797529b61a1ce2a1c3c4c6ed3baec219ae0417dd4a561fbd41793df4cd5e8d70
Jul 30 22:48:48.749776 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:48.749754    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cmxp4"]
Jul 30 22:48:48.753135 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:48:48.753114    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48d8d89_2612_4fa2_a8a3_cf5ecd277009.slice/crio-59b77edbda1a15657ac3c2d2d8f172f4e93b7bdfe4227b2e07445d32eb260669 WatchSource:0}: Error finding container 59b77edbda1a15657ac3c2d2d8f172f4e93b7bdfe4227b2e07445d32eb260669: Status 404 returned error can't find the container with id 59b77edbda1a15657ac3c2d2d8f172f4e93b7bdfe4227b2e07445d32eb260669
Jul 30 22:48:49.047908 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.047867    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmxp4" event={"ID":"b48d8d89-2612-4fa2-a8a3-cf5ecd277009","Type":"ContainerStarted","Data":"59b77edbda1a15657ac3c2d2d8f172f4e93b7bdfe4227b2e07445d32eb260669"}
Jul 30 22:48:49.048998 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.048973    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m28hq" event={"ID":"b188ffcf-dfa7-4025-ae4f-404a18d62c3e","Type":"ContainerStarted","Data":"655710e0349308089fe51d699740164ab0333a3b931085e0dc3e6660a10c7d88"}
Jul 30 22:48:49.050401 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.050381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mh4q4" event={"ID":"5d615170-dc18-4245-b8d1-0af83fd6e73d","Type":"ContainerStarted","Data":"d23e48619c9af7320eb9bd40aebe49563e09e1536a64c592c2d85fee34bdfa7a"}
Jul 30 22:48:49.050483 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.050420    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mh4q4" event={"ID":"5d615170-dc18-4245-b8d1-0af83fd6e73d","Type":"ContainerStarted","Data":"797529b61a1ce2a1c3c4c6ed3baec219ae0417dd4a561fbd41793df4cd5e8d70"}
Jul 30 22:48:49.691628 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.691589    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:48:49.691920 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.691590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:48:49.691920 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.691603    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:48:49.695441 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.695376    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 22:48:49.695576 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.695444    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ghwvz\""
Jul 30 22:48:49.695576 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.695440    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 22:48:49.695576 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.695465    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 22:48:49.695721 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.695707    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6fgjp\""
Jul 30 22:48:49.695840 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.695823    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 22:48:49.773534 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.773428    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:49.829731 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:49.829694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:50.055284 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.055247    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mh4q4" event={"ID":"5d615170-dc18-4245-b8d1-0af83fd6e73d","Type":"ContainerStarted","Data":"20d7ae0c414fbbecd7d02456d4a29ba5bf3b34c992068e515013cbc48be703d9"}
Jul 30 22:48:50.169730 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.169668    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:50.208648 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.208566    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-8p496"]
Jul 30 22:48:50.217682 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.217660    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.220579 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.220518    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-8p496"]
Jul 30 22:48:50.221224 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.220877    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 30 22:48:50.221224 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.220955    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 30 22:48:50.221224 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.220988    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 22:48:50.221224 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.220988    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 22:48:50.221224 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.221106    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6g886\""
Jul 30 22:48:50.221522 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.221348    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 22:48:50.238329 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.238292    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:50.276511 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.276472    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.276677 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.276624    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.276677 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.276660    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b8e6550-0ed9-4d1e-868f-e613f41ee798-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.276777 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.276698    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhddc\" (UniqueName: \"kubernetes.io/projected/8b8e6550-0ed9-4d1e-868f-e613f41ee798-kube-api-access-xhddc\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.377383 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.377342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhddc\" (UniqueName: \"kubernetes.io/projected/8b8e6550-0ed9-4d1e-868f-e613f41ee798-kube-api-access-xhddc\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.377541 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.377408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.377541 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.377459    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.377541 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.377474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b8e6550-0ed9-4d1e-868f-e613f41ee798-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.377672 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:50.377580    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 30 22:48:50.377672 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:50.377655    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-tls podName:8b8e6550-0ed9-4d1e-868f-e613f41ee798 nodeName:}" failed. No retries permitted until 2026-07-30 22:48:50.877636636 +0000 UTC m=+54.608781780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-8p496" (UID: "8b8e6550-0ed9-4d1e-868f-e613f41ee798") : secret "prometheus-operator-tls" not found
Jul 30 22:48:50.378683 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.378494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b8e6550-0ed9-4d1e-868f-e613f41ee798-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.382061 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.382037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.386966 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.386939    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhddc\" (UniqueName: \"kubernetes.io/projected/8b8e6550-0ed9-4d1e-868f-e613f41ee798-kube-api-access-xhddc\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.490266 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.490150    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:50.882472 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.882434    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:50.885256 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:50.885220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/8b8e6550-0ed9-4d1e-868f-e613f41ee798-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-8p496\" (UID: \"8b8e6550-0ed9-4d1e-868f-e613f41ee798\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:51.130014 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:51.129975    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496"
Jul 30 22:48:52.218593 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:52.218342    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-8p496"]
Jul 30 22:48:52.251132 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:48:52.251054    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8e6550_0ed9_4d1e_868f_e613f41ee798.slice/crio-5d7d81ebfe54bc358358de591c0a05542dc3dd3dc35e84ba5a90830b17d5e26b WatchSource:0}: Error finding container 5d7d81ebfe54bc358358de591c0a05542dc3dd3dc35e84ba5a90830b17d5e26b: Status 404 returned error can't find the container with id 5d7d81ebfe54bc358358de591c0a05542dc3dd3dc35e84ba5a90830b17d5e26b
Jul 30 22:48:52.388422 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:52.388388    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:52.491069 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:52.491034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:53.064989 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.064947    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmxp4" event={"ID":"b48d8d89-2612-4fa2-a8a3-cf5ecd277009","Type":"ContainerStarted","Data":"29bf06c7de8c3696563f97a1c1888e0a0e3ffa5cf5fe85a91c8efb64d0104758"}
Jul 30 22:48:53.065188 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.065014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cmxp4" event={"ID":"b48d8d89-2612-4fa2-a8a3-cf5ecd277009","Type":"ContainerStarted","Data":"12c96eb01d17ac1f00efc27aab77e9fe897a1388709f658a4c81f833b2d25582"}
Jul 30 22:48:53.065262 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.065167    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:48:53.066166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.066144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496" event={"ID":"8b8e6550-0ed9-4d1e-868f-e613f41ee798","Type":"ContainerStarted","Data":"5d7d81ebfe54bc358358de591c0a05542dc3dd3dc35e84ba5a90830b17d5e26b"}
Jul 30 22:48:53.067505 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.067484    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m28hq" event={"ID":"b188ffcf-dfa7-4025-ae4f-404a18d62c3e","Type":"ContainerStarted","Data":"4a29c4caca360a3cfc5b604e6108dc81f5e1d65f4f7cf4e41a57e62ec7880ad7"}
Jul 30 22:48:53.069452 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.069429    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mh4q4" event={"ID":"5d615170-dc18-4245-b8d1-0af83fd6e73d","Type":"ContainerStarted","Data":"d88c429628764d93ce4a47b59f99352b076b4e927c51256cee71f5fe48a3452f"}
Jul 30 22:48:53.082878 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.082833    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cmxp4" podStartSLOduration=1.7736266569999999 podStartE2EDuration="5.082818721s" totalImagesPullingTime="3.309192064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:53.082368947 +0000 UTC m=+56.813514147" watchObservedRunningTime="2026-07-30 22:48:53.082818721 +0000 UTC m=+56.813963860"
Jul 30 22:48:53.107984 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.107937    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m28hq" podStartSLOduration=1.7742853950000002 podStartE2EDuration="5.107921969s" totalImagesPullingTime="3.333636574s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:53.107319121 +0000 UTC m=+56.838464297" watchObservedRunningTime="2026-07-30 22:48:53.107921969 +0000 UTC m=+56.839067160"
Jul 30 22:48:53.138504 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.138447    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mh4q4" podStartSLOduration=1.815981106 podStartE2EDuration="5.138423874s" totalImagesPullingTime="3.322442768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:48:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:53.137318624 +0000 UTC m=+56.868463811" watchObservedRunningTime="2026-07-30 22:48:53.138423874 +0000 UTC m=+56.869569036"
Jul 30 22:48:53.673359 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.673284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:53.774111 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:53.774077    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:54.385802 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:54.385696    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:54.780460 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:54.780416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:54.841308 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:54.841277    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:55.081456 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:55.081372    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496" event={"ID":"8b8e6550-0ed9-4d1e-868f-e613f41ee798","Type":"ContainerStarted","Data":"6df10ef6f67b720fc22f6c3e18916a1cf832a00ca32b25a2a831b65adb105491"}
Jul 30 22:48:55.081456 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:55.081421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496" event={"ID":"8b8e6550-0ed9-4d1e-868f-e613f41ee798","Type":"ContainerStarted","Data":"b5441fa84e44f50c8a1b2865e51bf918fb761e8f1dfb8eacedca669ece037d97"}
Jul 30 22:48:55.100730 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:55.100680    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-8p496" podStartSLOduration=3.321442814 podStartE2EDuration="5.100665602s" totalImagesPullingTime="1.779222788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:55.099773395 +0000 UTC m=+58.830918555" watchObservedRunningTime="2026-07-30 22:48:55.100665602 +0000 UTC m=+58.831810830"
Jul 30 22:48:56.350230 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.350194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:56.543010 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.542980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:56.589267 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.589235    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ws6tv"]
Jul 30 22:48:56.592867 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.592840    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.595248 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.595222    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 22:48:56.595504 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.595488    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 22:48:56.595839 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.595823    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8rdn7\""
Jul 30 22:48:56.595880 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.595843    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 22:48:56.622768 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.622680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-tls\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.622768 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.622716    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34dbe537-632e-44b8-ac40-ad575efce976-metrics-client-ca\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.622768 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.622743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-accelerators-collector-config\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.623025 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.622772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-sys\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.623025 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.622844    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-root\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.623025 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.622865    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-textfile\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.623025 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.622886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.623025 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.622976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/34dbe537-632e-44b8-ac40-ad575efce976-kube-api-access-nc57r\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.623025 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.623015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-wtmp\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.649334 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.649305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:56.723341 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723311    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-wtmp\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723542 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723378    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-tls\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723542 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723407    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34dbe537-632e-44b8-ac40-ad575efce976-metrics-client-ca\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723542 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-accelerators-collector-config\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723542 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-sys\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723542 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-wtmp\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723794 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-root\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723794 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723533    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-sys\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723794 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-textfile\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723794 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723794 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723609    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34dbe537-632e-44b8-ac40-ad575efce976-root\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.723794 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/34dbe537-632e-44b8-ac40-ad575efce976-kube-api-access-nc57r\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.724054 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.723907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-textfile\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.724151 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.724134    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34dbe537-632e-44b8-ac40-ad575efce976-metrics-client-ca\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.724246 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.724211    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-accelerators-collector-config\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.726631 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.726602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.726769 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.726738    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34dbe537-632e-44b8-ac40-ad575efce976-node-exporter-tls\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.732591 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.732560    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc57r\" (UniqueName: \"kubernetes.io/projected/34dbe537-632e-44b8-ac40-ad575efce976-kube-api-access-nc57r\") pod \"node-exporter-ws6tv\" (UID: \"34dbe537-632e-44b8-ac40-ad575efce976\") " pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.738950 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.738927    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:56.838783 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.838746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:56.901729 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.901662    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ws6tv"
Jul 30 22:48:56.912203 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:48:56.912156    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34dbe537_632e_44b8_ac40_ad575efce976.slice/crio-518373d3dabee99ea1be407d0bfb0214d0e53a0501710175faef5bb726a93a3f WatchSource:0}: Error finding container 518373d3dabee99ea1be407d0bfb0214d0e53a0501710175faef5bb726a93a3f: Status 404 returned error can't find the container with id 518373d3dabee99ea1be407d0bfb0214d0e53a0501710175faef5bb726a93a3f
Jul 30 22:48:56.939964 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.939914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:56.996144 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:56.996121    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-r9ng2"
Jul 30 22:48:57.088916 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.088879    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ws6tv" event={"ID":"34dbe537-632e-44b8-ac40-ad575efce976","Type":"ContainerStarted","Data":"518373d3dabee99ea1be407d0bfb0214d0e53a0501710175faef5bb726a93a3f"}
Jul 30 22:48:57.123284 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.123251    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:57.223932 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.223854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:57.439278 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.439240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:57.574003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.573968    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:57.672089 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.672055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:57.677612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.677583    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:48:57.681412 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.681389    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.684758 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.683963    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 30 22:48:57.684758 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.684218    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 30 22:48:57.684758 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.684732    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cnrsr\""
Jul 30 22:48:57.685034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.684923    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 30 22:48:57.685034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.684936    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 30 22:48:57.685034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.684939    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 30 22:48:57.685034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.685007    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 30 22:48:57.685034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.684983    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 30 22:48:57.685345 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.685165    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 30 22:48:57.685345 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.685263    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 30 22:48:57.699959 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.699934    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:48:57.730872 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.730829    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731041 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.730878    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731041 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.730906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731041 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731000    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731172 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731172 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731073    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731172 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731090    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvvzb\" (UniqueName: \"kubernetes.io/projected/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-kube-api-access-bvvzb\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731172 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731172 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731167    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731390 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731202    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-web-config\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731390 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731230    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731390 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-config-out\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.731390 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.731309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.798661 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.798606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:57.832092 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832092 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832060    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-config-out\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832316 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832316 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832272    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832316 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832307    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832476 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832362    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832542 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832611 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832664 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832664 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832638    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvvzb\" (UniqueName: \"kubernetes.io/projected/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-kube-api-access-bvvzb\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832762 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832762 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.832864 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.832760    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-web-config\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.833556 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.833068    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.833556 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:48:57.833318    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-trusted-ca-bundle podName:dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a nodeName:}" failed. No retries permitted until 2026-07-30 22:48:58.333294294 +0000 UTC m=+62.064439453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a") : configmap references non-existent config key: ca-bundle.crt
Jul 30 22:48:57.833556 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.833360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.835159 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.835130    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-config-volume\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.835903 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.835846    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-web-config\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.835903 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.835886    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.836052 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.836027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-config-out\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.836270 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.836236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.836378 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.836300    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.836378 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.836339    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.836690 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.836668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.836769 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.836755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.841276 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.841253    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvvzb\" (UniqueName: \"kubernetes.io/projected/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-kube-api-access-bvvzb\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:57.888619 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:57.888590    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:58.094346 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.094245    2561 generic.go:356] "Generic (PLEG): container finished" podID="34dbe537-632e-44b8-ac40-ad575efce976" containerID="cb3cbeb966d5a500ba0269bcb5434e799eca43436a90c5fcfc9fdeb96dae0ea8" exitCode=0
Jul 30 22:48:58.094346 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.094317    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ws6tv" event={"ID":"34dbe537-632e-44b8-ac40-ad575efce976","Type":"ContainerDied","Data":"cb3cbeb966d5a500ba0269bcb5434e799eca43436a90c5fcfc9fdeb96dae0ea8"}
Jul 30 22:48:58.336513 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.336475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:58.337415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.337394    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:58.593933 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.593896    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 30 22:48:58.670137 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.670111    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"]
Jul 30 22:48:58.674636 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.673847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.676631 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.676541    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 30 22:48:58.676883 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.676839    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 30 22:48:58.677647 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.677021    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-rlbk57rujgff\""
Jul 30 22:48:58.677647 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.677234    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 30 22:48:58.677647 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.677267    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 30 22:48:58.677647 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.677368    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-95jnx\""
Jul 30 22:48:58.677647 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.677486    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 30 22:48:58.682098 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.682075    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"]
Jul 30 22:48:58.739963 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.739930    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfd7p\" (UniqueName: \"kubernetes.io/projected/d7294f53-2807-43b3-a24d-99894d2c0688-kube-api-access-dfd7p\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.740115 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.739976    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.740115 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.740004    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7294f53-2807-43b3-a24d-99894d2c0688-metrics-client-ca\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.740115 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.740089    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.740262 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.740138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-grpc-tls\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.740262 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.740161    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.740262 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.740212    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.740351 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.740279    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-tls\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.744263 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.744238    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 30 22:48:58.747357 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:48:58.747324    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcabf8a9_7f24_4649_a5d2_4b5ebc02df3a.slice/crio-823e5a1e5489ea4385fa0962352f79b7873863a2651271a0fefca3e06d166c12 WatchSource:0}: Error finding container 823e5a1e5489ea4385fa0962352f79b7873863a2651271a0fefca3e06d166c12: Status 404 returned error can't find the container with id 823e5a1e5489ea4385fa0962352f79b7873863a2651271a0fefca3e06d166c12
Jul 30 22:48:58.840932 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.840893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.841106 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.840952    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-grpc-tls\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.841106 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.840984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.841106 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.841017    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.841106 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.841091    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-tls\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.841358 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.841125    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfd7p\" (UniqueName: \"kubernetes.io/projected/d7294f53-2807-43b3-a24d-99894d2c0688-kube-api-access-dfd7p\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.841358 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.841154    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.841358 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.841206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7294f53-2807-43b3-a24d-99894d2c0688-metrics-client-ca\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.842211 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.841974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d7294f53-2807-43b3-a24d-99894d2c0688-metrics-client-ca\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.844274 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.844208    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-grpc-tls\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.844549 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.844530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.844670 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.844627    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.844728 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.844680    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.844784 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.844740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.844841 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.844792    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d7294f53-2807-43b3-a24d-99894d2c0688-secret-thanos-querier-tls\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.850288 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.850264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfd7p\" (UniqueName: \"kubernetes.io/projected/d7294f53-2807-43b3-a24d-99894d2c0688-kube-api-access-dfd7p\") pod \"thanos-querier-6858f6cf95-zcnxg\" (UID: \"d7294f53-2807-43b3-a24d-99894d2c0688\") " pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:58.858091 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.858065    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:58.958746 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.958713    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:58.985888 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:58.985857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:48:59.104009 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.103919    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ws6tv" event={"ID":"34dbe537-632e-44b8-ac40-ad575efce976","Type":"ContainerStarted","Data":"981c61ffd8c6c41e83c55fc04f40e68a1cc4391f9a96b1121d964a7324637bfd"}
Jul 30 22:48:59.104170 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.104021    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ws6tv" event={"ID":"34dbe537-632e-44b8-ac40-ad575efce976","Type":"ContainerStarted","Data":"e141fc6d5be63950057421547361c05ebc93e6861de95c991bae70a5bf726300"}
Jul 30 22:48:59.105119 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.105098    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a","Type":"ContainerStarted","Data":"823e5a1e5489ea4385fa0962352f79b7873863a2651271a0fefca3e06d166c12"}
Jul 30 22:48:59.123683 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.123656    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"]
Jul 30 22:48:59.126759 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.126717    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ws6tv" podStartSLOduration=2.109963719 podStartE2EDuration="3.126701264s" totalImagesPullingTime="952.555946ms" totalInitContainerRuntime="64.181599ms" isStatefulPod=true podCreationTimestamp="2026-07-30 22:48:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:48:59.125360866 +0000 UTC m=+62.856506028" watchObservedRunningTime="2026-07-30 22:48:59.126701264 +0000 UTC m=+62.857846425"
Jul 30 22:48:59.127871 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:48:59.127847    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7294f53_2807_43b3_a24d_99894d2c0688.slice/crio-c6b97cb2c0afd553b6517f7d32467fbddc91303a0a7752ccecbd36b4217ff453 WatchSource:0}: Error finding container c6b97cb2c0afd553b6517f7d32467fbddc91303a0a7752ccecbd36b4217ff453: Status 404 returned error can't find the container with id c6b97cb2c0afd553b6517f7d32467fbddc91303a0a7752ccecbd36b4217ff453
Jul 30 22:48:59.531484 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.531430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:59.634222 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.634171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:59.838211 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.838157    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:48:59.938884 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:48:59.938854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:00.109621 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.109532    2561 generic.go:356] "Generic (PLEG): container finished" podID="dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a" containerID="813b029710e3774bb226746235dedd7a1a53a8fe41d07785c8f40847e50bacbd" exitCode=0
Jul 30 22:49:00.109779 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.109629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a","Type":"ContainerDied","Data":"813b029710e3774bb226746235dedd7a1a53a8fe41d07785c8f40847e50bacbd"}
Jul 30 22:49:00.110870 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.110841    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg" event={"ID":"d7294f53-2807-43b3-a24d-99894d2c0688","Type":"ContainerStarted","Data":"c6b97cb2c0afd553b6517f7d32467fbddc91303a0a7752ccecbd36b4217ff453"}
Jul 30 22:49:00.835912 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.835882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:00.950687 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.950655    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76bf775fd8-gsjjb"]
Jul 30 22:49:00.954019 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.953997    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:00.959109 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.959059    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 30 22:49:00.959109 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.959110    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 30 22:49:00.959696 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.959675    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 30 22:49:00.959791 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.959762    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-7n5rs\""
Jul 30 22:49:00.959855 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.959800    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 30 22:49:00.959855 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.959680    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1okl30k8e5o2\""
Jul 30 22:49:00.963326 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.963301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:00.971638 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:00.971614    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76bf775fd8-gsjjb"]
Jul 30 22:49:01.063456 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.063415    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-secret-metrics-server-tls\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.063641 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.063473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-audit-log\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.063641 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.063518    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-metrics-server-audit-profiles\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.063641 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.063551    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-client-ca-bundle\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.063641 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.063627    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-secret-metrics-server-client-certs\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.063874 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.063656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.063874 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.063696    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7sg\" (UniqueName: \"kubernetes.io/projected/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-kube-api-access-gw7sg\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.165200 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.165382 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165300    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7sg\" (UniqueName: \"kubernetes.io/projected/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-kube-api-access-gw7sg\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.165382 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165373    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-secret-metrics-server-tls\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.165506 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165413    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-audit-log\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.165506 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-metrics-server-audit-profiles\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.165506 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165483    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-client-ca-bundle\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.165650 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-secret-metrics-server-client-certs\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.166279 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165926    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.166279 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.165960    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-audit-log\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.166833 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.166802    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-metrics-server-audit-profiles\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.169005 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.168982    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-secret-metrics-server-client-certs\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.169098 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.169005    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-secret-metrics-server-tls\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.169211 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.169167    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-client-ca-bundle\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.175622 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.175592    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7sg\" (UniqueName: \"kubernetes.io/projected/7a06c6d5-5583-4ecc-b05c-f7337e6cbe34-kube-api-access-gw7sg\") pod \"metrics-server-76bf775fd8-gsjjb\" (UID: \"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34\") " pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.266016 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.265971    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:01.389392 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.389357    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"]
Jul 30 22:49:01.392618 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.392582    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:01.397095 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.397066    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 30 22:49:01.397263 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.397096    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-slsr8\""
Jul 30 22:49:01.401286 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.401262    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:01.410341 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.410291    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"]
Jul 30 22:49:01.468223 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.468124    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fee519c-f0cb-48ae-92cf-df70ccaecc26-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-96w28\" (UID: \"1fee519c-f0cb-48ae-92cf-df70ccaecc26\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:01.468394 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.468363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mrxj\" (UniqueName: \"kubernetes.io/projected/1fee519c-f0cb-48ae-92cf-df70ccaecc26-kube-api-access-5mrxj\") pod \"monitoring-plugin-6dffbbd67-96w28\" (UID: \"1fee519c-f0cb-48ae-92cf-df70ccaecc26\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:01.491426 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.491380    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:01.569217 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.569155    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mrxj\" (UniqueName: \"kubernetes.io/projected/1fee519c-f0cb-48ae-92cf-df70ccaecc26-kube-api-access-5mrxj\") pod \"monitoring-plugin-6dffbbd67-96w28\" (UID: \"1fee519c-f0cb-48ae-92cf-df70ccaecc26\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:01.569402 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.569235    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fee519c-f0cb-48ae-92cf-df70ccaecc26-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-96w28\" (UID: \"1fee519c-f0cb-48ae-92cf-df70ccaecc26\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:01.569402 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:49:01.569368    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 30 22:49:01.569504 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:49:01.569444    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1fee519c-f0cb-48ae-92cf-df70ccaecc26-monitoring-plugin-cert podName:1fee519c-f0cb-48ae-92cf-df70ccaecc26 nodeName:}" failed. No retries permitted until 2026-07-30 22:49:02.069424112 +0000 UTC m=+65.800569264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1fee519c-f0cb-48ae-92cf-df70ccaecc26-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-96w28" (UID: "1fee519c-f0cb-48ae-92cf-df70ccaecc26") : secret "monitoring-plugin-cert" not found
Jul 30 22:49:01.578843 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.578813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mrxj\" (UniqueName: \"kubernetes.io/projected/1fee519c-f0cb-48ae-92cf-df70ccaecc26-kube-api-access-5mrxj\") pod \"monitoring-plugin-6dffbbd67-96w28\" (UID: \"1fee519c-f0cb-48ae-92cf-df70ccaecc26\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:01.765805 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.765775    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76bf775fd8-gsjjb"]
Jul 30 22:49:01.770349 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:49:01.770303    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a06c6d5_5583_4ecc_b05c_f7337e6cbe34.slice/crio-59fa165942554cbb369d994ba933fa9619f4c1f32e72bd036132bf83d2247970 WatchSource:0}: Error finding container 59fa165942554cbb369d994ba933fa9619f4c1f32e72bd036132bf83d2247970: Status 404 returned error can't find the container with id 59fa165942554cbb369d994ba933fa9619f4c1f32e72bd036132bf83d2247970
Jul 30 22:49:01.827914 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:01.827863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:02.073352 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.073319    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fee519c-f0cb-48ae-92cf-df70ccaecc26-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-96w28\" (UID: \"1fee519c-f0cb-48ae-92cf-df70ccaecc26\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:02.075681 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.075662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1fee519c-f0cb-48ae-92cf-df70ccaecc26-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-96w28\" (UID: \"1fee519c-f0cb-48ae-92cf-df70ccaecc26\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:02.120457 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.120426    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg" event={"ID":"d7294f53-2807-43b3-a24d-99894d2c0688","Type":"ContainerStarted","Data":"cd6663bd53c13c32b3a0ccbc9d327aa87e47ca6a10b30f756207b91c19949764"}
Jul 30 22:49:02.120630 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.120491    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg" event={"ID":"d7294f53-2807-43b3-a24d-99894d2c0688","Type":"ContainerStarted","Data":"f198a321e2aaa590d51b6f83c4b0168dd1cba4f86ac77e37393e64ad2fe4403d"}
Jul 30 22:49:02.120630 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.120529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg" event={"ID":"d7294f53-2807-43b3-a24d-99894d2c0688","Type":"ContainerStarted","Data":"c5db63774031b7616a46b190404c37c0fcdf844737bac3757e170e6e02fd05c5"}
Jul 30 22:49:02.121594 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.121570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb" event={"ID":"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34","Type":"ContainerStarted","Data":"59fa165942554cbb369d994ba933fa9619f4c1f32e72bd036132bf83d2247970"}
Jul 30 22:49:02.124497 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.124477    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a","Type":"ContainerStarted","Data":"0c80197ce689cf06456660582100131691a691bda6f6702ef685f2f369fc8209"}
Jul 30 22:49:02.124650 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.124532    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a","Type":"ContainerStarted","Data":"d93c52ee98211d315ba46909484e960125a76fb9d3fccb3bd5f4eb52f8b29372"}
Jul 30 22:49:02.124650 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.124557    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a","Type":"ContainerStarted","Data":"f62daedfd631f98eba7f9ef108c83d09ebe781480d0c6f4cd9ffbf88695fd9d0"}
Jul 30 22:49:02.124650 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.124588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a","Type":"ContainerStarted","Data":"8d94f277492e6a5e410e1159bbca2031464f9e718d2fac9857b42defb8d721c8"}
Jul 30 22:49:02.124650 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.124614    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a","Type":"ContainerStarted","Data":"ba7a4cfd23e8369afbf5c7a5865d19abfff47ef93577973bbcc67cd0738e1506"}
Jul 30 22:49:02.304373 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.304325    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:02.464709 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.464669    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"]
Jul 30 22:49:02.476577 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.476546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:49:02.476776 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.476591    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:49:02.479740 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.479711    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 22:49:02.479903 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.479711    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 22:49:02.490250 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.490217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/07fa440e-a582-4b5e-b055-87da66d02efc-original-pull-secret\") pod \"global-pull-secret-syncer-d8n59\" (UID: \"07fa440e-a582-4b5e-b055-87da66d02efc\") " pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:49:02.490250 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.490244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b790639c-32af-4aab-abf8-7a439dc26f30-metrics-certs\") pod \"network-metrics-daemon-bgxlv\" (UID: \"b790639c-32af-4aab-abf8-7a439dc26f30\") " pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:49:02.579219 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.579066    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:49:02.582157 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.582121    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 22:49:02.593783 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.593730    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 22:49:02.603802 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.603729    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdrg\" (UniqueName: \"kubernetes.io/projected/8f23b63e-77ff-4825-92a3-e041a40e5d9b-kube-api-access-qjdrg\") pod \"network-check-target-hmftj\" (UID: \"8f23b63e-77ff-4825-92a3-e041a40e5d9b\") " pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:49:02.607950 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.607917    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6fgjp\""
Jul 30 22:49:02.611053 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:49:02.611015    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fee519c_f0cb_48ae_92cf_df70ccaecc26.slice/crio-c51094db1a3516007cd74266cd75087fd4114b8505279a23e6f276563a3a07e6 WatchSource:0}: Error finding container c51094db1a3516007cd74266cd75087fd4114b8505279a23e6f276563a3a07e6: Status 404 returned error can't find the container with id c51094db1a3516007cd74266cd75087fd4114b8505279a23e6f276563a3a07e6
Jul 30 22:49:02.616391 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.616330    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bgxlv"
Jul 30 22:49:02.616518 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.616450    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ghwvz\""
Jul 30 22:49:02.620171 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.620131    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-d8n59"
Jul 30 22:49:02.624274 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.624244    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:49:02.680071 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.680018    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:02.781865 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.780664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:02.823328 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.823157    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bgxlv"]
Jul 30 22:49:02.834649 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:49:02.834568    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb790639c_32af_4aab_abf8_7a439dc26f30.slice/crio-91c1163077e1bbc473e206a28e1b32d32d47d558eaefd899b85bd9c1423ac743 WatchSource:0}: Error finding container 91c1163077e1bbc473e206a28e1b32d32d47d558eaefd899b85bd9c1423ac743: Status 404 returned error can't find the container with id 91c1163077e1bbc473e206a28e1b32d32d47d558eaefd899b85bd9c1423ac743
Jul 30 22:49:02.846934 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.846858    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-d8n59"]
Jul 30 22:49:02.851060 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:49:02.850945    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07fa440e_a582_4b5e_b055_87da66d02efc.slice/crio-9a511c133ec05ea6414798fd3903c2ce1686e7c73c4edf84d831a9297cfffbec WatchSource:0}: Error finding container 9a511c133ec05ea6414798fd3903c2ce1686e7c73c4edf84d831a9297cfffbec: Status 404 returned error can't find the container with id 9a511c133ec05ea6414798fd3903c2ce1686e7c73c4edf84d831a9297cfffbec
Jul 30 22:49:02.878757 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.878728    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hmftj"]
Jul 30 22:49:02.892340 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:49:02.890551    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f23b63e_77ff_4825_92a3_e041a40e5d9b.slice/crio-b15e579a268bf3828d6552f0b36784d33ad0c174e4684e2347f5b663e8850164 WatchSource:0}: Error finding container b15e579a268bf3828d6552f0b36784d33ad0c174e4684e2347f5b663e8850164: Status 404 returned error can't find the container with id b15e579a268bf3828d6552f0b36784d33ad0c174e4684e2347f5b663e8850164
Jul 30 22:49:02.899507 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.899314    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:49:02.904302 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.904260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:02.907874 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.906380    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.909825 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.909794    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 30 22:49:02.909993 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.909968    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 30 22:49:02.910896 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.910228    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 30 22:49:02.910896 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.910254    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 30 22:49:02.910896 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.910266    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 30 22:49:02.910896 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.910440    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 30 22:49:02.910896 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.910478    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 30 22:49:02.911318 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.910992    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-b1eg95n7v881k\""
Jul 30 22:49:02.911318 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.911109    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 30 22:49:02.912330 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.911897    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7dc4m\""
Jul 30 22:49:02.912330 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.912061    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 30 22:49:02.912330 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.912097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 30 22:49:02.912330 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.912142    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 30 22:49:02.912585 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.912389    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 30 22:49:02.912647 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.912615    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 30 22:49:02.929993 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.929945    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 30 22:49:02.932290 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.932077    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:49:02.982840 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.982803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ff33266-c552-463d-9e4d-b1daa1397aa8-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.983089 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.983058    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.983270 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.983249    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.983429 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.983412    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ff33266-c552-463d-9e4d-b1daa1397aa8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.983570 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.983554    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.983692 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.983678    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.983834 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.983818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.983955 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.983941    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.984087 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.984070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.984230 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.984215    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.984350 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.984335    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.984490 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.984474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.984627 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.984603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.984761 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.984738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.984886 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.984872    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.985012 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.984998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.985157 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.985143    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsw2b\" (UniqueName: \"kubernetes.io/projected/6ff33266-c552-463d-9e4d-b1daa1397aa8-kube-api-access-qsw2b\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.985354 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.985338    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.985564 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.985547    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:02.985711 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:02.985697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-config\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.078645 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.078613    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cmxp4"
Jul 30 22:49:03.087287 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ff33266-c552-463d-9e4d-b1daa1397aa8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087287 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087287 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087273    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087337    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087416    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087447    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087468    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087492    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087553 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087564    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsw2b\" (UniqueName: \"kubernetes.io/projected/6ff33266-c552-463d-9e4d-b1daa1397aa8-kube-api-access-qsw2b\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087628    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087657    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-config\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087737    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ff33266-c552-463d-9e4d-b1daa1397aa8-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087760    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.087962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.087784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.088358 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.088110    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.088358 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.088143    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.088459 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.088409    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.088946 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.088916    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.089051 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.088945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.089576 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.089550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.090549 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.090441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6ff33266-c552-463d-9e4d-b1daa1397aa8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.090549 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.090450    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-web-config\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.091441 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.091089    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.091441 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.091128    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.091812 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.091747    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.092501 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.092474    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/6ff33266-c552-463d-9e4d-b1daa1397aa8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.092597 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.092475    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.092597 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.092564    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.093066 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.093042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-config\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.094523 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.094463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.096673 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.096348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.096673 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.096603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6ff33266-c552-463d-9e4d-b1daa1397aa8-config-out\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.098595 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.098393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6ff33266-c552-463d-9e4d-b1daa1397aa8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.101148 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.101115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsw2b\" (UniqueName: \"kubernetes.io/projected/6ff33266-c552-463d-9e4d-b1daa1397aa8-kube-api-access-qsw2b\") pod \"prometheus-k8s-0\" (UID: \"6ff33266-c552-463d-9e4d-b1daa1397aa8\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.133747 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.133704    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8n59" event={"ID":"07fa440e-a582-4b5e-b055-87da66d02efc","Type":"ContainerStarted","Data":"9a511c133ec05ea6414798fd3903c2ce1686e7c73c4edf84d831a9297cfffbec"}
Jul 30 22:49:03.135191 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.135102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgxlv" event={"ID":"b790639c-32af-4aab-abf8-7a439dc26f30","Type":"ContainerStarted","Data":"91c1163077e1bbc473e206a28e1b32d32d47d558eaefd899b85bd9c1423ac743"}
Jul 30 22:49:03.139644 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.139617    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a","Type":"ContainerStarted","Data":"5c12f9e9244cd899930d11c7d96b0843052e495255458a1cf75d9f5dad8883e5"}
Jul 30 22:49:03.143659 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.143621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28" event={"ID":"1fee519c-f0cb-48ae-92cf-df70ccaecc26","Type":"ContainerStarted","Data":"c51094db1a3516007cd74266cd75087fd4114b8505279a23e6f276563a3a07e6"}
Jul 30 22:49:03.147040 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.147013    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg" event={"ID":"d7294f53-2807-43b3-a24d-99894d2c0688","Type":"ContainerStarted","Data":"e113926b882f94a6cfd909ce2e1e3175714c2fcae70f28cc29007181d1a5b80c"}
Jul 30 22:49:03.147214 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.147090    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg" event={"ID":"d7294f53-2807-43b3-a24d-99894d2c0688","Type":"ContainerStarted","Data":"7cbe065dfba9353415350807819fa9df86c1ea0a44fe6da662c5effb49aed33c"}
Jul 30 22:49:03.148194 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.148159    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmftj" event={"ID":"8f23b63e-77ff-4825-92a3-e041a40e5d9b","Type":"ContainerStarted","Data":"b15e579a268bf3828d6552f0b36784d33ad0c174e4684e2347f5b663e8850164"}
Jul 30 22:49:03.169354 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.169294    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.901452718 podStartE2EDuration="6.169268212s" totalImagesPullingTime="3.251574703s" totalInitContainerRuntime="16.240791ms" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:03.166874587 +0000 UTC m=+66.898019773" watchObservedRunningTime="2026-07-30 22:49:03.169268212 +0000 UTC m=+66.900413372"
Jul 30 22:49:03.235898 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.235860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:03.539088 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:03.539053    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 30 22:49:03.544054 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:49:03.544004    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ff33266_c552_463d_9e4d_b1daa1397aa8.slice/crio-c236003f5b26df7b5fed315c56574907cb2deea78120b3b0cad4d7a9a634d8ae WatchSource:0}: Error finding container c236003f5b26df7b5fed315c56574907cb2deea78120b3b0cad4d7a9a634d8ae: Status 404 returned error can't find the container with id c236003f5b26df7b5fed315c56574907cb2deea78120b3b0cad4d7a9a634d8ae
Jul 30 22:49:04.158866 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.158831    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg" event={"ID":"d7294f53-2807-43b3-a24d-99894d2c0688","Type":"ContainerStarted","Data":"5f23907ecb6e04bf7a23faef77afe5a654f3f2a37dc7b8612b6dfc8c788dd552"}
Jul 30 22:49:04.159432 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.159410    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:49:04.163059 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.162407    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb" event={"ID":"7a06c6d5-5583-4ecc-b05c-f7337e6cbe34","Type":"ContainerStarted","Data":"b7d1c773dacaeccf104bb965a987f666cee08fcbc7d6357ba9d38224b2a389ef"}
Jul 30 22:49:04.166139 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.166106    2561 generic.go:356] "Generic (PLEG): container finished" podID="6ff33266-c552-463d-9e4d-b1daa1397aa8" containerID="97cfdcc8b19a560d3ff3a3eadcb35452bf168bb6a32c234605c2f722ce757e7a" exitCode=0
Jul 30 22:49:04.167466 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.167271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff33266-c552-463d-9e4d-b1daa1397aa8","Type":"ContainerDied","Data":"97cfdcc8b19a560d3ff3a3eadcb35452bf168bb6a32c234605c2f722ce757e7a"}
Jul 30 22:49:04.167466 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.167342    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff33266-c552-463d-9e4d-b1daa1397aa8","Type":"ContainerStarted","Data":"c236003f5b26df7b5fed315c56574907cb2deea78120b3b0cad4d7a9a634d8ae"}
Jul 30 22:49:04.186996 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.186130    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg" podStartSLOduration=3.127832624 podStartE2EDuration="6.186108559s" totalImagesPullingTime="3.058275935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:48:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:04.18394185 +0000 UTC m=+67.915087048" watchObservedRunningTime="2026-07-30 22:49:04.186108559 +0000 UTC m=+67.917253720"
Jul 30 22:49:04.205566 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.205452    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb" podStartSLOduration=2.536466474 podStartE2EDuration="4.205426486s" totalImagesPullingTime="1.668960012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:49:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:04.204362191 +0000 UTC m=+67.935507378" watchObservedRunningTime="2026-07-30 22:49:04.205426486 +0000 UTC m=+67.936571648"
Jul 30 22:49:04.269384 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.269312    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:04.374713 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.374672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:04.471685 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.471593    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:04.761905 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.761781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:04.825137 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:04.825103    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:05.270746 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:05.270529    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:05.371966 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:05.371891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:05.735518 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:05.735422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:05.839805 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:05.839758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:06.182595 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.182556    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgxlv" event={"ID":"b790639c-32af-4aab-abf8-7a439dc26f30","Type":"ContainerStarted","Data":"7c9c0f1aadf6410a5c8c5fda9d635fb8a24fd38f0075ca65f634917fd4274770"}
Jul 30 22:49:06.182791 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.182657    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bgxlv" event={"ID":"b790639c-32af-4aab-abf8-7a439dc26f30","Type":"ContainerStarted","Data":"f3ce3bab50d1a05d6686d5ec820b798decca87e1926d3e3c7e07f63d61f2cefc"}
Jul 30 22:49:06.185846 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.185799    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28" event={"ID":"1fee519c-f0cb-48ae-92cf-df70ccaecc26","Type":"ContainerStarted","Data":"d88b94a5cf30975200d7f49825e23a3ccfd56c4e7b6c9dacf3d584f161b8440c"}
Jul 30 22:49:06.185994 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.185973    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:06.192504 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.192472    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28"
Jul 30 22:49:06.203995 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.203936    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bgxlv" podStartSLOduration=66.972912378 podStartE2EDuration="1m9.203912667s" totalImagesPullingTime="2.231000289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:06.201087071 +0000 UTC m=+69.932232261" watchObservedRunningTime="2026-07-30 22:49:06.203912667 +0000 UTC m=+69.935057829"
Jul 30 22:49:06.220265 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.220202    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-96w28" podStartSLOduration=2.759353875 podStartE2EDuration="5.220166483s" totalImagesPullingTime="2.460812608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:49:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:06.217540789 +0000 UTC m=+69.948685978" watchObservedRunningTime="2026-07-30 22:49:06.220166483 +0000 UTC m=+69.951311646"
Jul 30 22:49:06.313723 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.313684    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:06.378674 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:06.378632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:09.447932 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:09.447900    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:10.172660 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.172629    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:10.180941 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.180916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6858f6cf95-zcnxg"
Jul 30 22:49:10.213121 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.213085    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hmftj" event={"ID":"8f23b63e-77ff-4825-92a3-e041a40e5d9b","Type":"ContainerStarted","Data":"a196444ce2395e6dddce033153d54a5ed7888ac92450b775c13f8f6c9315119e"}
Jul 30 22:49:10.213334 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.213204    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:49:10.214940 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.214911    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-d8n59" event={"ID":"07fa440e-a582-4b5e-b055-87da66d02efc","Type":"ContainerStarted","Data":"ffebfb1d0c91dc8d73611926ba8d8c9c39d4bf63c2000d92d2ce5ddc9cc7fdd5"}
Jul 30 22:49:10.218662 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.218638    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff33266-c552-463d-9e4d-b1daa1397aa8","Type":"ContainerStarted","Data":"5c1d6918e2a355c7821c9da0577caa861d884f7df71ea83f5e90803fb0e32074"}
Jul 30 22:49:10.218783 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.218703    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff33266-c552-463d-9e4d-b1daa1397aa8","Type":"ContainerStarted","Data":"a16bdb403ff4755ce761350f38da3f78e261b13238b2dbc085947edd65c82bdf"}
Jul 30 22:49:10.218783 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.218745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff33266-c552-463d-9e4d-b1daa1397aa8","Type":"ContainerStarted","Data":"0d974ad9bdf049824cc925ed9013e4493c2a09c29277b9ed45de2f5351c6ad31"}
Jul 30 22:49:10.218893 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.218783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff33266-c552-463d-9e4d-b1daa1397aa8","Type":"ContainerStarted","Data":"9ec9099b200b667bd8828f9c7976443c1684305b2eabbeef6ebc590a352dc4cd"}
Jul 30 22:49:10.218893 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.218825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff33266-c552-463d-9e4d-b1daa1397aa8","Type":"ContainerStarted","Data":"e877935424a5abce47d3cabd4cce17cdfa5928a624be39664f941dd646c30e3a"}
Jul 30 22:49:10.218893 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.218857    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"6ff33266-c552-463d-9e4d-b1daa1397aa8","Type":"ContainerStarted","Data":"433ba2a3060fc2fd798ba19cb68d9c44a7baded659ac518eb2fd348794ae70b3"}
Jul 30 22:49:10.234276 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.234228    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hmftj" podStartSLOduration=66.694919056 podStartE2EDuration="1m13.234210091s" totalImagesPullingTime="6.539291035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:10.232429403 +0000 UTC m=+73.963574589" watchObservedRunningTime="2026-07-30 22:49:10.234210091 +0000 UTC m=+73.965355275"
Jul 30 22:49:10.241264 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.241238    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:10.248155 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.248109    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-d8n59" podStartSLOduration=66.660472044 podStartE2EDuration="1m13.248093542s" totalImagesPullingTime="6.587621498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 22:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:10.246928745 +0000 UTC m=+73.978073925" watchObservedRunningTime="2026-07-30 22:49:10.248093542 +0000 UTC m=+73.979238703"
Jul 30 22:49:10.279337 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:10.279280    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.9754753320000003 podStartE2EDuration="8.279262631s" totalImagesPullingTime="5.272448497s" totalInitContainerRuntime="31.338802ms" isStatefulPod=false podCreationTimestamp="2026-07-30 22:49:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:49:10.277805101 +0000 UTC m=+74.008950266" watchObservedRunningTime="2026-07-30 22:49:10.279262631 +0000 UTC m=+74.010407792"
Jul 30 22:49:12.133071 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:12.133038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:12.234729 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:12.234687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:12.580415 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:12.580382    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:12.677284 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:12.677254    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:12.902235 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:12.902086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:13.002337 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:13.002290    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:13.069099 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:13.069021    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:13.236218 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:13.236106    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:49:13.808833 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:13.808802    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:13.905564 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:13.905534    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:19.264549 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:19.264411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:19.365609 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:19.365571    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:21.266682 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:21.266651    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:21.267134 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:21.266748    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:27.567206 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:27.567147    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:27.667604 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:27.667572    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:37.190944 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:37.190903    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:37.257303 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:37.257267    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:41.225833 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:41.225802    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hmftj"
Jul 30 22:49:41.271781 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:41.271754    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:41.275749 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:41.275721    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76bf775fd8-gsjjb"
Jul 30 22:49:42.563420 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:42.563384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:49:42.626665 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:49:42.626629    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:03.236615 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:03.236573    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:50:03.255812 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:03.255781    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:50:03.440299 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:03.440271    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 30 22:50:09.019310 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:09.019278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:09.078490 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:09.078453    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:12.119547 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:12.119495    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:15.841437 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:15.841396    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:15.952862 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:15.952826    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:25.181350 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:25.181317    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:25.245579 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:25.245547    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:31.108469 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:31.108437    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:31.179216 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:31.179161    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:43.110163 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:43.110128    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:43.173034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:43.173003    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:47.245728 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:47.245690    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:47.346950 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:47.346913    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:57.586303 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:57.586254    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:50:57.683170 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:50:57.683132    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:51:47.235390 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:51:47.235340    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:51:47.362909 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:51:47.362879    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:51:58.584731 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:51:58.584664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:01.540037 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:01.539992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:01.595265 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:01.595230    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:08.883812 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:08.883764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:10.000821 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:10.000772    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:12.506091 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:12.506053    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:12.559044 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:12.559016    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:14.346984 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:14.346948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:14.427822 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:14.427778    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:14.735447 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:14.735353    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:14.874468 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:14.874434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:16.566028 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:16.565992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:16.842742 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:16.842641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:19.499925 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:19.499821    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:19.603463 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:19.603427    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:24.555041 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:24.555001    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:26.103941 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:26.103896    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:26.202335 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:26.202286    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:27.203276 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.203244    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lgpt2"]
Jul 30 22:52:27.206396 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.206375    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lgpt2"
Jul 30 22:52:27.209356 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.209084    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-k6dtv\""
Jul 30 22:52:27.209356 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.209281    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 22:52:27.214071 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.209633    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 22:52:27.216917 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.216879    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lgpt2"]
Jul 30 22:52:27.365365 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.365315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbxdm\" (UniqueName: \"kubernetes.io/projected/3d19751f-ba87-4426-b542-fb600fe1e0bd-kube-api-access-hbxdm\") pod \"cert-manager-55b4d954d5-lgpt2\" (UID: \"3d19751f-ba87-4426-b542-fb600fe1e0bd\") " pod="cert-manager/cert-manager-55b4d954d5-lgpt2"
Jul 30 22:52:27.365549 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.365404    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d19751f-ba87-4426-b542-fb600fe1e0bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-lgpt2\" (UID: \"3d19751f-ba87-4426-b542-fb600fe1e0bd\") " pod="cert-manager/cert-manager-55b4d954d5-lgpt2"
Jul 30 22:52:27.466738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.466655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d19751f-ba87-4426-b542-fb600fe1e0bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-lgpt2\" (UID: \"3d19751f-ba87-4426-b542-fb600fe1e0bd\") " pod="cert-manager/cert-manager-55b4d954d5-lgpt2"
Jul 30 22:52:27.466738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.466722    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbxdm\" (UniqueName: \"kubernetes.io/projected/3d19751f-ba87-4426-b542-fb600fe1e0bd-kube-api-access-hbxdm\") pod \"cert-manager-55b4d954d5-lgpt2\" (UID: \"3d19751f-ba87-4426-b542-fb600fe1e0bd\") " pod="cert-manager/cert-manager-55b4d954d5-lgpt2"
Jul 30 22:52:27.474598 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.474559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3d19751f-ba87-4426-b542-fb600fe1e0bd-bound-sa-token\") pod \"cert-manager-55b4d954d5-lgpt2\" (UID: \"3d19751f-ba87-4426-b542-fb600fe1e0bd\") " pod="cert-manager/cert-manager-55b4d954d5-lgpt2"
Jul 30 22:52:27.474734 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.474631    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbxdm\" (UniqueName: \"kubernetes.io/projected/3d19751f-ba87-4426-b542-fb600fe1e0bd-kube-api-access-hbxdm\") pod \"cert-manager-55b4d954d5-lgpt2\" (UID: \"3d19751f-ba87-4426-b542-fb600fe1e0bd\") " pod="cert-manager/cert-manager-55b4d954d5-lgpt2"
Jul 30 22:52:27.533401 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.533371    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lgpt2"
Jul 30 22:52:27.665706 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.665587    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lgpt2"]
Jul 30 22:52:27.668424 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:52:27.668385    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3d19751f_ba87_4426_b542_fb600fe1e0bd.slice/crio-93a5dc5e57d66949fa8fa1d0b45442a117f73deeed34292afac8ddf321ad0e01 WatchSource:0}: Error finding container 93a5dc5e57d66949fa8fa1d0b45442a117f73deeed34292afac8ddf321ad0e01: Status 404 returned error can't find the container with id 93a5dc5e57d66949fa8fa1d0b45442a117f73deeed34292afac8ddf321ad0e01
Jul 30 22:52:27.972222 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:27.972164    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lgpt2" event={"ID":"3d19751f-ba87-4426-b542-fb600fe1e0bd","Type":"ContainerStarted","Data":"93a5dc5e57d66949fa8fa1d0b45442a117f73deeed34292afac8ddf321ad0e01"}
Jul 30 22:52:30.986304 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:30.986216    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lgpt2" event={"ID":"3d19751f-ba87-4426-b542-fb600fe1e0bd","Type":"ContainerStarted","Data":"5adb556e25f1110debdcdb82a96929062214678a2ee826a58420c705acc14cd2"}
Jul 30 22:52:31.005646 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:31.005593    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lgpt2" podStartSLOduration=0.960239962 podStartE2EDuration="4.005575171s" totalImagesPullingTime="3.045335209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:52:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:52:31.004629165 +0000 UTC m=+274.735774339" watchObservedRunningTime="2026-07-30 22:52:31.005575171 +0000 UTC m=+274.736720332"
Jul 30 22:52:31.239502 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:31.239423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:31.336898 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:31.336863    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:33.541101 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:33.541061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:38.065534 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:38.065504    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:38.166069 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:38.166022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:47.710348 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:47.710311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:47.808596 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:47.808563    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:48.318053 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.318017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:48.522720 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.522689    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:48.627820 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.627712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:48.667268 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.667235    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"]
Jul 30 22:52:48.670679 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.670658    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.677018 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.676822    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 22:52:48.677018 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.676825    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 22:52:48.677251 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.677235    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rmz5j\""
Jul 30 22:52:48.678311 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.678291    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 22:52:48.678405 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.678379    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 22:52:48.716117 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.716087    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"]
Jul 30 22:52:48.742158 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.742120    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-446pk\" (UniqueName: \"kubernetes.io/projected/4e52edcd-56c6-4ed8-98ea-012069b23a55-kube-api-access-446pk\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.742339 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.742210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e52edcd-56c6-4ed8-98ea-012069b23a55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.742339 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.742242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e52edcd-56c6-4ed8-98ea-012069b23a55-tmp\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.742339 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.742271    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e52edcd-56c6-4ed8-98ea-012069b23a55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.742339 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.742327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4e52edcd-56c6-4ed8-98ea-012069b23a55-manifests\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.824452 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.824415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:48.843668 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.843629    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446pk\" (UniqueName: \"kubernetes.io/projected/4e52edcd-56c6-4ed8-98ea-012069b23a55-kube-api-access-446pk\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.843825 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.843690    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e52edcd-56c6-4ed8-98ea-012069b23a55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.843825 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.843713    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e52edcd-56c6-4ed8-98ea-012069b23a55-tmp\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.843825 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.843743    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e52edcd-56c6-4ed8-98ea-012069b23a55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.843825 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.843771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4e52edcd-56c6-4ed8-98ea-012069b23a55-manifests\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.844094 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.844078    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4e52edcd-56c6-4ed8-98ea-012069b23a55-manifests\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.846029 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.846007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e52edcd-56c6-4ed8-98ea-012069b23a55-tmp\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.846262 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.846243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4e52edcd-56c6-4ed8-98ea-012069b23a55-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.846389 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.846371    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4e52edcd-56c6-4ed8-98ea-012069b23a55-webhook-cert\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.853361 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.853335    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-446pk\" (UniqueName: \"kubernetes.io/projected/4e52edcd-56c6-4ed8-98ea-012069b23a55-kube-api-access-446pk\") pod \"opendatahub-operator-controller-manager-5c6bb66584-v7lfh\" (UID: \"4e52edcd-56c6-4ed8-98ea-012069b23a55\") " pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:48.924122 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.924037    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:48.980525 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:48.980494    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:49.024075 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:49.024046    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:49.096688 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:49.096655    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:49.118241 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:49.118211    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"]
Jul 30 22:52:49.121700 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:52:49.121676    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e52edcd_56c6_4ed8_98ea_012069b23a55.slice/crio-2c1d4b98fe35756aca174f28cb37360d599ffc4293c984ba939c94005dd679bb WatchSource:0}: Error finding container 2c1d4b98fe35756aca174f28cb37360d599ffc4293c984ba939c94005dd679bb: Status 404 returned error can't find the container with id 2c1d4b98fe35756aca174f28cb37360d599ffc4293c984ba939c94005dd679bb
Jul 30 22:52:49.156212 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:49.156162    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:49.256089 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:49.256055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:49.355982 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:49.355948    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:50.063580 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:50.063507    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh" event={"ID":"4e52edcd-56c6-4ed8-98ea-012069b23a55","Type":"ContainerStarted","Data":"2c1d4b98fe35756aca174f28cb37360d599ffc4293c984ba939c94005dd679bb"}
Jul 30 22:52:52.074406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:52.074371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh" event={"ID":"4e52edcd-56c6-4ed8-98ea-012069b23a55","Type":"ContainerStarted","Data":"6ae292dc752cc3fc738394d877a9f15997e97ddfb193b8cae3016c1de46a5a8e"}
Jul 30 22:52:54.083602 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:54.083570    2561 generic.go:356] "Generic (PLEG): container finished" podID="4e52edcd-56c6-4ed8-98ea-012069b23a55" containerID="6ae292dc752cc3fc738394d877a9f15997e97ddfb193b8cae3016c1de46a5a8e" exitCode=0
Jul 30 22:52:54.084077 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:54.083640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh" event={"ID":"4e52edcd-56c6-4ed8-98ea-012069b23a55","Type":"ContainerDied","Data":"6ae292dc752cc3fc738394d877a9f15997e97ddfb193b8cae3016c1de46a5a8e"}
Jul 30 22:52:55.089555 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:55.089527    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh" event={"ID":"4e52edcd-56c6-4ed8-98ea-012069b23a55","Type":"ContainerStarted","Data":"40966d73e5d4bcce45397c7c64aba8d2b59d862d8c6663437a514ed15bfa93fb"}
Jul 30 22:52:55.089964 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:55.089731    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:52:55.116090 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:55.116038    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh" podStartSLOduration=2.7641872039999997 podStartE2EDuration="7.116019564s" totalImagesPullingTime="3.290638897s" totalInitContainerRuntime="1.061193463s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:52:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:52:55.113559942 +0000 UTC m=+298.844705104" watchObservedRunningTime="2026-07-30 22:52:55.116019564 +0000 UTC m=+298.847164726"
Jul 30 22:52:55.757868 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:55.757834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:55.822285 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:55.822252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:52:56.586506 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:52:56.586481    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 22:53:06.095345 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.095316    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5c6bb66584-v7lfh"
Jul 30 22:53:06.283419 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.283387    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"]
Jul 30 22:53:06.298189 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.298143    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"]
Jul 30 22:53:06.298355 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.298276    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.301368 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.301341    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 30 22:53:06.301368 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.301356    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 30 22:53:06.301572 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.301432    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 30 22:53:06.301572 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.301449    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-clkv5\""
Jul 30 22:53:06.301688 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.301586    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 30 22:53:06.302109 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.302092    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 30 22:53:06.389696 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.389610    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-metrics-cert\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.389696 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.389651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-manager-config\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.389696 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.389676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-cert\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.389935 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.389737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc5tm\" (UniqueName: \"kubernetes.io/projected/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-kube-api-access-nc5tm\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.490738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.490702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-manager-config\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.490883 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.490749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-cert\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.490883 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.490791    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc5tm\" (UniqueName: \"kubernetes.io/projected/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-kube-api-access-nc5tm\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.490883 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.490871    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-metrics-cert\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.491494 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.491473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-manager-config\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.493353 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.493334    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-cert\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.493414 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.493390    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-metrics-cert\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.498565 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.498542    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc5tm\" (UniqueName: \"kubernetes.io/projected/b584aecc-b3aa-4cad-81f8-d6ba25e2c39f-kube-api-access-nc5tm\") pod \"lws-controller-manager-78d44f567c-fjkh5\" (UID: \"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f\") " pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.607741 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.607702    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:06.760203 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.760153    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"]
Jul 30 22:53:06.763225 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:53:06.763194    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb584aecc_b3aa_4cad_81f8_d6ba25e2c39f.slice/crio-8956b8e3faa50231877f9457fbd19674d16644bfebc22e351600c1c031f7e017 WatchSource:0}: Error finding container 8956b8e3faa50231877f9457fbd19674d16644bfebc22e351600c1c031f7e017: Status 404 returned error can't find the container with id 8956b8e3faa50231877f9457fbd19674d16644bfebc22e351600c1c031f7e017
Jul 30 22:53:06.765137 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:06.765120    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:53:07.141624 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:07.141587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5" event={"ID":"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f","Type":"ContainerStarted","Data":"8956b8e3faa50231877f9457fbd19674d16644bfebc22e351600c1c031f7e017"}
Jul 30 22:53:07.818767 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:07.818736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:07.970014 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:07.969978    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:08.317978 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.317933    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:08.503135 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.503100    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"]
Jul 30 22:53:08.509452 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.509426    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.514066 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.514040    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 22:53:08.518759 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.518738    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 22:53:08.520495 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.520474    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 22:53:08.520617 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.520512    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-bvs8z\""
Jul 30 22:53:08.520617 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.520479    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 22:53:08.540601 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.540568    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"]
Jul 30 22:53:08.607118 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.607030    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:08.611072 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.611044    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsn6m\" (UniqueName: \"kubernetes.io/projected/dfcd6851-5386-4aeb-a589-be3d16864256-kube-api-access-jsn6m\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.611214 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.611094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfcd6851-5386-4aeb-a589-be3d16864256-tls-certs\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.611214 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.611139    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfcd6851-5386-4aeb-a589-be3d16864256-tmp\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.712103 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.712069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsn6m\" (UniqueName: \"kubernetes.io/projected/dfcd6851-5386-4aeb-a589-be3d16864256-kube-api-access-jsn6m\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.712292 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.712115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfcd6851-5386-4aeb-a589-be3d16864256-tls-certs\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.712292 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.712148    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfcd6851-5386-4aeb-a589-be3d16864256-tmp\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.714604 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.714577    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dfcd6851-5386-4aeb-a589-be3d16864256-tmp\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.714843 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.714820    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dfcd6851-5386-4aeb-a589-be3d16864256-tls-certs\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.722657 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.722632    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsn6m\" (UniqueName: \"kubernetes.io/projected/dfcd6851-5386-4aeb-a589-be3d16864256-kube-api-access-jsn6m\") pod \"kube-auth-proxy-556f7c5984-n8lxc\" (UID: \"dfcd6851-5386-4aeb-a589-be3d16864256\") " pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.792312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.792282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:08.821961 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.821915    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"
Jul 30 22:53:08.895071 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.894993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:08.992439 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:08.992404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:09.102236 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:09.102200    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:09.217891 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:09.217812    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:09.523232 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:09.522350    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc"]
Jul 30 22:53:09.528126 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:53:09.528094    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfcd6851_5386_4aeb_a589_be3d16864256.slice/crio-04a40b0556edbde66939fa59c313baff4e634e74678d2088ef2940f1339ebc1c WatchSource:0}: Error finding container 04a40b0556edbde66939fa59c313baff4e634e74678d2088ef2940f1339ebc1c: Status 404 returned error can't find the container with id 04a40b0556edbde66939fa59c313baff4e634e74678d2088ef2940f1339ebc1c
Jul 30 22:53:09.592566 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:09.592467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:09.680157 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:09.680114    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:09.819438 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:09.819392    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:10.157826 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:10.157726    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5" event={"ID":"b584aecc-b3aa-4cad-81f8-d6ba25e2c39f","Type":"ContainerStarted","Data":"ef03919f7cdb0d49ac3d800092eff343d167f2eaec45d9efb0305357ca095c17"}
Jul 30 22:53:10.157826 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:10.157793    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:10.158857 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:10.158829    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc" event={"ID":"dfcd6851-5386-4aeb-a589-be3d16864256","Type":"ContainerStarted","Data":"04a40b0556edbde66939fa59c313baff4e634e74678d2088ef2940f1339ebc1c"}
Jul 30 22:53:10.173674 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:10.173621    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5" podStartSLOduration=1.481116078 podStartE2EDuration="4.173601672s" totalImagesPullingTime="2.692485594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:53:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:53:10.172056279 +0000 UTC m=+313.903201443" watchObservedRunningTime="2026-07-30 22:53:10.173601672 +0000 UTC m=+313.904746835"
Jul 30 22:53:10.501573 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:10.501538    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:10.743319 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:10.743283    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:12.169737 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:12.169703    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc" event={"ID":"dfcd6851-5386-4aeb-a589-be3d16864256","Type":"ContainerStarted","Data":"4520c8481b1035bdc6c18dc4fdc867a04d69ee15659afcc0c0f6bab3fb04396f"}
Jul 30 22:53:12.185200 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:12.185051    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-556f7c5984-n8lxc" podStartSLOduration=2.205213829 podStartE2EDuration="4.185033873s" totalImagesPullingTime="1.979820044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:53:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:53:12.184496812 +0000 UTC m=+315.915641992" watchObservedRunningTime="2026-07-30 22:53:12.185033873 +0000 UTC m=+315.916179033"
Jul 30 22:53:14.959666 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:14.959630    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:15.059812 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:15.059779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:15.277244 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:15.277206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:15.574556 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:15.574474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:15.675060 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:15.675024    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:19.652248 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:19.652209    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:19.744918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:19.744878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:19.938926 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:19.938845    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:20.082260 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:20.082222    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:20.928905 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:20.928871    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:21.052387 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:21.052356    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:21.154136 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:21.154105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:21.165848 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:21.165820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78d44f567c-fjkh5"
Jul 30 22:53:44.871602 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:44.871562    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:44.972369 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:44.972332    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:45.073050 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:45.073015    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:45.617751 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:45.617713    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:45.668096 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:45.668063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:56.086111 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:56.086076    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:53:56.187247 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:53:56.187215    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:09.618617 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:09.618583    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:09.718043 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:09.718011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:21.307374 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:21.307339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:24.093918 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:24.093881    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:25.694350 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:25.694313    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:25.971202 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:25.971100    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:26.093816 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:26.093787    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:27.324612 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:27.324578    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:28.685916 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:28.685885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:29.123945 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:29.123909    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:29.340495 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:29.340468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:29.444246 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:29.444158    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:29.541348 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:29.541315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:30.947893 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:30.947857    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:31.045630 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:31.045598    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:32.600719 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.600685    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"]
Jul 30 22:54:32.603962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.603946    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:32.606550 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.606523    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 22:54:32.606550 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.606546    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tx2tw\""
Jul 30 22:54:32.606733 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.606569    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 22:54:32.620386 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.620361    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"]
Jul 30 22:54:32.631871 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.631847    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1500776a-b5bd-4981-9242-8d111e205b60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" (UID: \"1500776a-b5bd-4981-9242-8d111e205b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:32.631999 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.631888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghcpb\" (UniqueName: \"kubernetes.io/projected/1500776a-b5bd-4981-9242-8d111e205b60-kube-api-access-ghcpb\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" (UID: \"1500776a-b5bd-4981-9242-8d111e205b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:32.732965 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.732919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1500776a-b5bd-4981-9242-8d111e205b60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" (UID: \"1500776a-b5bd-4981-9242-8d111e205b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:32.733166 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.732984    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghcpb\" (UniqueName: \"kubernetes.io/projected/1500776a-b5bd-4981-9242-8d111e205b60-kube-api-access-ghcpb\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" (UID: \"1500776a-b5bd-4981-9242-8d111e205b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:32.733477 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.733457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1500776a-b5bd-4981-9242-8d111e205b60-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" (UID: \"1500776a-b5bd-4981-9242-8d111e205b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:32.741239 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.741209    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghcpb\" (UniqueName: \"kubernetes.io/projected/1500776a-b5bd-4981-9242-8d111e205b60-kube-api-access-ghcpb\") pod \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" (UID: \"1500776a-b5bd-4981-9242-8d111e205b60\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:32.914535 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:32.914449    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:33.052148 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:33.052124    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"]
Jul 30 22:54:33.054239 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:54:33.054214    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1500776a_b5bd_4981_9242_8d111e205b60.slice/crio-3bac4d8f5b4407a4c653128c6cccefc194c706b8c163ff7960030723254e95e6 WatchSource:0}: Error finding container 3bac4d8f5b4407a4c653128c6cccefc194c706b8c163ff7960030723254e95e6: Status 404 returned error can't find the container with id 3bac4d8f5b4407a4c653128c6cccefc194c706b8c163ff7960030723254e95e6
Jul 30 22:54:33.511692 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:33.511655    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c" event={"ID":"1500776a-b5bd-4981-9242-8d111e205b60","Type":"ContainerStarted","Data":"3bac4d8f5b4407a4c653128c6cccefc194c706b8c163ff7960030723254e95e6"}
Jul 30 22:54:33.777157 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:33.777072    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:33.882107 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:33.882063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:37.094658 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:37.094622    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:37.195020 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:37.194988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:38.538913 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:38.538880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c" event={"ID":"1500776a-b5bd-4981-9242-8d111e205b60","Type":"ContainerStarted","Data":"4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049"}
Jul 30 22:54:38.539347 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:38.538961    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:38.561196 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:38.561135    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c" podStartSLOduration=1.728551048 podStartE2EDuration="6.561118134s" totalImagesPullingTime="4.832567086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:54:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:54:38.558679812 +0000 UTC m=+402.289824973" watchObservedRunningTime="2026-07-30 22:54:38.561118134 +0000 UTC m=+402.292263294"
Jul 30 22:54:40.673414 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:40.673377    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:41.004386 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:41.004355    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:41.503312 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:41.503284    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:41.602454 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:41.602399    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:46.244334 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:46.244299    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:46.344265 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:46.344226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:46.402772 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:46.402720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:48.931565 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:48.931527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:49.031399 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:49.031371    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:49.545395 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:49.545363    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:50.696794 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:50.696712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:50.795097 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:50.795067    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:51.333079 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.333043    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"]
Jul 30 22:54:51.333305 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.333247    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c" podUID="1500776a-b5bd-4981-9242-8d111e205b60" containerName="manager" containerID="cri-o://4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049" gracePeriod=2
Jul 30 22:54:51.342431 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.342408    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"]
Jul 30 22:54:51.355969 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.355945    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"]
Jul 30 22:54:51.356309 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.356296    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1500776a-b5bd-4981-9242-8d111e205b60" containerName="manager"
Jul 30 22:54:51.356309 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.356310    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1500776a-b5bd-4981-9242-8d111e205b60" containerName="manager"
Jul 30 22:54:51.356429 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.356380    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1500776a-b5bd-4981-9242-8d111e205b60" containerName="manager"
Jul 30 22:54:51.359287 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.359263    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:51.375952 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.375924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"]
Jul 30 22:54:51.383086 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.383052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26a4d093-bfe4-4423-91c9-186fe9ae8a51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-cdddd\" (UID: \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:51.383252 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.383194    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdfhl\" (UniqueName: \"kubernetes.io/projected/26a4d093-bfe4-4423-91c9-186fe9ae8a51-kube-api-access-kdfhl\") pod \"kuadrant-operator-controller-manager-58fc56757c-cdddd\" (UID: \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:51.400240 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:54:51.400169    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="1500776a-b5bd-4981-9242-8d111e205b60" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:51.484502 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.484462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26a4d093-bfe4-4423-91c9-186fe9ae8a51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-cdddd\" (UID: \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:51.484670 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.484536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdfhl\" (UniqueName: \"kubernetes.io/projected/26a4d093-bfe4-4423-91c9-186fe9ae8a51-kube-api-access-kdfhl\") pod \"kuadrant-operator-controller-manager-58fc56757c-cdddd\" (UID: \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:51.484857 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.484833    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26a4d093-bfe4-4423-91c9-186fe9ae8a51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-cdddd\" (UID: \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:51.495337 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.495311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdfhl\" (UniqueName: \"kubernetes.io/projected/26a4d093-bfe4-4423-91c9-186fe9ae8a51-kube-api-access-kdfhl\") pod \"kuadrant-operator-controller-manager-58fc56757c-cdddd\" (UID: \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:51.572457 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.572432    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:51.574697 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:54:51.574668    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="1500776a-b5bd-4981-9242-8d111e205b60" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:51.596749 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.596671    2561 generic.go:356] "Generic (PLEG): container finished" podID="1500776a-b5bd-4981-9242-8d111e205b60" containerID="4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049" exitCode=0
Jul 30 22:54:51.596749 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.596719    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:51.596919 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.596769    2561 scope.go:117] "RemoveContainer" containerID="4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049"
Jul 30 22:54:51.599157 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:54:51.599124    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="1500776a-b5bd-4981-9242-8d111e205b60" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:51.604998 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.604981    2561 scope.go:117] "RemoveContainer" containerID="4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049"
Jul 30 22:54:51.605293 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:54:51.605272    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049\": container with ID starting with 4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049 not found: ID does not exist" containerID="4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049"
Jul 30 22:54:51.605368 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.605302    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049"} err="failed to get container status \"4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049\": rpc error: code = NotFound desc = could not find container \"4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049\": container with ID starting with 4f551113a179cf9805d08479a45133b42aba94e5d9381d80e0955d6afbd9a049 not found: ID does not exist"
Jul 30 22:54:51.686230 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.686169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghcpb\" (UniqueName: \"kubernetes.io/projected/1500776a-b5bd-4981-9242-8d111e205b60-kube-api-access-ghcpb\") pod \"1500776a-b5bd-4981-9242-8d111e205b60\" (UID: \"1500776a-b5bd-4981-9242-8d111e205b60\") "
Jul 30 22:54:51.686386 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.686238    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1500776a-b5bd-4981-9242-8d111e205b60-extensions-socket-volume\") pod \"1500776a-b5bd-4981-9242-8d111e205b60\" (UID: \"1500776a-b5bd-4981-9242-8d111e205b60\") "
Jul 30 22:54:51.686725 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.686702    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1500776a-b5bd-4981-9242-8d111e205b60-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1500776a-b5bd-4981-9242-8d111e205b60" (UID: "1500776a-b5bd-4981-9242-8d111e205b60"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:54:51.688450 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.688428    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1500776a-b5bd-4981-9242-8d111e205b60-kube-api-access-ghcpb" (OuterVolumeSpecName: "kube-api-access-ghcpb") pod "1500776a-b5bd-4981-9242-8d111e205b60" (UID: "1500776a-b5bd-4981-9242-8d111e205b60"). InnerVolumeSpecName "kube-api-access-ghcpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:54:51.713330 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.713299    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:51.787628 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.787596    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghcpb\" (UniqueName: \"kubernetes.io/projected/1500776a-b5bd-4981-9242-8d111e205b60-kube-api-access-ghcpb\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:54:51.787628 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.787624    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1500776a-b5bd-4981-9242-8d111e205b60-extensions-socket-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:54:51.862335 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:51.862308    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"]
Jul 30 22:54:51.864465 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:54:51.864436    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26a4d093_bfe4_4423_91c9_186fe9ae8a51.slice/crio-4a8e80fe2857ef76c072bf34190289f7a67ba1c05ecc212cc20c31668080d2d1 WatchSource:0}: Error finding container 4a8e80fe2857ef76c072bf34190289f7a67ba1c05ecc212cc20c31668080d2d1: Status 404 returned error can't find the container with id 4a8e80fe2857ef76c072bf34190289f7a67ba1c05ecc212cc20c31668080d2d1
Jul 30 22:54:51.906752 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:54:51.906725    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="1500776a-b5bd-4981-9242-8d111e205b60" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:52.602872 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:52.602835    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd" event={"ID":"26a4d093-bfe4-4423-91c9-186fe9ae8a51","Type":"ContainerStarted","Data":"bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f"}
Jul 30 22:54:52.603070 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:52.602905    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd" event={"ID":"26a4d093-bfe4-4423-91c9-186fe9ae8a51","Type":"ContainerStarted","Data":"4a8e80fe2857ef76c072bf34190289f7a67ba1c05ecc212cc20c31668080d2d1"}
Jul 30 22:54:52.603070 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:52.602949    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:54:52.629191 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:54:52.629136    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-dwk6c\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="1500776a-b5bd-4981-9242-8d111e205b60" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-dwk6c"
Jul 30 22:54:52.629365 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:52.629191    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd" podStartSLOduration=1.629163196 podStartE2EDuration="1.629163196s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:54:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:54:52.627024682 +0000 UTC m=+416.358169859" watchObservedRunningTime="2026-07-30 22:54:52.629163196 +0000 UTC m=+416.360308356"
Jul 30 22:54:52.696871 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:52.696827    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1500776a-b5bd-4981-9242-8d111e205b60" path="/var/lib/kubelet/pods/1500776a-b5bd-4981-9242-8d111e205b60/volumes"
Jul 30 22:54:52.907604 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:52.907527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:53.008146 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:53.008115    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:56.084592 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:56.084541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:54:56.187226 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:54:56.187170    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:00.519977 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:00.519942    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:00.571557 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:00.571524    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:00.682491 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:00.682447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:00.783542 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:00.783455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:03.610682 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:03.610649    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:55:05.870643 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:05.870608    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:05.923524 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:05.923487    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:07.230271 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.230237    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"]
Jul 30 22:55:07.230694 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.230427    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd" podUID="26a4d093-bfe4-4423-91c9-186fe9ae8a51" containerName="manager" containerID="cri-o://bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f" gracePeriod=10
Jul 30 22:55:07.484518 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.484453    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:55:07.504378 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.504347    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"]
Jul 30 22:55:07.504663 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.504652    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a4d093-bfe4-4423-91c9-186fe9ae8a51" containerName="manager"
Jul 30 22:55:07.504709 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.504664    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a4d093-bfe4-4423-91c9-186fe9ae8a51" containerName="manager"
Jul 30 22:55:07.504742 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.504715    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="26a4d093-bfe4-4423-91c9-186fe9ae8a51" containerName="manager"
Jul 30 22:55:07.507501 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.507486    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:07.525252 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.525223    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"]
Jul 30 22:55:07.633233 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.633196    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26a4d093-bfe4-4423-91c9-186fe9ae8a51-extensions-socket-volume\") pod \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\" (UID: \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\") "
Jul 30 22:55:07.633410 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.633288    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdfhl\" (UniqueName: \"kubernetes.io/projected/26a4d093-bfe4-4423-91c9-186fe9ae8a51-kube-api-access-kdfhl\") pod \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\" (UID: \"26a4d093-bfe4-4423-91c9-186fe9ae8a51\") "
Jul 30 22:55:07.633460 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.633413    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04336e6-f995-4f27-8bf6-e08c8e02206e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ft278\" (UID: \"f04336e6-f995-4f27-8bf6-e08c8e02206e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:07.633546 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.633525    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf97j\" (UniqueName: \"kubernetes.io/projected/f04336e6-f995-4f27-8bf6-e08c8e02206e-kube-api-access-sf97j\") pod \"kuadrant-operator-controller-manager-68cf589589-ft278\" (UID: \"f04336e6-f995-4f27-8bf6-e08c8e02206e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:07.633592 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.633540    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26a4d093-bfe4-4423-91c9-186fe9ae8a51-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "26a4d093-bfe4-4423-91c9-186fe9ae8a51" (UID: "26a4d093-bfe4-4423-91c9-186fe9ae8a51"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 22:55:07.633637 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.633627    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/26a4d093-bfe4-4423-91c9-186fe9ae8a51-extensions-socket-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:55:07.635390 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.635372    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a4d093-bfe4-4423-91c9-186fe9ae8a51-kube-api-access-kdfhl" (OuterVolumeSpecName: "kube-api-access-kdfhl") pod "26a4d093-bfe4-4423-91c9-186fe9ae8a51" (UID: "26a4d093-bfe4-4423-91c9-186fe9ae8a51"). InnerVolumeSpecName "kube-api-access-kdfhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:55:07.667356 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.667320    2561 generic.go:356] "Generic (PLEG): container finished" podID="26a4d093-bfe4-4423-91c9-186fe9ae8a51" containerID="bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f" exitCode=0
Jul 30 22:55:07.667523 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.667368    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"
Jul 30 22:55:07.667523 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.667398    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd" event={"ID":"26a4d093-bfe4-4423-91c9-186fe9ae8a51","Type":"ContainerDied","Data":"bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f"}
Jul 30 22:55:07.667523 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.667450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd" event={"ID":"26a4d093-bfe4-4423-91c9-186fe9ae8a51","Type":"ContainerDied","Data":"4a8e80fe2857ef76c072bf34190289f7a67ba1c05ecc212cc20c31668080d2d1"}
Jul 30 22:55:07.667523 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.667476    2561 scope.go:117] "RemoveContainer" containerID="bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f"
Jul 30 22:55:07.684821 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.684799    2561 scope.go:117] "RemoveContainer" containerID="bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f"
Jul 30 22:55:07.685124 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:55:07.685104    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f\": container with ID starting with bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f not found: ID does not exist" containerID="bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f"
Jul 30 22:55:07.685167 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.685134    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f"} err="failed to get container status \"bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f\": rpc error: code = NotFound desc = could not find container \"bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f\": container with ID starting with bdf61a981a6ed6fface8bedda9498336e42ab9347960c4d01578e61190d0845f not found: ID does not exist"
Jul 30 22:55:07.694202 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.694154    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"]
Jul 30 22:55:07.702922 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.702897    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-cdddd"]
Jul 30 22:55:07.734052 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.734015    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04336e6-f995-4f27-8bf6-e08c8e02206e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ft278\" (UID: \"f04336e6-f995-4f27-8bf6-e08c8e02206e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:07.734238 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.734097    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf97j\" (UniqueName: \"kubernetes.io/projected/f04336e6-f995-4f27-8bf6-e08c8e02206e-kube-api-access-sf97j\") pod \"kuadrant-operator-controller-manager-68cf589589-ft278\" (UID: \"f04336e6-f995-4f27-8bf6-e08c8e02206e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:07.734238 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.734192    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdfhl\" (UniqueName: \"kubernetes.io/projected/26a4d093-bfe4-4423-91c9-186fe9ae8a51-kube-api-access-kdfhl\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:55:07.734419 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.734401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04336e6-f995-4f27-8bf6-e08c8e02206e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-ft278\" (UID: \"f04336e6-f995-4f27-8bf6-e08c8e02206e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:07.746133 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.746072    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf97j\" (UniqueName: \"kubernetes.io/projected/f04336e6-f995-4f27-8bf6-e08c8e02206e-kube-api-access-sf97j\") pod \"kuadrant-operator-controller-manager-68cf589589-ft278\" (UID: \"f04336e6-f995-4f27-8bf6-e08c8e02206e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:07.817636 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.817599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:07.951652 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:07.951624    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"]
Jul 30 22:55:07.953719 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:55:07.953691    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf04336e6_f995_4f27_8bf6_e08c8e02206e.slice/crio-f5bcd3c5bb00494823f23603248418d870eab05803495065044fad4f5fce575d WatchSource:0}: Error finding container f5bcd3c5bb00494823f23603248418d870eab05803495065044fad4f5fce575d: Status 404 returned error can't find the container with id f5bcd3c5bb00494823f23603248418d870eab05803495065044fad4f5fce575d
Jul 30 22:55:08.673129 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:08.673093    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278" event={"ID":"f04336e6-f995-4f27-8bf6-e08c8e02206e","Type":"ContainerStarted","Data":"57df154fa84b008666ee5900601bd37527e8ff70f255a96eb773beb17786f2cd"}
Jul 30 22:55:08.673607 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:08.673148    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278" event={"ID":"f04336e6-f995-4f27-8bf6-e08c8e02206e","Type":"ContainerStarted","Data":"f5bcd3c5bb00494823f23603248418d870eab05803495065044fad4f5fce575d"}
Jul 30 22:55:08.673607 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:08.673193    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:08.697035 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:08.696990    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26a4d093-bfe4-4423-91c9-186fe9ae8a51" path="/var/lib/kubelet/pods/26a4d093-bfe4-4423-91c9-186fe9ae8a51/volumes"
Jul 30 22:55:08.697740 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:08.697703    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278" podStartSLOduration=1.6976905370000002 podStartE2EDuration="1.697690537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:55:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:55:08.695227381 +0000 UTC m=+432.426372563" watchObservedRunningTime="2026-07-30 22:55:08.697690537 +0000 UTC m=+432.428835698"
Jul 30 22:55:15.442028 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:15.441983    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:19.680676 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:19.680594    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 22:55:23.610329 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:23.610294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:23.707425 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:23.707391    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:41.296580 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.296541    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:41.397130 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.397091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:41.497264 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.497224    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:41.749635 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.749546    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:55:41.753087 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.753067    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:41.755549 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.755529    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8bl7q\""
Jul 30 22:55:41.755672 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.755529    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 22:55:41.762571 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.762544    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:55:41.794595 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.794561    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:55:41.821347 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.821310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4f2n\" (UniqueName: \"kubernetes.io/projected/ba9231cb-ef2d-4115-84be-123e2e8d2502-kube-api-access-x4f2n\") pod \"limitador-limitador-85d9db4d5d-w4m7z\" (UID: \"ba9231cb-ef2d-4115-84be-123e2e8d2502\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:41.821527 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.821371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba9231cb-ef2d-4115-84be-123e2e8d2502-config-file\") pod \"limitador-limitador-85d9db4d5d-w4m7z\" (UID: \"ba9231cb-ef2d-4115-84be-123e2e8d2502\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:41.922467 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.922430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4f2n\" (UniqueName: \"kubernetes.io/projected/ba9231cb-ef2d-4115-84be-123e2e8d2502-kube-api-access-x4f2n\") pod \"limitador-limitador-85d9db4d5d-w4m7z\" (UID: \"ba9231cb-ef2d-4115-84be-123e2e8d2502\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:41.922641 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.922486    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba9231cb-ef2d-4115-84be-123e2e8d2502-config-file\") pod \"limitador-limitador-85d9db4d5d-w4m7z\" (UID: \"ba9231cb-ef2d-4115-84be-123e2e8d2502\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:41.923049 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.923030    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ba9231cb-ef2d-4115-84be-123e2e8d2502-config-file\") pod \"limitador-limitador-85d9db4d5d-w4m7z\" (UID: \"ba9231cb-ef2d-4115-84be-123e2e8d2502\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:41.930499 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:41.930473    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4f2n\" (UniqueName: \"kubernetes.io/projected/ba9231cb-ef2d-4115-84be-123e2e8d2502-kube-api-access-x4f2n\") pod \"limitador-limitador-85d9db4d5d-w4m7z\" (UID: \"ba9231cb-ef2d-4115-84be-123e2e8d2502\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:42.064809 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.064768    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:42.080360 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.080336    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-mwhnc"]
Jul 30 22:55:42.083706 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.083687    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-mwhnc"
Jul 30 22:55:42.086250 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.086228    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xh5wx\""
Jul 30 22:55:42.090369 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.090285    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-mwhnc"]
Jul 30 22:55:42.117169 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.117123    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:42.128743 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.128657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb2h9\" (UniqueName: \"kubernetes.io/projected/05db04d1-3122-4aa0-8178-4cb47d156c88-kube-api-access-pb2h9\") pod \"authorino-b54df94b4-mwhnc\" (UID: \"05db04d1-3122-4aa0-8178-4cb47d156c88\") " pod="kuadrant-system/authorino-b54df94b4-mwhnc"
Jul 30 22:55:42.196901 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.196796    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:55:42.198929 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.198904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:42.199879 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:55:42.199854    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba9231cb_ef2d_4115_84be_123e2e8d2502.slice/crio-44ad10b9758b3cd9ba217e0dd571a14be92b98be39133070d74c0019c8720da7 WatchSource:0}: Error finding container 44ad10b9758b3cd9ba217e0dd571a14be92b98be39133070d74c0019c8720da7: Status 404 returned error can't find the container with id 44ad10b9758b3cd9ba217e0dd571a14be92b98be39133070d74c0019c8720da7
Jul 30 22:55:42.229428 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.229392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb2h9\" (UniqueName: \"kubernetes.io/projected/05db04d1-3122-4aa0-8178-4cb47d156c88-kube-api-access-pb2h9\") pod \"authorino-b54df94b4-mwhnc\" (UID: \"05db04d1-3122-4aa0-8178-4cb47d156c88\") " pod="kuadrant-system/authorino-b54df94b4-mwhnc"
Jul 30 22:55:42.237232 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.237203    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb2h9\" (UniqueName: \"kubernetes.io/projected/05db04d1-3122-4aa0-8178-4cb47d156c88-kube-api-access-pb2h9\") pod \"authorino-b54df94b4-mwhnc\" (UID: \"05db04d1-3122-4aa0-8178-4cb47d156c88\") " pod="kuadrant-system/authorino-b54df94b4-mwhnc"
Jul 30 22:55:42.344143 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.344064    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vt5jx"]
Jul 30 22:55:42.347611 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.347593    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-vt5jx"
Jul 30 22:55:42.356765 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.356742    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vt5jx"]
Jul 30 22:55:42.400116 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.400071    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-mwhnc"
Jul 30 22:55:42.431386 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.431353    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ncnl\" (UniqueName: \"kubernetes.io/projected/50aafea2-403c-4ac1-8783-58ad1b011865-kube-api-access-9ncnl\") pod \"authorino-c548b5d7d-vt5jx\" (UID: \"50aafea2-403c-4ac1-8783-58ad1b011865\") " pod="kuadrant-system/authorino-c548b5d7d-vt5jx"
Jul 30 22:55:42.528763 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.528735    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-mwhnc"]
Jul 30 22:55:42.530977 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:55:42.530949    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05db04d1_3122_4aa0_8178_4cb47d156c88.slice/crio-e2e703490daf528db89e2550ec7a91821108caf3a86a3fbb776d8598ec41becf WatchSource:0}: Error finding container e2e703490daf528db89e2550ec7a91821108caf3a86a3fbb776d8598ec41becf: Status 404 returned error can't find the container with id e2e703490daf528db89e2550ec7a91821108caf3a86a3fbb776d8598ec41becf
Jul 30 22:55:42.532126 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.532064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ncnl\" (UniqueName: \"kubernetes.io/projected/50aafea2-403c-4ac1-8783-58ad1b011865-kube-api-access-9ncnl\") pod \"authorino-c548b5d7d-vt5jx\" (UID: \"50aafea2-403c-4ac1-8783-58ad1b011865\") " pod="kuadrant-system/authorino-c548b5d7d-vt5jx"
Jul 30 22:55:42.540688 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.540658    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ncnl\" (UniqueName: \"kubernetes.io/projected/50aafea2-403c-4ac1-8783-58ad1b011865-kube-api-access-9ncnl\") pod \"authorino-c548b5d7d-vt5jx\" (UID: \"50aafea2-403c-4ac1-8783-58ad1b011865\") " pod="kuadrant-system/authorino-c548b5d7d-vt5jx"
Jul 30 22:55:42.657483 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.657401    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-vt5jx"
Jul 30 22:55:42.794928 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.794897    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vt5jx"]
Jul 30 22:55:42.797208 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:55:42.797165    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50aafea2_403c_4ac1_8783_58ad1b011865.slice/crio-1a756707ddf34b4ecfa2971c583d6af2c7f1c0af80333c93e724f8d5e620e0e1 WatchSource:0}: Error finding container 1a756707ddf34b4ecfa2971c583d6af2c7f1c0af80333c93e724f8d5e620e0e1: Status 404 returned error can't find the container with id 1a756707ddf34b4ecfa2971c583d6af2c7f1c0af80333c93e724f8d5e620e0e1
Jul 30 22:55:42.822481 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.822449    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-vt5jx" event={"ID":"50aafea2-403c-4ac1-8783-58ad1b011865","Type":"ContainerStarted","Data":"1a756707ddf34b4ecfa2971c583d6af2c7f1c0af80333c93e724f8d5e620e0e1"}
Jul 30 22:55:42.823868 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.823839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z" event={"ID":"ba9231cb-ef2d-4115-84be-123e2e8d2502","Type":"ContainerStarted","Data":"44ad10b9758b3cd9ba217e0dd571a14be92b98be39133070d74c0019c8720da7"}
Jul 30 22:55:42.825024 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:42.825003    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-mwhnc" event={"ID":"05db04d1-3122-4aa0-8178-4cb47d156c88","Type":"ContainerStarted","Data":"e2e703490daf528db89e2550ec7a91821108caf3a86a3fbb776d8598ec41becf"}
Jul 30 22:55:43.846519 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:43.846480    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z" event={"ID":"ba9231cb-ef2d-4115-84be-123e2e8d2502","Type":"ContainerStarted","Data":"7a299d2d0fc56ad3ada045ae7baf0fd105d5858c8d76ab9746b8149ca0669e29"}
Jul 30 22:55:43.848034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:43.848010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:43.866969 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:43.866777    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z" podStartSLOduration=1.869006564 podStartE2EDuration="2.866751831s" totalImagesPullingTime="997.745267ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:55:43.86367542 +0000 UTC m=+467.594820618" watchObservedRunningTime="2026-07-30 22:55:43.866751831 +0000 UTC m=+467.597896993"
Jul 30 22:55:45.857054 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:45.857015    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-vt5jx" event={"ID":"50aafea2-403c-4ac1-8783-58ad1b011865","Type":"ContainerStarted","Data":"8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86"}
Jul 30 22:55:45.858418 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:45.858386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-mwhnc" event={"ID":"05db04d1-3122-4aa0-8178-4cb47d156c88","Type":"ContainerStarted","Data":"3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a"}
Jul 30 22:55:45.872681 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:45.872636    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-vt5jx" podStartSLOduration=1.8279458800000001 podStartE2EDuration="3.872621357s" totalImagesPullingTime="2.044675477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:55:45.870855961 +0000 UTC m=+469.602001122" watchObservedRunningTime="2026-07-30 22:55:45.872621357 +0000 UTC m=+469.603766518"
Jul 30 22:55:45.884416 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:45.884358    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-mwhnc" podStartSLOduration=1.5839899320000002 podStartE2EDuration="3.884342283s" totalImagesPullingTime="2.300352351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:55:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:55:45.883333026 +0000 UTC m=+469.614478188" watchObservedRunningTime="2026-07-30 22:55:45.884342283 +0000 UTC m=+469.615487443"
Jul 30 22:55:45.910251 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:45.910210    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-mwhnc"]
Jul 30 22:55:47.867046 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:47.867002    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-mwhnc" podUID="05db04d1-3122-4aa0-8178-4cb47d156c88" containerName="authorino" containerID="cri-o://3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a" gracePeriod=30
Jul 30 22:55:48.116761 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.116734    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-mwhnc"
Jul 30 22:55:48.187665 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.187570    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb2h9\" (UniqueName: \"kubernetes.io/projected/05db04d1-3122-4aa0-8178-4cb47d156c88-kube-api-access-pb2h9\") pod \"05db04d1-3122-4aa0-8178-4cb47d156c88\" (UID: \"05db04d1-3122-4aa0-8178-4cb47d156c88\") "
Jul 30 22:55:48.189679 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.189649    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05db04d1-3122-4aa0-8178-4cb47d156c88-kube-api-access-pb2h9" (OuterVolumeSpecName: "kube-api-access-pb2h9") pod "05db04d1-3122-4aa0-8178-4cb47d156c88" (UID: "05db04d1-3122-4aa0-8178-4cb47d156c88"). InnerVolumeSpecName "kube-api-access-pb2h9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:55:48.288560 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.288526    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb2h9\" (UniqueName: \"kubernetes.io/projected/05db04d1-3122-4aa0-8178-4cb47d156c88-kube-api-access-pb2h9\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:55:48.872597 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.872564    2561 generic.go:356] "Generic (PLEG): container finished" podID="05db04d1-3122-4aa0-8178-4cb47d156c88" containerID="3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a" exitCode=0
Jul 30 22:55:48.873004 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.872609    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-mwhnc" event={"ID":"05db04d1-3122-4aa0-8178-4cb47d156c88","Type":"ContainerDied","Data":"3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a"}
Jul 30 22:55:48.873004 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.872615    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-mwhnc"
Jul 30 22:55:48.873004 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.872639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-mwhnc" event={"ID":"05db04d1-3122-4aa0-8178-4cb47d156c88","Type":"ContainerDied","Data":"e2e703490daf528db89e2550ec7a91821108caf3a86a3fbb776d8598ec41becf"}
Jul 30 22:55:48.873004 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.872655    2561 scope.go:117] "RemoveContainer" containerID="3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a"
Jul 30 22:55:48.880624 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.880602    2561 scope.go:117] "RemoveContainer" containerID="3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a"
Jul 30 22:55:48.880895 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:55:48.880877    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a\": container with ID starting with 3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a not found: ID does not exist" containerID="3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a"
Jul 30 22:55:48.880950 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.880904    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a"} err="failed to get container status \"3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a\": rpc error: code = NotFound desc = could not find container \"3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a\": container with ID starting with 3e09bd6c09689f8e7f376da195df8b4ff2fcaad2de2dce2f353b9d295bfe843a not found: ID does not exist"
Jul 30 22:55:48.888681 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.888657    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-mwhnc"]
Jul 30 22:55:48.891343 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:48.891322    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-mwhnc"]
Jul 30 22:55:50.696906 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:50.696872    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05db04d1-3122-4aa0-8178-4cb47d156c88" path="/var/lib/kubelet/pods/05db04d1-3122-4aa0-8178-4cb47d156c88/volumes"
Jul 30 22:55:55.859806 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:55.859771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"
Jul 30 22:55:56.955583 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:56.955501    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:57.059138 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:57.059106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:55:57.443964 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:55:57.443931    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:09.865921 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:09.865882    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:09.987730 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:09.987696    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:10.085893 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.085859    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-lgzst"]
Jul 30 22:56:10.086236 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.086223    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05db04d1-3122-4aa0-8178-4cb47d156c88" containerName="authorino"
Jul 30 22:56:10.086292 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.086238    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="05db04d1-3122-4aa0-8178-4cb47d156c88" containerName="authorino"
Jul 30 22:56:10.086327 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.086304    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="05db04d1-3122-4aa0-8178-4cb47d156c88" containerName="authorino"
Jul 30 22:56:10.092682 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.092657    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-lgzst"
Jul 30 22:56:10.095490 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.095458    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-lgzst"]
Jul 30 22:56:10.148741 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.148655    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-lgzst"]
Jul 30 22:56:10.148956 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:56:10.148931    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-49dlw], unattached volumes=[], failed to process volumes=[kube-api-access-49dlw]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-lgzst" podUID="c9b74ede-45b3-4df0-af3c-141625e75b76"
Jul 30 22:56:10.170866 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.170828    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-687bd45585-7n6x6"]
Jul 30 22:56:10.175308 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.175281    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.177729 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.177691    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 22:56:10.180153 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.180126    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-687bd45585-7n6x6"]
Jul 30 22:56:10.280854 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.280817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb0f7246-41ab-409f-96b1-70b75090b074-tls-cert\") pod \"authorino-687bd45585-7n6x6\" (UID: \"cb0f7246-41ab-409f-96b1-70b75090b074\") " pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.281022 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.280870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmfzb\" (UniqueName: \"kubernetes.io/projected/cb0f7246-41ab-409f-96b1-70b75090b074-kube-api-access-wmfzb\") pod \"authorino-687bd45585-7n6x6\" (UID: \"cb0f7246-41ab-409f-96b1-70b75090b074\") " pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.281022 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.280899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49dlw\" (UniqueName: \"kubernetes.io/projected/c9b74ede-45b3-4df0-af3c-141625e75b76-kube-api-access-49dlw\") pod \"authorino-5dc7ccb5f-lgzst\" (UID: \"c9b74ede-45b3-4df0-af3c-141625e75b76\") " pod="kuadrant-system/authorino-5dc7ccb5f-lgzst"
Jul 30 22:56:10.318336 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.318303    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-7n6x6"]
Jul 30 22:56:10.318583 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:56:10.318565    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wmfzb tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-687bd45585-7n6x6" podUID="cb0f7246-41ab-409f-96b1-70b75090b074"
Jul 30 22:56:10.339364 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.339328    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f95f67756-wnw4g"]
Jul 30 22:56:10.343549 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.343527    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:56:10.352643 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.352616    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f95f67756-wnw4g"]
Jul 30 22:56:10.382274 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.382236    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb0f7246-41ab-409f-96b1-70b75090b074-tls-cert\") pod \"authorino-687bd45585-7n6x6\" (UID: \"cb0f7246-41ab-409f-96b1-70b75090b074\") " pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.382476 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.382294    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmfzb\" (UniqueName: \"kubernetes.io/projected/cb0f7246-41ab-409f-96b1-70b75090b074-kube-api-access-wmfzb\") pod \"authorino-687bd45585-7n6x6\" (UID: \"cb0f7246-41ab-409f-96b1-70b75090b074\") " pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.382476 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.382337    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49dlw\" (UniqueName: \"kubernetes.io/projected/c9b74ede-45b3-4df0-af3c-141625e75b76-kube-api-access-49dlw\") pod \"authorino-5dc7ccb5f-lgzst\" (UID: \"c9b74ede-45b3-4df0-af3c-141625e75b76\") " pod="kuadrant-system/authorino-5dc7ccb5f-lgzst"
Jul 30 22:56:10.384877 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.384848    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb0f7246-41ab-409f-96b1-70b75090b074-tls-cert\") pod \"authorino-687bd45585-7n6x6\" (UID: \"cb0f7246-41ab-409f-96b1-70b75090b074\") " pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.390462 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.390437    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49dlw\" (UniqueName: \"kubernetes.io/projected/c9b74ede-45b3-4df0-af3c-141625e75b76-kube-api-access-49dlw\") pod \"authorino-5dc7ccb5f-lgzst\" (UID: \"c9b74ede-45b3-4df0-af3c-141625e75b76\") " pod="kuadrant-system/authorino-5dc7ccb5f-lgzst"
Jul 30 22:56:10.390604 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.390584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmfzb\" (UniqueName: \"kubernetes.io/projected/cb0f7246-41ab-409f-96b1-70b75090b074-kube-api-access-wmfzb\") pod \"authorino-687bd45585-7n6x6\" (UID: \"cb0f7246-41ab-409f-96b1-70b75090b074\") " pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.483738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.483651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t6vm\" (UniqueName: \"kubernetes.io/projected/14314034-b7ad-467c-a6a0-ed9265d33584-kube-api-access-4t6vm\") pod \"authorino-7f95f67756-wnw4g\" (UID: \"14314034-b7ad-467c-a6a0-ed9265d33584\") " pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:56:10.483738 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.483701    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14314034-b7ad-467c-a6a0-ed9265d33584-tls-cert\") pod \"authorino-7f95f67756-wnw4g\" (UID: \"14314034-b7ad-467c-a6a0-ed9265d33584\") " pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:56:10.584223 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.584145    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t6vm\" (UniqueName: \"kubernetes.io/projected/14314034-b7ad-467c-a6a0-ed9265d33584-kube-api-access-4t6vm\") pod \"authorino-7f95f67756-wnw4g\" (UID: \"14314034-b7ad-467c-a6a0-ed9265d33584\") " pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:56:10.584403 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.584247    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14314034-b7ad-467c-a6a0-ed9265d33584-tls-cert\") pod \"authorino-7f95f67756-wnw4g\" (UID: \"14314034-b7ad-467c-a6a0-ed9265d33584\") " pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:56:10.586723 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.586702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14314034-b7ad-467c-a6a0-ed9265d33584-tls-cert\") pod \"authorino-7f95f67756-wnw4g\" (UID: \"14314034-b7ad-467c-a6a0-ed9265d33584\") " pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:56:10.592490 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.592460    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t6vm\" (UniqueName: \"kubernetes.io/projected/14314034-b7ad-467c-a6a0-ed9265d33584-kube-api-access-4t6vm\") pod \"authorino-7f95f67756-wnw4g\" (UID: \"14314034-b7ad-467c-a6a0-ed9265d33584\") " pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:56:10.654000 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.653945    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:56:10.786844 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.786805    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f95f67756-wnw4g"]
Jul 30 22:56:10.790130 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:56:10.790100    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14314034_b7ad_467c_a6a0_ed9265d33584.slice/crio-6d63d8e8292ea1363fb7983cf7315675ddf1d22207e57420cefb7df60d0add7a WatchSource:0}: Error finding container 6d63d8e8292ea1363fb7983cf7315675ddf1d22207e57420cefb7df60d0add7a: Status 404 returned error can't find the container with id 6d63d8e8292ea1363fb7983cf7315675ddf1d22207e57420cefb7df60d0add7a
Jul 30 22:56:10.976590 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.976551    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f95f67756-wnw4g" event={"ID":"14314034-b7ad-467c-a6a0-ed9265d33584","Type":"ContainerStarted","Data":"6d63d8e8292ea1363fb7983cf7315675ddf1d22207e57420cefb7df60d0add7a"}
Jul 30 22:56:10.976590 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.976561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.977012 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.976572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-lgzst"
Jul 30 22:56:10.986034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.986008    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:10.989033 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:10.988986    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-lgzst"
Jul 30 22:56:11.088734 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.088697    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49dlw\" (UniqueName: \"kubernetes.io/projected/c9b74ede-45b3-4df0-af3c-141625e75b76-kube-api-access-49dlw\") pod \"c9b74ede-45b3-4df0-af3c-141625e75b76\" (UID: \"c9b74ede-45b3-4df0-af3c-141625e75b76\") "
Jul 30 22:56:11.088977 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.088811    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb0f7246-41ab-409f-96b1-70b75090b074-tls-cert\") pod \"cb0f7246-41ab-409f-96b1-70b75090b074\" (UID: \"cb0f7246-41ab-409f-96b1-70b75090b074\") "
Jul 30 22:56:11.088977 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.088926    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmfzb\" (UniqueName: \"kubernetes.io/projected/cb0f7246-41ab-409f-96b1-70b75090b074-kube-api-access-wmfzb\") pod \"cb0f7246-41ab-409f-96b1-70b75090b074\" (UID: \"cb0f7246-41ab-409f-96b1-70b75090b074\") "
Jul 30 22:56:11.090925 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.090891    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb0f7246-41ab-409f-96b1-70b75090b074-kube-api-access-wmfzb" (OuterVolumeSpecName: "kube-api-access-wmfzb") pod "cb0f7246-41ab-409f-96b1-70b75090b074" (UID: "cb0f7246-41ab-409f-96b1-70b75090b074"). InnerVolumeSpecName "kube-api-access-wmfzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:56:11.090925 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.090919    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9b74ede-45b3-4df0-af3c-141625e75b76-kube-api-access-49dlw" (OuterVolumeSpecName: "kube-api-access-49dlw") pod "c9b74ede-45b3-4df0-af3c-141625e75b76" (UID: "c9b74ede-45b3-4df0-af3c-141625e75b76"). InnerVolumeSpecName "kube-api-access-49dlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:56:11.091084 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.091005    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb0f7246-41ab-409f-96b1-70b75090b074-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "cb0f7246-41ab-409f-96b1-70b75090b074" (UID: "cb0f7246-41ab-409f-96b1-70b75090b074"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:56:11.189827 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.189791    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmfzb\" (UniqueName: \"kubernetes.io/projected/cb0f7246-41ab-409f-96b1-70b75090b074-kube-api-access-wmfzb\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:56:11.189827 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.189821    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49dlw\" (UniqueName: \"kubernetes.io/projected/c9b74ede-45b3-4df0-af3c-141625e75b76-kube-api-access-49dlw\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:56:11.189827 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.189832    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/cb0f7246-41ab-409f-96b1-70b75090b074-tls-cert\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:56:11.982148 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.982115    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-lgzst"
Jul 30 22:56:11.982148 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.982142    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f95f67756-wnw4g" event={"ID":"14314034-b7ad-467c-a6a0-ed9265d33584","Type":"ContainerStarted","Data":"bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab"}
Jul 30 22:56:11.982691 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.982417    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-687bd45585-7n6x6"
Jul 30 22:56:11.999681 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:11.999631    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f95f67756-wnw4g" podStartSLOduration=0.982220698 podStartE2EDuration="1.999614685s" totalImagesPullingTime="1.017393987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:56:11.998746735 +0000 UTC m=+495.729891897" watchObservedRunningTime="2026-07-30 22:56:11.999614685 +0000 UTC m=+495.730759845"
Jul 30 22:56:12.022425 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.022392    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-687bd45585-7n6x6"]
Jul 30 22:56:12.030873 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.030827    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vt5jx"]
Jul 30 22:56:12.031089 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.031045    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-vt5jx" podUID="50aafea2-403c-4ac1-8783-58ad1b011865" containerName="authorino" containerID="cri-o://8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86" gracePeriod=30
Jul 30 22:56:12.033243 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.033216    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-687bd45585-7n6x6"]
Jul 30 22:56:12.054003 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.053953    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-lgzst"]
Jul 30 22:56:12.056966 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.056940    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-lgzst"]
Jul 30 22:56:12.260538 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.260512    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-vt5jx"
Jul 30 22:56:12.402138 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.402058    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9ncnl\" (UniqueName: \"kubernetes.io/projected/50aafea2-403c-4ac1-8783-58ad1b011865-kube-api-access-9ncnl\") pod \"50aafea2-403c-4ac1-8783-58ad1b011865\" (UID: \"50aafea2-403c-4ac1-8783-58ad1b011865\") "
Jul 30 22:56:12.404128 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.404095    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50aafea2-403c-4ac1-8783-58ad1b011865-kube-api-access-9ncnl" (OuterVolumeSpecName: "kube-api-access-9ncnl") pod "50aafea2-403c-4ac1-8783-58ad1b011865" (UID: "50aafea2-403c-4ac1-8783-58ad1b011865"). InnerVolumeSpecName "kube-api-access-9ncnl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:56:12.502655 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.502616    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9ncnl\" (UniqueName: \"kubernetes.io/projected/50aafea2-403c-4ac1-8783-58ad1b011865-kube-api-access-9ncnl\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:56:12.696470 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.696399    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9b74ede-45b3-4df0-af3c-141625e75b76" path="/var/lib/kubelet/pods/c9b74ede-45b3-4df0-af3c-141625e75b76/volumes"
Jul 30 22:56:12.696671 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.696658    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb0f7246-41ab-409f-96b1-70b75090b074" path="/var/lib/kubelet/pods/cb0f7246-41ab-409f-96b1-70b75090b074/volumes"
Jul 30 22:56:12.989119 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.989019    2561 generic.go:356] "Generic (PLEG): container finished" podID="50aafea2-403c-4ac1-8783-58ad1b011865" containerID="8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86" exitCode=0
Jul 30 22:56:12.989119 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.989073    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-vt5jx"
Jul 30 22:56:12.989631 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.989119    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-vt5jx" event={"ID":"50aafea2-403c-4ac1-8783-58ad1b011865","Type":"ContainerDied","Data":"8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86"}
Jul 30 22:56:12.989631 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.989162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-vt5jx" event={"ID":"50aafea2-403c-4ac1-8783-58ad1b011865","Type":"ContainerDied","Data":"1a756707ddf34b4ecfa2971c583d6af2c7f1c0af80333c93e724f8d5e620e0e1"}
Jul 30 22:56:12.989631 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.989199    2561 scope.go:117] "RemoveContainer" containerID="8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86"
Jul 30 22:56:12.997204 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.997169    2561 scope.go:117] "RemoveContainer" containerID="8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86"
Jul 30 22:56:12.997450 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:56:12.997430    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86\": container with ID starting with 8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86 not found: ID does not exist" containerID="8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86"
Jul 30 22:56:12.997517 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:12.997458    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86"} err="failed to get container status \"8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86\": rpc error: code = NotFound desc = could not find container \"8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86\": container with ID starting with 8c7813ec8070a93305723a02df1b6a05b60bbe71dab69d1b978648e568daae86 not found: ID does not exist"
Jul 30 22:56:13.003380 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:13.003357    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vt5jx"]
Jul 30 22:56:13.007650 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:13.007629    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-vt5jx"]
Jul 30 22:56:14.697379 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:14.697347    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50aafea2-403c-4ac1-8783-58ad1b011865" path="/var/lib/kubelet/pods/50aafea2-403c-4ac1-8783-58ad1b011865/volumes"
Jul 30 22:56:16.601888 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:16.601856    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:16.681351 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:16.681320    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:16.738267 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:16.738236    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:16.797412 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:16.797375    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:19.735195 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:19.735136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:19.834142 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:19.834106    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:23.850616 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:23.850579    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:51.581273 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:51.581168    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:51.678983 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:51.678947    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:53.150237 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:53.150194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:53.548082 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:53.548043    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:53.653563 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:53.653530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:53.775229 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:53.775172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:56:53.869729 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:56:53.869650    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:57:03.413908 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:03.413840    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:57:03.514000 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:03.513963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:57:10.866426 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:10.866391    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:57:11.369126 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:11.369088    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:57:15.260027 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:15.259988    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:57:15.855292 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:15.855257    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:57:32.169170 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:32.169101    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:57:33.059879 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:33.059842    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:57:43.243422 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.243391    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"]
Jul 30 22:57:43.243841 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.243730    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50aafea2-403c-4ac1-8783-58ad1b011865" containerName="authorino"
Jul 30 22:57:43.243841 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.243741    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="50aafea2-403c-4ac1-8783-58ad1b011865" containerName="authorino"
Jul 30 22:57:43.243841 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.243806    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="50aafea2-403c-4ac1-8783-58ad1b011865" containerName="authorino"
Jul 30 22:57:43.247034 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.247011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.250586 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.250561    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 22:57:43.250586 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.250583    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 22:57:43.250787 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.250564    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mkjq5\""
Jul 30 22:57:43.250787 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.250618    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 30 22:57:43.256546 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.256517    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"]
Jul 30 22:57:43.339346 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.339303    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:57:43.378940 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.378903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f137d1ab-110d-47be-8c3c-4975f2a496bc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.378940 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.378943    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.379147 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.378961    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.379147 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.379090    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.379147 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.379122    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2bnb\" (UniqueName: \"kubernetes.io/projected/f137d1ab-110d-47be-8c3c-4975f2a496bc-kube-api-access-t2bnb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.379286 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.379145    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.479788 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.479747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f137d1ab-110d-47be-8c3c-4975f2a496bc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.479788 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.479793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.480051 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.479812    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.480051 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.479882    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.480051 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.479908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2bnb\" (UniqueName: \"kubernetes.io/projected/f137d1ab-110d-47be-8c3c-4975f2a496bc-kube-api-access-t2bnb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.480051 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.479935    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.480284 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.480256    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.480344 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.480295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.480406 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.480370    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.482243 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.482226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f137d1ab-110d-47be-8c3c-4975f2a496bc-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.482294 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.482242    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f137d1ab-110d-47be-8c3c-4975f2a496bc-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.487383 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.487360    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2bnb\" (UniqueName: \"kubernetes.io/projected/f137d1ab-110d-47be-8c3c-4975f2a496bc-kube-api-access-t2bnb\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq\" (UID: \"f137d1ab-110d-47be-8c3c-4975f2a496bc\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.557775 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.557741    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:43.691992 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:43.691966    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"]
Jul 30 22:57:43.694016 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:57:43.693992    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf137d1ab_110d_47be_8c3c_4975f2a496bc.slice/crio-f010e88e72d37e2bf9d2390fbc50263da7e12772d7f4329f5681eecd9c35bc7c WatchSource:0}: Error finding container f010e88e72d37e2bf9d2390fbc50263da7e12772d7f4329f5681eecd9c35bc7c: Status 404 returned error can't find the container with id f010e88e72d37e2bf9d2390fbc50263da7e12772d7f4329f5681eecd9c35bc7c
Jul 30 22:57:44.391828 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:44.391793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq" event={"ID":"f137d1ab-110d-47be-8c3c-4975f2a496bc","Type":"ContainerStarted","Data":"f010e88e72d37e2bf9d2390fbc50263da7e12772d7f4329f5681eecd9c35bc7c"}
Jul 30 22:57:44.755006 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:44.754974    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:57:45.398805 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:45.398771    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq" event={"ID":"f137d1ab-110d-47be-8c3c-4975f2a496bc","Type":"ContainerStarted","Data":"ad5d0ac41406f7cd8b22afdc40cbb906e9d12b59430df3d782d872792ac235b6"}
Jul 30 22:57:45.419994 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:45.419934    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq" podStartSLOduration=1.404431966 podStartE2EDuration="2.419914916s" totalImagesPullingTime="1.01548295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:57:45.418774615 +0000 UTC m=+589.149919814" watchObservedRunningTime="2026-07-30 22:57:45.419914916 +0000 UTC m=+589.151060076"
Jul 30 22:57:53.175728 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:53.175683    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:57:53.558816 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:53.558774    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:53.558992 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:53.558844    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:53.571392 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:53.571361    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:54.454004 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:54.453971    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq"
Jul 30 22:57:55.062962 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:55.062919    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:57:57.150498 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:57.150459    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:57:59.973659 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:57:59.973622    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:00.075433 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.075402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:00.687255 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.687223    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"]
Jul 30 22:58:00.693773 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.693740    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.699273 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.699251    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 30 22:58:00.730466 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.730436    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"]
Jul 30 22:58:00.748703 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.748677    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:00.835202 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.835138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fa492f5-060b-42b0-84a7-71520def05d3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.835387 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.835273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.835387 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.835329    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.835558 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.835536    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.835629 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.835617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.835933 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.835898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sxn7\" (UniqueName: \"kubernetes.io/projected/2fa492f5-060b-42b0-84a7-71520def05d3-kube-api-access-6sxn7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.937435 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.937353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sxn7\" (UniqueName: \"kubernetes.io/projected/2fa492f5-060b-42b0-84a7-71520def05d3-kube-api-access-6sxn7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.937435 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.937408    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fa492f5-060b-42b0-84a7-71520def05d3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.937654 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.937440    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.937654 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.937479    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.937654 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.937532    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.937654 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.937566    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.938037 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.938011    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.938112 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.938066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.938112 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.938084    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.939827 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.939809    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fa492f5-060b-42b0-84a7-71520def05d3-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.939882 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.939831    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fa492f5-060b-42b0-84a7-71520def05d3-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:00.945242 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:00.945216    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sxn7\" (UniqueName: \"kubernetes.io/projected/2fa492f5-060b-42b0-84a7-71520def05d3-kube-api-access-6sxn7\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs\" (UID: \"2fa492f5-060b-42b0-84a7-71520def05d3\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:01.004303 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:01.004262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:01.133971 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:01.133931    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"]
Jul 30 22:58:01.136345 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:58:01.136315    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fa492f5_060b_42b0_84a7_71520def05d3.slice/crio-b1e497b8b9119c5a50c15064100ae65087f7368ed608d5ad5122eed5fa69b5da WatchSource:0}: Error finding container b1e497b8b9119c5a50c15064100ae65087f7368ed608d5ad5122eed5fa69b5da: Status 404 returned error can't find the container with id b1e497b8b9119c5a50c15064100ae65087f7368ed608d5ad5122eed5fa69b5da
Jul 30 22:58:01.475712 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:01.475671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs" event={"ID":"2fa492f5-060b-42b0-84a7-71520def05d3","Type":"ContainerStarted","Data":"a79938fc41213ce47eafe47be09147fb6a82c0e13928ec1044a06e2e7385d805"}
Jul 30 22:58:01.475712 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:01.475711    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs" event={"ID":"2fa492f5-060b-42b0-84a7-71520def05d3","Type":"ContainerStarted","Data":"b1e497b8b9119c5a50c15064100ae65087f7368ed608d5ad5122eed5fa69b5da"}
Jul 30 22:58:01.493208 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:01.493120    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs" podStartSLOduration=1.308814145 podStartE2EDuration="1.493104227s" totalImagesPullingTime="184.290082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:58:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:58:01.491590597 +0000 UTC m=+605.222735759" watchObservedRunningTime="2026-07-30 22:58:01.493104227 +0000 UTC m=+605.224249398"
Jul 30 22:58:03.452944 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:03.452907    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:58:10.794865 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:10.794827    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:10.896882 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:10.896848    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:11.005022 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:11.004984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:11.005022 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:11.005027    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:11.018101 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:11.018075    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:11.533389 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:11.533357    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs"
Jul 30 22:58:24.158925 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:24.158850    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:37.304788 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:37.304750    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:46.685708 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:46.685671    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:46.747971 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:46.747935    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:54.931323 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:54.931282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:55.032132 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:55.032086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:58:58.337550 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:58:58.337515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:59:06.467933 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.467897    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7884dc974f-klcfr"]
Jul 30 22:59:06.471328 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.471309    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7884dc974f-klcfr"
Jul 30 22:59:06.477423 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.477391    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7884dc974f-klcfr"]
Jul 30 22:59:06.491259 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.491228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sz7q\" (UniqueName: \"kubernetes.io/projected/a08d9bf9-e198-40e8-9b37-95283eec0279-kube-api-access-6sz7q\") pod \"authorino-7884dc974f-klcfr\" (UID: \"a08d9bf9-e198-40e8-9b37-95283eec0279\") " pod="kuadrant-system/authorino-7884dc974f-klcfr"
Jul 30 22:59:06.491414 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.491275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a08d9bf9-e198-40e8-9b37-95283eec0279-tls-cert\") pod \"authorino-7884dc974f-klcfr\" (UID: \"a08d9bf9-e198-40e8-9b37-95283eec0279\") " pod="kuadrant-system/authorino-7884dc974f-klcfr"
Jul 30 22:59:06.592081 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.592043    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a08d9bf9-e198-40e8-9b37-95283eec0279-tls-cert\") pod \"authorino-7884dc974f-klcfr\" (UID: \"a08d9bf9-e198-40e8-9b37-95283eec0279\") " pod="kuadrant-system/authorino-7884dc974f-klcfr"
Jul 30 22:59:06.592288 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.592141    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sz7q\" (UniqueName: \"kubernetes.io/projected/a08d9bf9-e198-40e8-9b37-95283eec0279-kube-api-access-6sz7q\") pod \"authorino-7884dc974f-klcfr\" (UID: \"a08d9bf9-e198-40e8-9b37-95283eec0279\") " pod="kuadrant-system/authorino-7884dc974f-klcfr"
Jul 30 22:59:06.594539 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.594517    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a08d9bf9-e198-40e8-9b37-95283eec0279-tls-cert\") pod \"authorino-7884dc974f-klcfr\" (UID: \"a08d9bf9-e198-40e8-9b37-95283eec0279\") " pod="kuadrant-system/authorino-7884dc974f-klcfr"
Jul 30 22:59:06.600238 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.600207    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sz7q\" (UniqueName: \"kubernetes.io/projected/a08d9bf9-e198-40e8-9b37-95283eec0279-kube-api-access-6sz7q\") pod \"authorino-7884dc974f-klcfr\" (UID: \"a08d9bf9-e198-40e8-9b37-95283eec0279\") " pod="kuadrant-system/authorino-7884dc974f-klcfr"
Jul 30 22:59:06.781390 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.781354    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7884dc974f-klcfr"
Jul 30 22:59:06.921480 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.921447    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7884dc974f-klcfr"]
Jul 30 22:59:06.925344 ip-10-0-135-246 kubenswrapper[2561]: W0730 22:59:06.925308    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda08d9bf9_e198_40e8_9b37_95283eec0279.slice/crio-83bf71c1effee282edc004bdb6e1aa0a8010dca60de13aee426f886a3bf26df6 WatchSource:0}: Error finding container 83bf71c1effee282edc004bdb6e1aa0a8010dca60de13aee426f886a3bf26df6: Status 404 returned error can't find the container with id 83bf71c1effee282edc004bdb6e1aa0a8010dca60de13aee426f886a3bf26df6
Jul 30 22:59:06.926805 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:06.926778    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 22:59:07.781201 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:07.781147    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7884dc974f-klcfr" event={"ID":"a08d9bf9-e198-40e8-9b37-95283eec0279","Type":"ContainerStarted","Data":"2a45d41a6aafc8ee5c5c1a1d14f03557f7c08b636293de142c7be72f9546e8c1"}
Jul 30 22:59:07.781201 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:07.781199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7884dc974f-klcfr" event={"ID":"a08d9bf9-e198-40e8-9b37-95283eec0279","Type":"ContainerStarted","Data":"83bf71c1effee282edc004bdb6e1aa0a8010dca60de13aee426f886a3bf26df6"}
Jul 30 22:59:07.797625 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:07.797571    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7884dc974f-klcfr" podStartSLOduration=1.109700823 podStartE2EDuration="1.79755501s" totalImagesPullingTime="687.854187ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 22:59:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 22:59:07.795946447 +0000 UTC m=+671.527091607" watchObservedRunningTime="2026-07-30 22:59:07.79755501 +0000 UTC m=+671.528700171"
Jul 30 22:59:07.823091 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:07.823061    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f95f67756-wnw4g"]
Jul 30 22:59:07.823289 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:07.823242    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7f95f67756-wnw4g" podUID="14314034-b7ad-467c-a6a0-ed9265d33584" containerName="authorino" containerID="cri-o://bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab" gracePeriod=30
Jul 30 22:59:08.066070 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.066044    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:59:08.106346 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.106311    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t6vm\" (UniqueName: \"kubernetes.io/projected/14314034-b7ad-467c-a6a0-ed9265d33584-kube-api-access-4t6vm\") pod \"14314034-b7ad-467c-a6a0-ed9265d33584\" (UID: \"14314034-b7ad-467c-a6a0-ed9265d33584\") "
Jul 30 22:59:08.106540 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.106386    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14314034-b7ad-467c-a6a0-ed9265d33584-tls-cert\") pod \"14314034-b7ad-467c-a6a0-ed9265d33584\" (UID: \"14314034-b7ad-467c-a6a0-ed9265d33584\") "
Jul 30 22:59:08.108773 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.108725    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14314034-b7ad-467c-a6a0-ed9265d33584-kube-api-access-4t6vm" (OuterVolumeSpecName: "kube-api-access-4t6vm") pod "14314034-b7ad-467c-a6a0-ed9265d33584" (UID: "14314034-b7ad-467c-a6a0-ed9265d33584"). InnerVolumeSpecName "kube-api-access-4t6vm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 22:59:08.118435 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.118407    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14314034-b7ad-467c-a6a0-ed9265d33584-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "14314034-b7ad-467c-a6a0-ed9265d33584" (UID: "14314034-b7ad-467c-a6a0-ed9265d33584"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 22:59:08.207767 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.207672    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t6vm\" (UniqueName: \"kubernetes.io/projected/14314034-b7ad-467c-a6a0-ed9265d33584-kube-api-access-4t6vm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:59:08.207767 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.207716    2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14314034-b7ad-467c-a6a0-ed9265d33584-tls-cert\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 22:59:08.353090 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.353059    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:59:08.447664 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.447624    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:59:08.787304 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.787208    2561 generic.go:356] "Generic (PLEG): container finished" podID="14314034-b7ad-467c-a6a0-ed9265d33584" containerID="bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab" exitCode=0
Jul 30 22:59:08.787304 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.787288    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f95f67756-wnw4g"
Jul 30 22:59:08.787886 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.787311    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f95f67756-wnw4g" event={"ID":"14314034-b7ad-467c-a6a0-ed9265d33584","Type":"ContainerDied","Data":"bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab"}
Jul 30 22:59:08.787886 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.787374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f95f67756-wnw4g" event={"ID":"14314034-b7ad-467c-a6a0-ed9265d33584","Type":"ContainerDied","Data":"6d63d8e8292ea1363fb7983cf7315675ddf1d22207e57420cefb7df60d0add7a"}
Jul 30 22:59:08.787886 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.787407    2561 scope.go:117] "RemoveContainer" containerID="bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab"
Jul 30 22:59:08.796537 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.796520    2561 scope.go:117] "RemoveContainer" containerID="bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab"
Jul 30 22:59:08.796786 ip-10-0-135-246 kubenswrapper[2561]: E0730 22:59:08.796768    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab\": container with ID starting with bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab not found: ID does not exist" containerID="bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab"
Jul 30 22:59:08.796832 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.796798    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab"} err="failed to get container status \"bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab\": rpc error: code = NotFound desc = could not find container \"bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab\": container with ID starting with bc5925a843d5d462d7628fee689fa562c7f97d6f9082fc62f7584f98408514ab not found: ID does not exist"
Jul 30 22:59:08.805234 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.805195    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f95f67756-wnw4g"]
Jul 30 22:59:08.809576 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:08.809551    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f95f67756-wnw4g"]
Jul 30 22:59:09.540992 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:09.540957    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:59:09.649364 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:09.649282    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 22:59:10.697124 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:10.697094    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14314034-b7ad-467c-a6a0-ed9265d33584" path="/var/lib/kubelet/pods/14314034-b7ad-467c-a6a0-ed9265d33584/volumes"
Jul 30 22:59:35.860887 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:35.860850    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:59:46.249517 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:46.249482    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 22:59:57.463074 ip-10-0-135-246 kubenswrapper[2561]: I0730 22:59:57.463032    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:00:41.132551 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:00:41.132519    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:01:13.629941 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:01:13.629896    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:01:14.835465 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:01:14.835419    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:01:34.668199 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:01:34.668087    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:01:42.856686 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:01:42.856646    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:02:16.000264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:16.000226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:02:17.382743 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:17.382698    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:02:22.061813 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:22.061779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:02:22.167093 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:22.167050    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:02:22.262018 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:22.261979    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:02:22.409865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:22.409776    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:02:27.981549 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:27.981510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:02:28.080598 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:28.080558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:02:44.054194 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:44.054152    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:02:50.859245 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:02:50.859144    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:03:06.362401 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:03:06.362365    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:03:12.457792 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:03:12.457752    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:03:21.513125 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:03:21.513081    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:03:22.359301 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:03:22.359244    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:03:29.061422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:03:29.061385    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:03:42.462710 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:03:42.462673    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:03:47.759385 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:03:47.759354    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:03:52.761705 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:03:52.761655    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:04:14.660495 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:04:14.660459    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:04:25.262784 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:04:25.262706    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:04:40.946259 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:04:40.946222    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:04:41.001383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:04:41.001350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:04:48.157680 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:04:48.157629    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:04:58.554244 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:04:58.554212    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:05:04.260361 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:05:04.260324    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:05:13.062715 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:05:13.062675    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:05:22.577461 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:05:22.577424    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:05:23.865274 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:05:23.865240    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:05:29.960115 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:05:29.960076    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:05:38.757771 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:05:38.757733    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:05:47.253020 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:05:47.252976    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:05:58.858827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:05:58.858730    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:06:05.960629 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:06:05.960580    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:06:19.155634 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:06:19.155595    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:06:27.565506 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:06:27.565470    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:06:32.652557 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:06:32.652520    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:06:44.560038 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:06:44.559998    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:07:38.957989 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:38.957908    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"]
Jul 30 23:07:38.958539 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:38.958127    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278" podUID="f04336e6-f995-4f27-8bf6-e08c8e02206e" containerName="manager" containerID="cri-o://57df154fa84b008666ee5900601bd37527e8ff70f255a96eb773beb17786f2cd" gracePeriod=10
Jul 30 23:07:39.133729 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.133694    2561 generic.go:356] "Generic (PLEG): container finished" podID="f04336e6-f995-4f27-8bf6-e08c8e02206e" containerID="57df154fa84b008666ee5900601bd37527e8ff70f255a96eb773beb17786f2cd" exitCode=0
Jul 30 23:07:39.133885 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.133769    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278" event={"ID":"f04336e6-f995-4f27-8bf6-e08c8e02206e","Type":"ContainerDied","Data":"57df154fa84b008666ee5900601bd37527e8ff70f255a96eb773beb17786f2cd"}
Jul 30 23:07:39.204609 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.204582    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 23:07:39.272191 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.272137    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04336e6-f995-4f27-8bf6-e08c8e02206e-extensions-socket-volume\") pod \"f04336e6-f995-4f27-8bf6-e08c8e02206e\" (UID: \"f04336e6-f995-4f27-8bf6-e08c8e02206e\") "
Jul 30 23:07:39.272384 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.272280    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf97j\" (UniqueName: \"kubernetes.io/projected/f04336e6-f995-4f27-8bf6-e08c8e02206e-kube-api-access-sf97j\") pod \"f04336e6-f995-4f27-8bf6-e08c8e02206e\" (UID: \"f04336e6-f995-4f27-8bf6-e08c8e02206e\") "
Jul 30 23:07:39.272520 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.272496    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f04336e6-f995-4f27-8bf6-e08c8e02206e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f04336e6-f995-4f27-8bf6-e08c8e02206e" (UID: "f04336e6-f995-4f27-8bf6-e08c8e02206e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:07:39.272611 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.272596    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f04336e6-f995-4f27-8bf6-e08c8e02206e-extensions-socket-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:07:39.274382 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.274348    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f04336e6-f995-4f27-8bf6-e08c8e02206e-kube-api-access-sf97j" (OuterVolumeSpecName: "kube-api-access-sf97j") pod "f04336e6-f995-4f27-8bf6-e08c8e02206e" (UID: "f04336e6-f995-4f27-8bf6-e08c8e02206e"). InnerVolumeSpecName "kube-api-access-sf97j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:07:39.373254 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:39.373215    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf97j\" (UniqueName: \"kubernetes.io/projected/f04336e6-f995-4f27-8bf6-e08c8e02206e-kube-api-access-sf97j\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:07:40.139820 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:40.139791    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"
Jul 30 23:07:40.140273 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:40.139791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278" event={"ID":"f04336e6-f995-4f27-8bf6-e08c8e02206e","Type":"ContainerDied","Data":"f5bcd3c5bb00494823f23603248418d870eab05803495065044fad4f5fce575d"}
Jul 30 23:07:40.140273 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:40.139930    2561 scope.go:117] "RemoveContainer" containerID="57df154fa84b008666ee5900601bd37527e8ff70f255a96eb773beb17786f2cd"
Jul 30 23:07:40.160023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:40.160001    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"]
Jul 30 23:07:40.163719 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:40.163695    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-ft278"]
Jul 30 23:07:40.698301 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:07:40.698270    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f04336e6-f995-4f27-8bf6-e08c8e02206e" path="/var/lib/kubelet/pods/f04336e6-f995-4f27-8bf6-e08c8e02206e/volumes"
Jul 30 23:08:39.684845 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.684810    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"]
Jul 30 23:08:39.687434 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.685144    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f04336e6-f995-4f27-8bf6-e08c8e02206e" containerName="manager"
Jul 30 23:08:39.687434 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.685155    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f04336e6-f995-4f27-8bf6-e08c8e02206e" containerName="manager"
Jul 30 23:08:39.687434 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.685170    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14314034-b7ad-467c-a6a0-ed9265d33584" containerName="authorino"
Jul 30 23:08:39.687434 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.685189    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="14314034-b7ad-467c-a6a0-ed9265d33584" containerName="authorino"
Jul 30 23:08:39.687434 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.685242    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="14314034-b7ad-467c-a6a0-ed9265d33584" containerName="authorino"
Jul 30 23:08:39.687434 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.685252    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f04336e6-f995-4f27-8bf6-e08c8e02206e" containerName="manager"
Jul 30 23:08:39.688430 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.688414    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:39.691023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.691000    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tx2tw\""
Jul 30 23:08:39.700014 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.699989    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"]
Jul 30 23:08:39.821264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.821228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99bbfe6d-4f28-4190-97e3-bc6e5696e836-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-n5xbk\" (UID: \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:39.821438 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.821280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8b5l\" (UniqueName: \"kubernetes.io/projected/99bbfe6d-4f28-4190-97e3-bc6e5696e836-kube-api-access-z8b5l\") pod \"kuadrant-operator-controller-manager-68cf589589-n5xbk\" (UID: \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:39.922063 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.922016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99bbfe6d-4f28-4190-97e3-bc6e5696e836-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-n5xbk\" (UID: \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:39.922267 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.922084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8b5l\" (UniqueName: \"kubernetes.io/projected/99bbfe6d-4f28-4190-97e3-bc6e5696e836-kube-api-access-z8b5l\") pod \"kuadrant-operator-controller-manager-68cf589589-n5xbk\" (UID: \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:39.922479 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.922447    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99bbfe6d-4f28-4190-97e3-bc6e5696e836-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-n5xbk\" (UID: \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:39.932660 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.932628    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8b5l\" (UniqueName: \"kubernetes.io/projected/99bbfe6d-4f28-4190-97e3-bc6e5696e836-kube-api-access-z8b5l\") pod \"kuadrant-operator-controller-manager-68cf589589-n5xbk\" (UID: \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:39.998786 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:39.998683    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:40.134865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:40.134841    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"]
Jul 30 23:08:40.136662 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:08:40.136623    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99bbfe6d_4f28_4190_97e3_bc6e5696e836.slice/crio-7c2793c3fc81229aea34755c79ae0809237a8ce959f3d361e769bb09ac1ea3cb WatchSource:0}: Error finding container 7c2793c3fc81229aea34755c79ae0809237a8ce959f3d361e769bb09ac1ea3cb: Status 404 returned error can't find the container with id 7c2793c3fc81229aea34755c79ae0809237a8ce959f3d361e769bb09ac1ea3cb
Jul 30 23:08:40.408433 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:40.408400    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk" event={"ID":"99bbfe6d-4f28-4190-97e3-bc6e5696e836","Type":"ContainerStarted","Data":"7c82c46579608f4c55978e166cda2a0e6b68516504b1b10c871a8e2040933b3f"}
Jul 30 23:08:40.408629 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:40.408450    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk" event={"ID":"99bbfe6d-4f28-4190-97e3-bc6e5696e836","Type":"ContainerStarted","Data":"7c2793c3fc81229aea34755c79ae0809237a8ce959f3d361e769bb09ac1ea3cb"}
Jul 30 23:08:40.408629 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:40.408498    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:08:40.429732 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:40.429680    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk" podStartSLOduration=1.429663847 podStartE2EDuration="1.429663847s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:08:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:08:40.428148018 +0000 UTC m=+1244.159293221" watchObservedRunningTime="2026-07-30 23:08:40.429663847 +0000 UTC m=+1244.160809008"
Jul 30 23:08:51.414924 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:08:51.414895    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:09:01.461595 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:09:01.461563    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:09:08.464038 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:09:08.464002    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:09:30.755967 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:09:30.755935    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:09:42.548602 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:09:42.548561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:09:46.774642 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:09:46.774601    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:09:53.060881 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:09:53.060842    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:02.762501 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:02.762461    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:07.963524 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:07.963482    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:18.860396 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:18.860318    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:29.859547 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:29.859509    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:34.863408 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:34.863368    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:43.557749 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:43.557711    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:49.566616 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:49.566581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:54.564295 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:54.564258    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:10:58.897986 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:10:58.897953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:04.755134 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:04.755097    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:11:18.200422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:18.200385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:18.301014 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:18.300969    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:29.155694 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:29.155651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:11:34.163304 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:34.163266    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:11:39.745996 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.745960    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"]
Jul 30 23:11:39.749594 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.749570    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.752652 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.752632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-f6e6b135-kserve-self-signed-certs\""
Jul 30 23:11:39.768655 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.768627    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"]
Jul 30 23:11:39.768854 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.768825    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:39.789260 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.789214    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-home\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.789260 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.789263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvwvp\" (UniqueName: \"kubernetes.io/projected/fec9ef1d-e037-4d45-a512-00721af9044c-kube-api-access-qvwvp\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.789464 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.789366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-model-cache\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.789464 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.789395    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-dshm\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.789464 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.789411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec9ef1d-e037-4d45-a512-00721af9044c-tls-certs\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.789559 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.789489    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-tmp-dir\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.890795 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.890756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-home\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.890795 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.890797    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvwvp\" (UniqueName: \"kubernetes.io/projected/fec9ef1d-e037-4d45-a512-00721af9044c-kube-api-access-qvwvp\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.891020 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.890857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-model-cache\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.891020 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.890874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-dshm\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.891020 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.890890    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec9ef1d-e037-4d45-a512-00721af9044c-tls-certs\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.891165 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.891075    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-tmp-dir\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.891314 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.891224    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-home\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.891314 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.891277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-model-cache\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.891441 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.891421    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-tmp-dir\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.893237 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.893217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-dshm\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.893451 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.893435    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec9ef1d-e037-4d45-a512-00721af9044c-tls-certs\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:39.898928 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:39.898903    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvwvp\" (UniqueName: \"kubernetes.io/projected/fec9ef1d-e037-4d45-a512-00721af9044c-kube-api-access-qvwvp\") pod \"e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") " pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:40.059006 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:40.058971    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:40.196771 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:40.196735    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"]
Jul 30 23:11:40.199737 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:11:40.199707    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfec9ef1d_e037_4d45_a512_00721af9044c.slice/crio-9157b73218328d4441514a6bc46a3f163b5fc8b20ec071ccf10ee2bcd2de810d WatchSource:0}: Error finding container 9157b73218328d4441514a6bc46a3f163b5fc8b20ec071ccf10ee2bcd2de810d: Status 404 returned error can't find the container with id 9157b73218328d4441514a6bc46a3f163b5fc8b20ec071ccf10ee2bcd2de810d
Jul 30 23:11:40.240562 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:40.240534    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v" event={"ID":"fec9ef1d-e037-4d45-a512-00721af9044c","Type":"ContainerStarted","Data":"9157b73218328d4441514a6bc46a3f163b5fc8b20ec071ccf10ee2bcd2de810d"}
Jul 30 23:11:40.659931 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:40.659893    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:11:41.246794 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:41.246759    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v" event={"ID":"fec9ef1d-e037-4d45-a512-00721af9044c","Type":"ContainerStarted","Data":"8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f"}
Jul 30 23:11:41.265668 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:41.265617    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v" podStartSLOduration=2.265599629 podStartE2EDuration="2.265599629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:11:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:11:41.264670516 +0000 UTC m=+1424.995815669" watchObservedRunningTime="2026-07-30 23:11:41.265599629 +0000 UTC m=+1424.996744790"
Jul 30 23:11:50.059427 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:50.059385    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:50.059849 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:50.059452    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:50.072172 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:50.072144    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:50.300704 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:50.300675    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:11:50.486932 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:50.486840    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:11:52.646724 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.646688    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"]
Jul 30 23:11:52.650208 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.650169    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.653798 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.653781    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-f6e6b135-kserve-self-signed-certs\""
Jul 30 23:11:52.658242 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.658220    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"]
Jul 30 23:11:52.706143 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.706112    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-model-cache\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.706342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.706188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dkh7\" (UniqueName: \"kubernetes.io/projected/3f8bc57c-39f1-4759-862b-8254834befad-kube-api-access-7dkh7\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.706342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.706243    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f8bc57c-39f1-4759-862b-8254834befad-tls-certs\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.706342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.706286    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-dshm\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.706512 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.706375    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-home\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.706512 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.706494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-tmp-dir\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.742964 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.742928    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:52.807891 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.807850    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-model-cache\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.808070 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.807902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dkh7\" (UniqueName: \"kubernetes.io/projected/3f8bc57c-39f1-4759-862b-8254834befad-kube-api-access-7dkh7\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.808070 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.807929    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f8bc57c-39f1-4759-862b-8254834befad-tls-certs\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.808070 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.807990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-dshm\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.808070 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.808052    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-home\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.808305 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.808086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-tmp-dir\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.808364 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.808327    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-model-cache\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.808522 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.808489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-home\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.808596 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.808524    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-tmp-dir\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.810299 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.810276    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-dshm\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.810642 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.810623    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f8bc57c-39f1-4759-862b-8254834befad-tls-certs\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.817429 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.817400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dkh7\" (UniqueName: \"kubernetes.io/projected/3f8bc57c-39f1-4759-862b-8254834befad-kube-api-access-7dkh7\") pod \"e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") " pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:52.960499 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:52.960402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:11:53.095798 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:53.095571    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"]
Jul 30 23:11:53.098005 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:11:53.097977    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f8bc57c_39f1_4759_862b_8254834befad.slice/crio-37da2a8d72d820c2609e246fbef31d3d3ecaa0fb2c50227e85c97a93a88d61c9 WatchSource:0}: Error finding container 37da2a8d72d820c2609e246fbef31d3d3ecaa0fb2c50227e85c97a93a88d61c9: Status 404 returned error can't find the container with id 37da2a8d72d820c2609e246fbef31d3d3ecaa0fb2c50227e85c97a93a88d61c9
Jul 30 23:11:53.305350 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:53.305319    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg" event={"ID":"3f8bc57c-39f1-4759-862b-8254834befad","Type":"ContainerStarted","Data":"d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a"}
Jul 30 23:11:53.305537 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:53.305357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg" event={"ID":"3f8bc57c-39f1-4759-862b-8254834befad","Type":"ContainerStarted","Data":"37da2a8d72d820c2609e246fbef31d3d3ecaa0fb2c50227e85c97a93a88d61c9"}
Jul 30 23:11:53.322009 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:53.321959    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg" podStartSLOduration=1.321942615 podStartE2EDuration="1.321942615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:11:53.321046739 +0000 UTC m=+1437.052191899" watchObservedRunningTime="2026-07-30 23:11:53.321942615 +0000 UTC m=+1437.053087753"
Jul 30 23:11:56.834508 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:56.834473    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:11:59.861752 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:11:59.861720    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:12:02.960909 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:02.960865    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:12:02.960909 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:02.960921    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:12:02.973627 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:02.973600    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:12:03.363929 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:03.363895    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:12:35.509193 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:35.509134    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"]
Jul 30 23:12:36.222056 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:36.222022    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:36.931544 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:36.931508    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"]
Jul 30 23:12:36.952747 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:36.952697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:37.460308 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:37.460271    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:12:38.321000 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:38.320966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:38.422098 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:38.422061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:12:48.567084 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:48.567055    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:12:50.529702 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.529661    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v" podUID="fec9ef1d-e037-4d45-a512-00721af9044c" containerName="main" containerID="cri-o://8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f" gracePeriod=45
Jul 30 23:12:50.774302 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.774275    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:12:50.950799 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.950696    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvwvp\" (UniqueName: \"kubernetes.io/projected/fec9ef1d-e037-4d45-a512-00721af9044c-kube-api-access-qvwvp\") pod \"fec9ef1d-e037-4d45-a512-00721af9044c\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") "
Jul 30 23:12:50.950799 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.950746    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-dshm\") pod \"fec9ef1d-e037-4d45-a512-00721af9044c\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") "
Jul 30 23:12:50.950799 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.950775    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-model-cache\") pod \"fec9ef1d-e037-4d45-a512-00721af9044c\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") "
Jul 30 23:12:50.951078 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.950835    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-home\") pod \"fec9ef1d-e037-4d45-a512-00721af9044c\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") "
Jul 30 23:12:50.951078 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.950863    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec9ef1d-e037-4d45-a512-00721af9044c-tls-certs\") pod \"fec9ef1d-e037-4d45-a512-00721af9044c\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") "
Jul 30 23:12:50.951078 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.950921    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-tmp-dir\") pod \"fec9ef1d-e037-4d45-a512-00721af9044c\" (UID: \"fec9ef1d-e037-4d45-a512-00721af9044c\") "
Jul 30 23:12:50.951245 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.951100    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-home" (OuterVolumeSpecName: "home") pod "fec9ef1d-e037-4d45-a512-00721af9044c" (UID: "fec9ef1d-e037-4d45-a512-00721af9044c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:12:50.951245 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.951111    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-model-cache" (OuterVolumeSpecName: "model-cache") pod "fec9ef1d-e037-4d45-a512-00721af9044c" (UID: "fec9ef1d-e037-4d45-a512-00721af9044c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:12:50.951320 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.951256    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fec9ef1d-e037-4d45-a512-00721af9044c" (UID: "fec9ef1d-e037-4d45-a512-00721af9044c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:12:50.951320 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.951275    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:50.951320 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.951296    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:50.953085 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.953054    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-dshm" (OuterVolumeSpecName: "dshm") pod "fec9ef1d-e037-4d45-a512-00721af9044c" (UID: "fec9ef1d-e037-4d45-a512-00721af9044c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:12:50.953210 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.953096    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fec9ef1d-e037-4d45-a512-00721af9044c-kube-api-access-qvwvp" (OuterVolumeSpecName: "kube-api-access-qvwvp") pod "fec9ef1d-e037-4d45-a512-00721af9044c" (UID: "fec9ef1d-e037-4d45-a512-00721af9044c"). InnerVolumeSpecName "kube-api-access-qvwvp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:12:50.953210 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:50.953107    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fec9ef1d-e037-4d45-a512-00721af9044c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fec9ef1d-e037-4d45-a512-00721af9044c" (UID: "fec9ef1d-e037-4d45-a512-00721af9044c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:12:51.052399 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.052358    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvwvp\" (UniqueName: \"kubernetes.io/projected/fec9ef1d-e037-4d45-a512-00721af9044c-kube-api-access-qvwvp\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:51.052399 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.052392    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:51.052399 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.052401    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fec9ef1d-e037-4d45-a512-00721af9044c-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:51.052399 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.052410    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fec9ef1d-e037-4d45-a512-00721af9044c-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:51.581932 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.581895    2561 generic.go:356] "Generic (PLEG): container finished" podID="fec9ef1d-e037-4d45-a512-00721af9044c" containerID="8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f" exitCode=0
Jul 30 23:12:51.582369 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.581945    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"
Jul 30 23:12:51.582369 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.581944    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v" event={"ID":"fec9ef1d-e037-4d45-a512-00721af9044c","Type":"ContainerDied","Data":"8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f"}
Jul 30 23:12:51.582369 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.582050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v" event={"ID":"fec9ef1d-e037-4d45-a512-00721af9044c","Type":"ContainerDied","Data":"9157b73218328d4441514a6bc46a3f163b5fc8b20ec071ccf10ee2bcd2de810d"}
Jul 30 23:12:51.582369 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.582069    2561 scope.go:117] "RemoveContainer" containerID="8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f"
Jul 30 23:12:51.591146 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.591130    2561 scope.go:117] "RemoveContainer" containerID="8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f"
Jul 30 23:12:51.591402 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:12:51.591385    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f\": container with ID starting with 8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f not found: ID does not exist" containerID="8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f"
Jul 30 23:12:51.591455 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.591412    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f"} err="failed to get container status \"8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f\": rpc error: code = NotFound desc = could not find container \"8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f\": container with ID starting with 8a39645fcfc02b8bf625f05c6d11c5ca2c55d820b79002daa2258b136add106f not found: ID does not exist"
Jul 30 23:12:51.602546 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.602518    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"]
Jul 30 23:12:51.606945 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.606917    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-f6e6b135-kserve-68f9fdd975-trg2v"]
Jul 30 23:12:51.951058 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:51.950972    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg" podUID="3f8bc57c-39f1-4759-862b-8254834befad" containerName="main" containerID="cri-o://d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a" gracePeriod=45
Jul 30 23:12:52.202245 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.202167    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:12:52.363674 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.363637    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f8bc57c-39f1-4759-862b-8254834befad-tls-certs\") pod \"3f8bc57c-39f1-4759-862b-8254834befad\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") "
Jul 30 23:12:52.363674 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.363674    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-home\") pod \"3f8bc57c-39f1-4759-862b-8254834befad\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") "
Jul 30 23:12:52.363903 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.363708    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-dshm\") pod \"3f8bc57c-39f1-4759-862b-8254834befad\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") "
Jul 30 23:12:52.363903 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.363726    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-tmp-dir\") pod \"3f8bc57c-39f1-4759-862b-8254834befad\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") "
Jul 30 23:12:52.363903 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.363764    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-model-cache\") pod \"3f8bc57c-39f1-4759-862b-8254834befad\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") "
Jul 30 23:12:52.363903 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.363813    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dkh7\" (UniqueName: \"kubernetes.io/projected/3f8bc57c-39f1-4759-862b-8254834befad-kube-api-access-7dkh7\") pod \"3f8bc57c-39f1-4759-862b-8254834befad\" (UID: \"3f8bc57c-39f1-4759-862b-8254834befad\") "
Jul 30 23:12:52.364129 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.363997    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-home" (OuterVolumeSpecName: "home") pod "3f8bc57c-39f1-4759-862b-8254834befad" (UID: "3f8bc57c-39f1-4759-862b-8254834befad"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:12:52.364129 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.364072    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-model-cache" (OuterVolumeSpecName: "model-cache") pod "3f8bc57c-39f1-4759-862b-8254834befad" (UID: "3f8bc57c-39f1-4759-862b-8254834befad"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:12:52.364129 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.364085    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3f8bc57c-39f1-4759-862b-8254834befad" (UID: "3f8bc57c-39f1-4759-862b-8254834befad"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:12:52.365915 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.365875    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f8bc57c-39f1-4759-862b-8254834befad-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3f8bc57c-39f1-4759-862b-8254834befad" (UID: "3f8bc57c-39f1-4759-862b-8254834befad"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:12:52.366029 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.365915    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-dshm" (OuterVolumeSpecName: "dshm") pod "3f8bc57c-39f1-4759-862b-8254834befad" (UID: "3f8bc57c-39f1-4759-862b-8254834befad"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:12:52.366029 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.365944    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f8bc57c-39f1-4759-862b-8254834befad-kube-api-access-7dkh7" (OuterVolumeSpecName: "kube-api-access-7dkh7") pod "3f8bc57c-39f1-4759-862b-8254834befad" (UID: "3f8bc57c-39f1-4759-862b-8254834befad"). InnerVolumeSpecName "kube-api-access-7dkh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:12:52.465383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.465307    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dkh7\" (UniqueName: \"kubernetes.io/projected/3f8bc57c-39f1-4759-862b-8254834befad-kube-api-access-7dkh7\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:52.465383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.465336    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3f8bc57c-39f1-4759-862b-8254834befad-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:52.465383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.465347    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:52.465383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.465356    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:52.465383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.465365    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:52.465383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.465376    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3f8bc57c-39f1-4759-862b-8254834befad-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:12:52.588127 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.588087    2561 generic.go:356] "Generic (PLEG): container finished" podID="3f8bc57c-39f1-4759-862b-8254834befad" containerID="d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a" exitCode=0
Jul 30 23:12:52.588127 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.588131    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"
Jul 30 23:12:52.588660 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.588202    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg" event={"ID":"3f8bc57c-39f1-4759-862b-8254834befad","Type":"ContainerDied","Data":"d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a"}
Jul 30 23:12:52.588660 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.588249    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg" event={"ID":"3f8bc57c-39f1-4759-862b-8254834befad","Type":"ContainerDied","Data":"37da2a8d72d820c2609e246fbef31d3d3ecaa0fb2c50227e85c97a93a88d61c9"}
Jul 30 23:12:52.588660 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.588271    2561 scope.go:117] "RemoveContainer" containerID="d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a"
Jul 30 23:12:52.597796 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.597778    2561 scope.go:117] "RemoveContainer" containerID="d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a"
Jul 30 23:12:52.598116 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:12:52.598098    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a\": container with ID starting with d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a not found: ID does not exist" containerID="d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a"
Jul 30 23:12:52.598204 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.598122    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a"} err="failed to get container status \"d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a\": rpc error: code = NotFound desc = could not find container \"d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a\": container with ID starting with d6f2e0cf4ec3c8f7a07343672feea7984f6685dc9936f335b97e2112072b638a not found: ID does not exist"
Jul 30 23:12:52.609545 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.609506    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"]
Jul 30 23:12:52.613232 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.613207    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-f6e6b135-kserve-5888c75bd7-dnnhg"]
Jul 30 23:12:52.697782 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.697747    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f8bc57c-39f1-4759-862b-8254834befad" path="/var/lib/kubelet/pods/3f8bc57c-39f1-4759-862b-8254834befad/volumes"
Jul 30 23:12:52.698207 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.698193    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fec9ef1d-e037-4d45-a512-00721af9044c" path="/var/lib/kubelet/pods/fec9ef1d-e037-4d45-a512-00721af9044c/volumes"
Jul 30 23:12:52.757112 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:52.757082    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:12:59.357217 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:12:59.357162    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:13:09.158166 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:13:09.158132    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:13:16.502357 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:13:16.502321    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:13:27.166295 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:13:27.166211    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:13:33.659837 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:13:33.659800    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:13:46.464713 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:13:46.464673    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:13:52.655900 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:13:52.655856    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:14:01.063838 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:14:01.063799    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:14:07.061272 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:14:07.061238    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:14:14.861522 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:14:14.861479    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:14:27.460295 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:14:27.460256    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:14:32.558985 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:14:32.558949    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:14:39.162356 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:14:39.162314    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:14:44.658747 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:14:44.658709    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:14:51.166783 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:14:51.166700    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:15:00.063617 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:15:00.063581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:15:07.864342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:15:07.864295    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:15:17.166920 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:15:17.166884    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:15:24.664512 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:15:24.664477    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:15:34.455515 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:15:34.455482    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:15:49.953691 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:15:49.953655    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:15:55.761152 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:15:55.761114    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:15:59.472601 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:15:59.472566    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:02.361156 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:02.361122    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:16:13.764370 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:13.764328    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:16:22.466168 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:22.466088    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:16:25.450360 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:25.450323    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:27.761139 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:27.761099    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:16:28.667124 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:28.667079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:28.771827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:28.771789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:29.232465 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:29.232433    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:34.732557 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:34.732518    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:34.797543 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:34.797510    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:34.969677 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:34.969644    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:35.299428 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:35.299394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:35.501833 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:35.501782    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:38.105869 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:38.105836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:38.204100 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:38.204067    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:39.388158 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:39.388117    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:39.853120 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:39.853085    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:39.955113 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:39.955072    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:40.056150 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:40.056097    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:16:41.862723 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:41.862688    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:16:59.417474 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:16:59.417437    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:09.766673 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:09.766641    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:09.829254 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:09.829188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:09.891494 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:09.891454    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:09.953360 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:09.953324    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:10.082364 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:10.082272    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:10.316400 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:10.316367    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:10.590671 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:10.590634    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:10.689153 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:10.689104    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:10.796370 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:10.796328    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:11.120748 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:11.120711    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:11.326660 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:11.326623    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:12.653383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:12.653352    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:17:13.466040 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:13.466003    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:13.645731 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:13.645694    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:14.091640 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:14.091606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:14.193364 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:14.193330    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:19.667060 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:19.667023    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:17:44.989776 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:44.989743    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:45.089112 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:45.089078    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:45.153782 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:45.153748    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:45.210475 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:45.210430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:45.341451 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:45.341416    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:45.564223 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:45.564104    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:45.786025 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:45.785979    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:46.134740 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:46.134702    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:46.377825 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:46.377787    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:47.853788 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:47.853746    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:17:48.569453 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:48.569368    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:48.663845 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:48.663808    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:49.696991 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:49.696953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:49.940739 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:49.940697    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:50.282865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:50.282835    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:50.378352 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:50.378306    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:17:55.759813 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:17:55.759776    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:18:20.293114 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:20.293073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:20.357023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:20.356990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:20.413308 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:20.413269    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:20.470773 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:20.470738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:21.715162 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:21.715130    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:21.955775 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:21.955734    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:22.194394 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:22.194361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:22.537560 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:22.537524    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:22.916843 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:22.916758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:23.161912 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:23.161876    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:18:24.822990 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:24.822950    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:24.920296 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:24.920263    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:25.939470 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:25.939430    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:26.436739 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:26.436701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:26.518930 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:26.518895    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:29.365851 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:29.365804    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:18:50.676931 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:50.676891    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:56.403508 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:56.403469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:56.508502 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:56.508467    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:56.572552 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:56.572517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:56.633746 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:56.633703    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:56.779439 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:56.779409    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:57.009192 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:57.009156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:57.519977 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:57.519929    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:57.607731 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:57.607700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:57.706041 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:57.705996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:18:59.428240 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:18:59.428173    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:19:09.443037 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:09.442989    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:12.263982 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:12.263937    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:19:15.947851 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:15.947812    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:16.051486 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:16.051444    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:16.147712 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:16.147675    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:16.273362 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:16.273330    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:16.713993 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:16.713906    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:42.725748 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:42.725657    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:48.742737 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:48.742700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:48.846885 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:48.846843    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:19:48.987194 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:19:48.987154    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:05.003698 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:05.003657    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:10.897739 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:10.897693    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:11.004187 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:11.004128    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:11.115723 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:11.115681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:21.658462 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:21.658425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:32.784874 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:32.784837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:38.706851 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:38.706814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:38.777034 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:38.776996    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:38.851888 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:38.851854    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:38.954035 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:38.954000    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:39.053325 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:39.053275    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:39.687287 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:39.687254    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:39.855457 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:39.855422    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:39.956216 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:39.956095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:41.434822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:41.434772    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:45.958251 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:45.958216    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:20:47.268924 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:47.268889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:47.368735 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:47.368700    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:47.928818 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:47.928781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:50.065811 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:50.065724    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:20:54.042157 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:54.042116    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:54.142695 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:54.142666    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:54.286981 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:54.286945    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:54.630481 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:54.630448    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:54.692155 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:54.692124    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:57.625950 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:57.625916    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:57.726299 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:57.726266    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:58.752643 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:58.752605    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:59.073398 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:59.073305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:59.242245 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:59.242206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:20:59.339547 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:20:59.339464    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:01.655992 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:01.655953    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:21:22.667942 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:22.667899    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:23.968187 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:23.968154    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:29.428459 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:29.428418    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:29.495292 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:29.495255    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:40.481801 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:40.481764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:40.556613 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:40.556555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:40.623372 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:40.623335    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:40.686721 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:40.686686    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:41.081852 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:41.081812    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:42.658366 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:42.658330    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:21:46.735011 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:46.734973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:46.794367 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:46.794332    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:47.000706 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:47.000664    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:47.242364 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:47.242309    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:47.369978 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:47.369889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:47.471464 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:47.471428    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:47.611865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:47.611823    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:53.464892 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:53.464855    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:53.526237 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:53.526203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:53.596112 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:53.596073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:53.700419 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:53.700385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:53.826367 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:53.826330    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:59.392571 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:59.392532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:21:59.460651 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:21:59.460616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:11.906784 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:11.906739    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:12.007016 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:12.006967    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:14.311667 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:14.311635    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:21.360853 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:21.360763    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:22:24.061012 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:24.060980    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:22:27.990589 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:27.990556    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"]
Jul 30 23:22:27.991037 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:27.990806    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk" podUID="99bbfe6d-4f28-4190-97e3-bc6e5696e836" containerName="manager" containerID="cri-o://7c82c46579608f4c55978e166cda2a0e6b68516504b1b10c871a8e2040933b3f" gracePeriod=10
Jul 30 23:22:28.212846 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.212813    2561 generic.go:356] "Generic (PLEG): container finished" podID="99bbfe6d-4f28-4190-97e3-bc6e5696e836" containerID="7c82c46579608f4c55978e166cda2a0e6b68516504b1b10c871a8e2040933b3f" exitCode=0
Jul 30 23:22:28.212846 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.212838    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk" event={"ID":"99bbfe6d-4f28-4190-97e3-bc6e5696e836","Type":"ContainerDied","Data":"7c82c46579608f4c55978e166cda2a0e6b68516504b1b10c871a8e2040933b3f"}
Jul 30 23:22:28.252678 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.252641    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:22:28.273002 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.272970    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8b5l\" (UniqueName: \"kubernetes.io/projected/99bbfe6d-4f28-4190-97e3-bc6e5696e836-kube-api-access-z8b5l\") pod \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\" (UID: \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\") "
Jul 30 23:22:28.273258 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.273029    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99bbfe6d-4f28-4190-97e3-bc6e5696e836-extensions-socket-volume\") pod \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\" (UID: \"99bbfe6d-4f28-4190-97e3-bc6e5696e836\") "
Jul 30 23:22:28.273455 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.273425    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99bbfe6d-4f28-4190-97e3-bc6e5696e836-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "99bbfe6d-4f28-4190-97e3-bc6e5696e836" (UID: "99bbfe6d-4f28-4190-97e3-bc6e5696e836"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:22:28.275835 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.275806    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99bbfe6d-4f28-4190-97e3-bc6e5696e836-kube-api-access-z8b5l" (OuterVolumeSpecName: "kube-api-access-z8b5l") pod "99bbfe6d-4f28-4190-97e3-bc6e5696e836" (UID: "99bbfe6d-4f28-4190-97e3-bc6e5696e836"). InnerVolumeSpecName "kube-api-access-z8b5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:22:28.374497 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.374437    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8b5l\" (UniqueName: \"kubernetes.io/projected/99bbfe6d-4f28-4190-97e3-bc6e5696e836-kube-api-access-z8b5l\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:22:28.374497 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:28.374487    2561 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/99bbfe6d-4f28-4190-97e3-bc6e5696e836-extensions-socket-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:22:29.218775 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:29.218742    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"
Jul 30 23:22:29.218775 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:29.218770    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk" event={"ID":"99bbfe6d-4f28-4190-97e3-bc6e5696e836","Type":"ContainerDied","Data":"7c2793c3fc81229aea34755c79ae0809237a8ce959f3d361e769bb09ac1ea3cb"}
Jul 30 23:22:29.219335 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:29.218827    2561 scope.go:117] "RemoveContainer" containerID="7c82c46579608f4c55978e166cda2a0e6b68516504b1b10c871a8e2040933b3f"
Jul 30 23:22:29.236956 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:29.236927    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"]
Jul 30 23:22:29.242294 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:29.242267    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-n5xbk"]
Jul 30 23:22:30.696741 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:22:30.696698    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99bbfe6d-4f28-4190-97e3-bc6e5696e836" path="/var/lib/kubelet/pods/99bbfe6d-4f28-4190-97e3-bc6e5696e836/volumes"
Jul 30 23:23:03.206604 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:03.206562    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:23:43.674202 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674151    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"]
Jul 30 23:23:43.674822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674687    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99bbfe6d-4f28-4190-97e3-bc6e5696e836" containerName="manager"
Jul 30 23:23:43.674822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674708    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="99bbfe6d-4f28-4190-97e3-bc6e5696e836" containerName="manager"
Jul 30 23:23:43.674822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674722    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fec9ef1d-e037-4d45-a512-00721af9044c" containerName="main"
Jul 30 23:23:43.674822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674731    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fec9ef1d-e037-4d45-a512-00721af9044c" containerName="main"
Jul 30 23:23:43.674822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674741    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f8bc57c-39f1-4759-862b-8254834befad" containerName="main"
Jul 30 23:23:43.674822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674750    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f8bc57c-39f1-4759-862b-8254834befad" containerName="main"
Jul 30 23:23:43.674822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674825    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fec9ef1d-e037-4d45-a512-00721af9044c" containerName="main"
Jul 30 23:23:43.675173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674837    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f8bc57c-39f1-4759-862b-8254834befad" containerName="main"
Jul 30 23:23:43.675173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.674849    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="99bbfe6d-4f28-4190-97e3-bc6e5696e836" containerName="manager"
Jul 30 23:23:43.677998 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.677970    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:43.688387 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.688362    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tx2tw\""
Jul 30 23:23:43.699308 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.699279    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"]
Jul 30 23:23:43.854741 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.854696    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc3976b-e4fa-42ee-94a8-7cb17af9645b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-8t855\" (UID: \"ebc3976b-e4fa-42ee-94a8-7cb17af9645b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:43.854913 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.854777    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzn9w\" (UniqueName: \"kubernetes.io/projected/ebc3976b-e4fa-42ee-94a8-7cb17af9645b-kube-api-access-mzn9w\") pod \"kuadrant-operator-controller-manager-68cf589589-8t855\" (UID: \"ebc3976b-e4fa-42ee-94a8-7cb17af9645b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:43.956139 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.956025    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzn9w\" (UniqueName: \"kubernetes.io/projected/ebc3976b-e4fa-42ee-94a8-7cb17af9645b-kube-api-access-mzn9w\") pod \"kuadrant-operator-controller-manager-68cf589589-8t855\" (UID: \"ebc3976b-e4fa-42ee-94a8-7cb17af9645b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:43.956139 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.956132    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc3976b-e4fa-42ee-94a8-7cb17af9645b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-8t855\" (UID: \"ebc3976b-e4fa-42ee-94a8-7cb17af9645b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:43.956532 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.956511    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebc3976b-e4fa-42ee-94a8-7cb17af9645b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-8t855\" (UID: \"ebc3976b-e4fa-42ee-94a8-7cb17af9645b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:43.965581 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.965559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzn9w\" (UniqueName: \"kubernetes.io/projected/ebc3976b-e4fa-42ee-94a8-7cb17af9645b-kube-api-access-mzn9w\") pod \"kuadrant-operator-controller-manager-68cf589589-8t855\" (UID: \"ebc3976b-e4fa-42ee-94a8-7cb17af9645b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:43.987909 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:43.987874    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:44.127770 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:44.127744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"]
Jul 30 23:23:44.130417 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:23:44.130385    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebc3976b_e4fa_42ee_94a8_7cb17af9645b.slice/crio-70f19bea67c8f9327401235fcb904db333f8007a64f25d0d56adfdb61662b61c WatchSource:0}: Error finding container 70f19bea67c8f9327401235fcb904db333f8007a64f25d0d56adfdb61662b61c: Status 404 returned error can't find the container with id 70f19bea67c8f9327401235fcb904db333f8007a64f25d0d56adfdb61662b61c
Jul 30 23:23:44.549785 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:44.549734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855" event={"ID":"ebc3976b-e4fa-42ee-94a8-7cb17af9645b","Type":"ContainerStarted","Data":"414ee8be05cc392623ccc5563aaca1d76f01f3542f49c7f7f50e1296769a8f20"}
Jul 30 23:23:44.549974 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:44.549808    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855" event={"ID":"ebc3976b-e4fa-42ee-94a8-7cb17af9645b","Type":"ContainerStarted","Data":"70f19bea67c8f9327401235fcb904db333f8007a64f25d0d56adfdb61662b61c"}
Jul 30 23:23:44.549974 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:44.549848    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:23:44.571610 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:44.571557    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855" podStartSLOduration=1.571537979 podStartE2EDuration="1.571537979s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:23:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:23:44.56925562 +0000 UTC m=+2148.300400796" watchObservedRunningTime="2026-07-30 23:23:44.571537979 +0000 UTC m=+2148.302683139"
Jul 30 23:23:55.563196 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:23:55.563149    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-8t855"
Jul 30 23:24:02.161806 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:02.161766    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:02.479722 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:02.479620    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:02.579823 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:02.579785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:05.327925 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:05.327887    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:05.428342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:05.428305    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:05.564347 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:05.564305    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:24:06.465073 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:06.465032    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:06.642429 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:06.642390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:07.216309 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:07.216263    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:07.326308 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:07.326268    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:13.764739 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:13.764702    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:24:30.359427 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:30.359383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:37.140288 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.140256    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"]
Jul 30 23:24:37.143665 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.143646    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.148610 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.148583    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d04222a5\"/\"default-dockercfg-j4lcn\""
Jul 30 23:24:37.148751 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.148623    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d04222a5\"/\"openshift-service-ca.crt\""
Jul 30 23:24:37.148751 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.148593    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-d04222a5\"/\"kube-root-ca.crt\""
Jul 30 23:24:37.148751 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.148690    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-d04222a5\"/\"e2e-lifecycle-model-d04222a5-kserve-self-signed-certs\""
Jul 30 23:24:37.155400 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.155378    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"]
Jul 30 23:24:37.179988 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.179953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:24:37.239335 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.239295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-home\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.239335 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.239332    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-tmp-dir\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.239696 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.239390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-model-cache\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.239696 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.239420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/712749e7-200d-4cbf-920b-48db59b8f338-tls-certs\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.239696 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.239463    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-dshm\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.239696 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.239482    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jggv\" (UniqueName: \"kubernetes.io/projected/712749e7-200d-4cbf-920b-48db59b8f338-kube-api-access-9jggv\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.340425 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.340385    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-model-cache\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.340425 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.340438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/712749e7-200d-4cbf-920b-48db59b8f338-tls-certs\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.340692 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.340497    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-dshm\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.340692 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.340527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jggv\" (UniqueName: \"kubernetes.io/projected/712749e7-200d-4cbf-920b-48db59b8f338-kube-api-access-9jggv\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.340692 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.340598    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-home\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.340692 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.340621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-tmp-dir\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.340923 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.340868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-model-cache\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.341013 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.340979    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-home\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.341061 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.341019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-tmp-dir\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.342955 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.342931    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-dshm\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.343093 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.343075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/712749e7-200d-4cbf-920b-48db59b8f338-tls-certs\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.349596 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.349566    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jggv\" (UniqueName: \"kubernetes.io/projected/712749e7-200d-4cbf-920b-48db59b8f338-kube-api-access-9jggv\") pod \"e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") " pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.453199 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.453075    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:37.590393 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.590360    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"]
Jul 30 23:24:37.593595 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:24:37.593561    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod712749e7_200d_4cbf_920b_48db59b8f338.slice/crio-3f92802fa60886618bb2cf728e3f374b63e1d90ee71ec752dfa79227f7de34a8 WatchSource:0}: Error finding container 3f92802fa60886618bb2cf728e3f374b63e1d90ee71ec752dfa79227f7de34a8: Status 404 returned error can't find the container with id 3f92802fa60886618bb2cf728e3f374b63e1d90ee71ec752dfa79227f7de34a8
Jul 30 23:24:37.802203 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.802144    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg" event={"ID":"712749e7-200d-4cbf-920b-48db59b8f338","Type":"ContainerStarted","Data":"170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8"}
Jul 30 23:24:37.802380 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.802208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg" event={"ID":"712749e7-200d-4cbf-920b-48db59b8f338","Type":"ContainerStarted","Data":"3f92802fa60886618bb2cf728e3f374b63e1d90ee71ec752dfa79227f7de34a8"}
Jul 30 23:24:37.820606 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:37.820561    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg" podStartSLOduration=0.82054508 podStartE2EDuration="820.54508ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:24:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:24:37.818978529 +0000 UTC m=+2201.550123692" watchObservedRunningTime="2026-07-30 23:24:37.82054508 +0000 UTC m=+2201.551690240"
Jul 30 23:24:39.663717 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:39.663681    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:24:47.453857 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:47.453815    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:47.454328 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:47.453877    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:47.466261 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:47.466229    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:47.860083 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:47.860046    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:24:56.058973 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:24:56.058931    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:25:17.967800 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:17.967768    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:25:20.485621 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:20.485544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:20.569121 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:20.569083    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:20.637677 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:20.637645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:20.738763 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:20.738673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:23.761242 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:23.761203    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:25:24.034545 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:24.034449    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:29.014011 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:29.013971    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"]
Jul 30 23:25:29.057540 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:29.057504    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:41.551452 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:41.551405    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:25:44.033959 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.033908    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg" podUID="712749e7-200d-4cbf-920b-48db59b8f338" containerName="main" containerID="cri-o://170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8" gracePeriod=45
Jul 30 23:25:44.286688 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.286625    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:25:44.363762 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.363728    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-dshm\") pod \"712749e7-200d-4cbf-920b-48db59b8f338\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") "
Jul 30 23:25:44.363762 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.363768    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-model-cache\") pod \"712749e7-200d-4cbf-920b-48db59b8f338\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") "
Jul 30 23:25:44.364026 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.363790    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-tmp-dir\") pod \"712749e7-200d-4cbf-920b-48db59b8f338\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") "
Jul 30 23:25:44.364026 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.363822    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jggv\" (UniqueName: \"kubernetes.io/projected/712749e7-200d-4cbf-920b-48db59b8f338-kube-api-access-9jggv\") pod \"712749e7-200d-4cbf-920b-48db59b8f338\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") "
Jul 30 23:25:44.364026 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.363846    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-home\") pod \"712749e7-200d-4cbf-920b-48db59b8f338\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") "
Jul 30 23:25:44.364026 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.363903    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/712749e7-200d-4cbf-920b-48db59b8f338-tls-certs\") pod \"712749e7-200d-4cbf-920b-48db59b8f338\" (UID: \"712749e7-200d-4cbf-920b-48db59b8f338\") "
Jul 30 23:25:44.364268 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.364060    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-model-cache" (OuterVolumeSpecName: "model-cache") pod "712749e7-200d-4cbf-920b-48db59b8f338" (UID: "712749e7-200d-4cbf-920b-48db59b8f338"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:44.364268 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.364137    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "712749e7-200d-4cbf-920b-48db59b8f338" (UID: "712749e7-200d-4cbf-920b-48db59b8f338"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:44.364268 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.364165    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:25:44.364473 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.364451    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-home" (OuterVolumeSpecName: "home") pod "712749e7-200d-4cbf-920b-48db59b8f338" (UID: "712749e7-200d-4cbf-920b-48db59b8f338"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:44.366143 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.366117    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-dshm" (OuterVolumeSpecName: "dshm") pod "712749e7-200d-4cbf-920b-48db59b8f338" (UID: "712749e7-200d-4cbf-920b-48db59b8f338"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:25:44.366275 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.366138    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/712749e7-200d-4cbf-920b-48db59b8f338-kube-api-access-9jggv" (OuterVolumeSpecName: "kube-api-access-9jggv") pod "712749e7-200d-4cbf-920b-48db59b8f338" (UID: "712749e7-200d-4cbf-920b-48db59b8f338"). InnerVolumeSpecName "kube-api-access-9jggv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:25:44.366275 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.366162    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/712749e7-200d-4cbf-920b-48db59b8f338-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "712749e7-200d-4cbf-920b-48db59b8f338" (UID: "712749e7-200d-4cbf-920b-48db59b8f338"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:25:44.464919 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.464881    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/712749e7-200d-4cbf-920b-48db59b8f338-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:25:44.464919 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.464910    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:25:44.464919 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.464918    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:25:44.464919 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.464927    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jggv\" (UniqueName: \"kubernetes.io/projected/712749e7-200d-4cbf-920b-48db59b8f338-kube-api-access-9jggv\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:25:44.465215 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:44.464936    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/712749e7-200d-4cbf-920b-48db59b8f338-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:25:45.108227 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.108172    2561 generic.go:356] "Generic (PLEG): container finished" podID="712749e7-200d-4cbf-920b-48db59b8f338" containerID="170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8" exitCode=0
Jul 30 23:25:45.108227 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.108224    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"
Jul 30 23:25:45.108708 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.108270    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg" event={"ID":"712749e7-200d-4cbf-920b-48db59b8f338","Type":"ContainerDied","Data":"170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8"}
Jul 30 23:25:45.108708 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.108312    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg" event={"ID":"712749e7-200d-4cbf-920b-48db59b8f338","Type":"ContainerDied","Data":"3f92802fa60886618bb2cf728e3f374b63e1d90ee71ec752dfa79227f7de34a8"}
Jul 30 23:25:45.108708 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.108330    2561 scope.go:117] "RemoveContainer" containerID="170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8"
Jul 30 23:25:45.116836 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.116819    2561 scope.go:117] "RemoveContainer" containerID="170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8"
Jul 30 23:25:45.117105 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:25:45.117085    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8\": container with ID starting with 170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8 not found: ID does not exist" containerID="170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8"
Jul 30 23:25:45.117158 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.117111    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8"} err="failed to get container status \"170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8\": rpc error: code = NotFound desc = could not find container \"170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8\": container with ID starting with 170340c5b9c3c5215d677c2758a8651e83dfab2907096b45205d1ac5197ecfb8 not found: ID does not exist"
Jul 30 23:25:45.124630 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.124608    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"]
Jul 30 23:25:45.128519 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:45.128494    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-d04222a5/e2e-lifecycle-model-d04222a5-kserve-75f4c59787-fwdpg"]
Jul 30 23:25:46.697353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:25:46.697322    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="712749e7-200d-4cbf-920b-48db59b8f338" path="/var/lib/kubelet/pods/712749e7-200d-4cbf-920b-48db59b8f338/volumes"
Jul 30 23:26:05.336664 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:05.336628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:06.246396 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:06.246339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:11.711287 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:11.711245    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:11.813100 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:11.813062    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:12.010750 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:12.010717    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:12.251290 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:12.251255    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:14.064801 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:14.062029    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:26:23.595668 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:23.595626    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:23.689536 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:23.689490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:23.789582 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:23.789540    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:24.438935 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:24.438902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:25.828345 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:25.828311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:25.977679 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:25.977633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:26.164717 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:26.164631    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:26:32.204258 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:32.204223    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:32.269337 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:32.269303    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:32.872778 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:32.872746    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:34.063424 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:34.063384    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:26:39.502536 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:39.502494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:39.608895 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:39.608856    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:39.702678 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:39.702640    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:50.263986 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:50.263896    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:26:50.498077 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:26:50.498044    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:11.497127 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:11.497088    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:17.837702 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:17.837659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:17.935681 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:17.935642    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:18.214927 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:18.214803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:18.573832 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:18.573790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:18.734879 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:18.734847    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:21.410691 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:21.410632    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:21.513583 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:21.513545    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:22.695287 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:22.695253    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:22.919276 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:22.919227    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:23.281484 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:23.281447    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:23.482542 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:23.482509    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:25.470473 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:25.470434    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:27:46.412567 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:46.412525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:46.743519 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:46.743429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:47.057800 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:47.057766    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:47.404676 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:47.404574    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:49.516445 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:49.516406    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:49.617478 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:49.617423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:50.770825 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:50.770751    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:50.964964 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:50.964924    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:51.237836 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:51.237749    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:51.328168 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:51.328129    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:27:53.157241 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:27:53.157193    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:28:14.494726 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:14.494692    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:28:19.341403 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.341322    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"]
Jul 30 23:28:19.341789 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.341660    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="712749e7-200d-4cbf-920b-48db59b8f338" containerName="main"
Jul 30 23:28:19.341789 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.341672    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="712749e7-200d-4cbf-920b-48db59b8f338" containerName="main"
Jul 30 23:28:19.341789 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.341731    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="712749e7-200d-4cbf-920b-48db59b8f338" containerName="main"
Jul 30 23:28:19.344825 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.344807    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.348449 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.348421    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2f122f\"/\"test-model-2f122f-kserve-self-signed-certs\""
Jul 30 23:28:19.348612 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.348486    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2f122f\"/\"openshift-service-ca.crt\""
Jul 30 23:28:19.348612 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.348486    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-2f122f\"/\"default-dockercfg-jn62x\""
Jul 30 23:28:19.348612 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.348490    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-2f122f\"/\"kube-root-ca.crt\""
Jul 30 23:28:19.355940 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.355913    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"]
Jul 30 23:28:19.371048 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.371012    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:28:19.452831 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.452792    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb3735c-872d-42d7-a94e-62867dbdee44-tls-certs\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.453010 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.452850    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-home\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.453010 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.452934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-model-cache\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.453010 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.452972    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-tmp-dir\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.453114 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.453020    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-dshm\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.453114 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.453050    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct94x\" (UniqueName: \"kubernetes.io/projected/deb3735c-872d-42d7-a94e-62867dbdee44-kube-api-access-ct94x\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.553947 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.553907    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-model-cache\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.554159 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.553964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-tmp-dir\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.554159 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.553998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-dshm\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.554159 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.554027    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct94x\" (UniqueName: \"kubernetes.io/projected/deb3735c-872d-42d7-a94e-62867dbdee44-kube-api-access-ct94x\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.554159 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.554089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb3735c-872d-42d7-a94e-62867dbdee44-tls-certs\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.554159 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.554135    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-home\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.554488 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.554406    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-tmp-dir\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.554488 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.554413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-model-cache\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.554581 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.554503    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-home\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.556434 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.556413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-dshm\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.556598 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.556583    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb3735c-872d-42d7-a94e-62867dbdee44-tls-certs\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.563407 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.563383    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct94x\" (UniqueName: \"kubernetes.io/projected/deb3735c-872d-42d7-a94e-62867dbdee44-kube-api-access-ct94x\") pod \"test-model-2f122f-kserve-7d695b64c5-rg97w\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") " pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.654102 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.653984    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:19.795988 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.795955    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"]
Jul 30 23:28:19.800901 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:28:19.800864    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddeb3735c_872d_42d7_a94e_62867dbdee44.slice/crio-64691e08a1857ea2db09383e68657336bd96e4b5428a2bc42a39195d0499e52a WatchSource:0}: Error finding container 64691e08a1857ea2db09383e68657336bd96e4b5428a2bc42a39195d0499e52a: Status 404 returned error can't find the container with id 64691e08a1857ea2db09383e68657336bd96e4b5428a2bc42a39195d0499e52a
Jul 30 23:28:19.809489 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:19.809458    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w" event={"ID":"deb3735c-872d-42d7-a94e-62867dbdee44","Type":"ContainerStarted","Data":"64691e08a1857ea2db09383e68657336bd96e4b5428a2bc42a39195d0499e52a"}
Jul 30 23:28:20.815673 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:20.815629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w" event={"ID":"deb3735c-872d-42d7-a94e-62867dbdee44","Type":"ContainerStarted","Data":"6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452"}
Jul 30 23:28:20.833317 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:20.833263    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w" podStartSLOduration=1.833243844 podStartE2EDuration="1.833243844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:28:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:28:20.831458321 +0000 UTC m=+2424.562603483" watchObservedRunningTime="2026-07-30 23:28:20.833243844 +0000 UTC m=+2424.564388983"
Jul 30 23:28:22.564757 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:22.564715    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:28:29.654480 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:29.654422    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:29.654480 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:29.654488    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:29.667296 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:29.667264    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:29.872650 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:29.872615    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:28:43.440391 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.440357    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"]
Jul 30 23:28:43.443879 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.443857    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.448153 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.448131    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fcdf3e\"/\"kube-root-ca.crt\""
Jul 30 23:28:43.449350 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.449324    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fcdf3e\"/\"default-dockercfg-h87v6\""
Jul 30 23:28:43.449458 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.449376    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-fcdf3e\"/\"openshift-service-ca.crt\""
Jul 30 23:28:43.449510 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.449451    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-fcdf3e\"/\"test-model-fcdf3e-kserve-self-signed-certs\""
Jul 30 23:28:43.457795 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.457771    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"]
Jul 30 23:28:43.537325 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.537294    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:28:43.570766 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.570734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htc2v\" (UniqueName: \"kubernetes.io/projected/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-kube-api-access-htc2v\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.570766 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.570772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-home\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.571010 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.570827    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tls-certs\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.571010 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.570886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tmp-dir\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.571010 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.570920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-dshm\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.571010 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.570957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-model-cache\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.671818 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.671779    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htc2v\" (UniqueName: \"kubernetes.io/projected/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-kube-api-access-htc2v\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.671818 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.671821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-home\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.672097 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.671853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tls-certs\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.672097 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.671905    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tmp-dir\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.672097 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.671934    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-dshm\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.672097 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.672050    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-model-cache\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.672342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.672277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-home\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.672342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.672295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tmp-dir\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.672470 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.672454    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-model-cache\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.674188 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.674161    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-dshm\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.674454 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.674438    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tls-certs\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.679676 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.679654    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htc2v\" (UniqueName: \"kubernetes.io/projected/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-kube-api-access-htc2v\") pod \"test-model-fcdf3e-kserve-857997c9d7-vxlmm\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") " pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.753458 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.753425    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:43.888861 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.888835    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"]
Jul 30 23:28:43.891450 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:28:43.891424    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f87cb6a_2c19_4b13_8f01_9d2cfc9a35f9.slice/crio-5a4ceeead85668694beecca28c1558817f5d59fd65489e9d44fab54d0e5b13b7 WatchSource:0}: Error finding container 5a4ceeead85668694beecca28c1558817f5d59fd65489e9d44fab54d0e5b13b7: Status 404 returned error can't find the container with id 5a4ceeead85668694beecca28c1558817f5d59fd65489e9d44fab54d0e5b13b7
Jul 30 23:28:43.925418 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:43.925382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm" event={"ID":"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9","Type":"ContainerStarted","Data":"5a4ceeead85668694beecca28c1558817f5d59fd65489e9d44fab54d0e5b13b7"}
Jul 30 23:28:44.931984 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:44.931943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm" event={"ID":"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9","Type":"ContainerStarted","Data":"8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739"}
Jul 30 23:28:44.948789 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:44.948735    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm" podStartSLOduration=1.9487179380000001 podStartE2EDuration="1.948717938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:28:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:28:44.948060579 +0000 UTC m=+2448.679205742" watchObservedRunningTime="2026-07-30 23:28:44.948717938 +0000 UTC m=+2448.679863099"
Jul 30 23:28:46.459634 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:46.459591    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:28:53.753991 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:53.753945    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:53.754455 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:53.754008    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:53.766743 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:53.766714    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:53.984833 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:53.984803    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:28:54.956260 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:28:54.956221    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:29:06.269105 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:06.269064    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:23.819805 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:23.819771    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"]
Jul 30 23:29:23.841155 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:23.841127    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:24.899099 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:24.899064    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"]
Jul 30 23:29:24.925336 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:24.925304    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:27.353480 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:27.353441    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:29:35.617941 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:35.617905    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:35.686774 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:35.686735    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:35.787200 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:35.787136    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:35.849638 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:35.849601    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:36.193805 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:36.193774    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:37.772087 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:37.772049    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:29:38.839564 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:38.839517    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w" podUID="deb3735c-872d-42d7-a94e-62867dbdee44" containerName="main" containerID="cri-o://6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452" gracePeriod=45
Jul 30 23:29:39.095995 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.095919    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:29:39.181403 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.181364    2561 generic.go:356] "Generic (PLEG): container finished" podID="deb3735c-872d-42d7-a94e-62867dbdee44" containerID="6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452" exitCode=0
Jul 30 23:29:39.181596 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.181412    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"
Jul 30 23:29:39.181596 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.181425    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w" event={"ID":"deb3735c-872d-42d7-a94e-62867dbdee44","Type":"ContainerDied","Data":"6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452"}
Jul 30 23:29:39.181596 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.181478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w" event={"ID":"deb3735c-872d-42d7-a94e-62867dbdee44","Type":"ContainerDied","Data":"64691e08a1857ea2db09383e68657336bd96e4b5428a2bc42a39195d0499e52a"}
Jul 30 23:29:39.181596 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.181498    2561 scope.go:117] "RemoveContainer" containerID="6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452"
Jul 30 23:29:39.189913 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.189889    2561 scope.go:117] "RemoveContainer" containerID="6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452"
Jul 30 23:29:39.190242 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:29:39.190220    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452\": container with ID starting with 6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452 not found: ID does not exist" containerID="6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452"
Jul 30 23:29:39.190309 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.190252    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452"} err="failed to get container status \"6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452\": rpc error: code = NotFound desc = could not find container \"6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452\": container with ID starting with 6f531a45ee2c7a53a898bf6b16690260b4d623fd4dfbffcdeeac333a116d4452 not found: ID does not exist"
Jul 30 23:29:39.196493 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.196465    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb3735c-872d-42d7-a94e-62867dbdee44-tls-certs\") pod \"deb3735c-872d-42d7-a94e-62867dbdee44\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") "
Jul 30 23:29:39.196614 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.196505    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-dshm\") pod \"deb3735c-872d-42d7-a94e-62867dbdee44\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") "
Jul 30 23:29:39.196614 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.196546    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct94x\" (UniqueName: \"kubernetes.io/projected/deb3735c-872d-42d7-a94e-62867dbdee44-kube-api-access-ct94x\") pod \"deb3735c-872d-42d7-a94e-62867dbdee44\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") "
Jul 30 23:29:39.196680 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.196646    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-model-cache\") pod \"deb3735c-872d-42d7-a94e-62867dbdee44\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") "
Jul 30 23:29:39.196721 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.196707    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-home\") pod \"deb3735c-872d-42d7-a94e-62867dbdee44\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") "
Jul 30 23:29:39.196776 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.196730    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-tmp-dir\") pod \"deb3735c-872d-42d7-a94e-62867dbdee44\" (UID: \"deb3735c-872d-42d7-a94e-62867dbdee44\") "
Jul 30 23:29:39.197018 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.196987    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-model-cache" (OuterVolumeSpecName: "model-cache") pod "deb3735c-872d-42d7-a94e-62867dbdee44" (UID: "deb3735c-872d-42d7-a94e-62867dbdee44"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:29:39.197018 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.197004    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-home" (OuterVolumeSpecName: "home") pod "deb3735c-872d-42d7-a94e-62867dbdee44" (UID: "deb3735c-872d-42d7-a94e-62867dbdee44"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:29:39.197173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.197085    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "deb3735c-872d-42d7-a94e-62867dbdee44" (UID: "deb3735c-872d-42d7-a94e-62867dbdee44"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:29:39.198918 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.198888    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/deb3735c-872d-42d7-a94e-62867dbdee44-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "deb3735c-872d-42d7-a94e-62867dbdee44" (UID: "deb3735c-872d-42d7-a94e-62867dbdee44"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:29:39.198918 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.198901    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-dshm" (OuterVolumeSpecName: "dshm") pod "deb3735c-872d-42d7-a94e-62867dbdee44" (UID: "deb3735c-872d-42d7-a94e-62867dbdee44"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:29:39.199082 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.198913    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/deb3735c-872d-42d7-a94e-62867dbdee44-kube-api-access-ct94x" (OuterVolumeSpecName: "kube-api-access-ct94x") pod "deb3735c-872d-42d7-a94e-62867dbdee44" (UID: "deb3735c-872d-42d7-a94e-62867dbdee44"). InnerVolumeSpecName "kube-api-access-ct94x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:29:39.297477 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.297439    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct94x\" (UniqueName: \"kubernetes.io/projected/deb3735c-872d-42d7-a94e-62867dbdee44-kube-api-access-ct94x\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:39.297477 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.297470    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:39.297477 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.297480    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:39.297477 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.297488    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:39.297757 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.297496    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/deb3735c-872d-42d7-a94e-62867dbdee44-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:39.297757 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.297503    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/deb3735c-872d-42d7-a94e-62867dbdee44-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:39.503422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.503389    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"]
Jul 30 23:29:39.510799 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.510768    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-2f122f/test-model-2f122f-kserve-7d695b64c5-rg97w"]
Jul 30 23:29:39.918929 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:39.918862    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm" podUID="0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" containerName="main" containerID="cri-o://8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739" gracePeriod=45
Jul 30 23:29:40.174770 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.174707    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:29:40.189044 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.189009    2561 generic.go:356] "Generic (PLEG): container finished" podID="0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" containerID="8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739" exitCode=0
Jul 30 23:29:40.189216 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.189057    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"
Jul 30 23:29:40.189216 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.189056    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm" event={"ID":"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9","Type":"ContainerDied","Data":"8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739"}
Jul 30 23:29:40.189216 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.189102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm" event={"ID":"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9","Type":"ContainerDied","Data":"5a4ceeead85668694beecca28c1558817f5d59fd65489e9d44fab54d0e5b13b7"}
Jul 30 23:29:40.189216 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.189121    2561 scope.go:117] "RemoveContainer" containerID="8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739"
Jul 30 23:29:40.201763 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.201738    2561 scope.go:117] "RemoveContainer" containerID="8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739"
Jul 30 23:29:40.202307 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:29:40.202276    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739\": container with ID starting with 8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739 not found: ID does not exist" containerID="8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739"
Jul 30 23:29:40.202414 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.202319    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739"} err="failed to get container status \"8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739\": rpc error: code = NotFound desc = could not find container \"8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739\": container with ID starting with 8ee72f03bff6393f43e819d98b797f8c2b89d7655d3313d9facae34dd2d13739 not found: ID does not exist"
Jul 30 23:29:40.308065 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308025    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-model-cache\") pod \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") "
Jul 30 23:29:40.308306 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308081    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tls-certs\") pod \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") "
Jul 30 23:29:40.308306 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308117    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-dshm\") pod \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") "
Jul 30 23:29:40.308306 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308228    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tmp-dir\") pod \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") "
Jul 30 23:29:40.308306 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308261    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-home\") pod \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") "
Jul 30 23:29:40.308306 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308289    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htc2v\" (UniqueName: \"kubernetes.io/projected/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-kube-api-access-htc2v\") pod \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\" (UID: \"0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9\") "
Jul 30 23:29:40.308569 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308400    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" (UID: "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:29:40.308639 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308565    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-home" (OuterVolumeSpecName: "home") pod "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" (UID: "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:29:40.308639 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308576    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" (UID: "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:29:40.308639 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.308600    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:40.310621 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.310595    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" (UID: "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:29:40.310744 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.310620    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-dshm" (OuterVolumeSpecName: "dshm") pod "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" (UID: "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:29:40.310744 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.310637    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-kube-api-access-htc2v" (OuterVolumeSpecName: "kube-api-access-htc2v") pod "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" (UID: "0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9"). InnerVolumeSpecName "kube-api-access-htc2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:29:40.409846 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.409803    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:40.409846 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.409842    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:40.409846 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.409856    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:40.410095 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.409868    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:40.410095 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.409890    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htc2v\" (UniqueName: \"kubernetes.io/projected/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9-kube-api-access-htc2v\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:29:40.510994 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.510961    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"]
Jul 30 23:29:40.513125 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.513098    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-fcdf3e/test-model-fcdf3e-kserve-857997c9d7-vxlmm"]
Jul 30 23:29:40.697171 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.697131    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" path="/var/lib/kubelet/pods/0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9/volumes"
Jul 30 23:29:40.697654 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:40.697633    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="deb3735c-872d-42d7-a94e-62867dbdee44" path="/var/lib/kubelet/pods/deb3735c-872d-42d7-a94e-62867dbdee44/volumes"
Jul 30 23:29:42.183601 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:42.183561    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:42.246259 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:42.246221    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:42.458469 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:42.458371    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:42.671716 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:42.671677    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:53.237853 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:53.237762    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:53.306647 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:53.306612    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:53.412906 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:53.412873    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:53.481925 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:53.481884    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:53.853281 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:53.853238    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:55.555516 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:55.555481    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:29:59.768872 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:59.768833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:29:59.827729 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:29:59.827668    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:00.050506 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:00.050413    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:00.262289 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:00.262252    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:00.595172 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:00.595135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:00.924352 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:00.924260    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:01.071829 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:01.071790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:04.275599 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:04.275555    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:04.374097 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:04.374063    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:05.411095 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:05.411059    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:05.790690 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:05.790658    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:05.950165 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:05.950135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:06.043913 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:06.043823    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:07.957464 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:07.957427    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:30:12.308055 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:12.308011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:29.259701 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:29.259659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:29.781095 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:29.781054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:30.088030 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:30.087941    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:30.406222 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:30.406101    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:33.466465 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:33.466429    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:33.570759 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:33.570724    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:34.589567 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:34.589528    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:34.884923 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:34.884816    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:35.177214 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:35.177080    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:35.279193 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:35.279140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:30:37.265290 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:37.265252    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:30:58.926393 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:30:58.926354    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:01.316733 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.316695    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"]
Jul 30 23:31:01.317264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.317038    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" containerName="main"
Jul 30 23:31:01.317264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.317049    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" containerName="main"
Jul 30 23:31:01.317264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.317070    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="deb3735c-872d-42d7-a94e-62867dbdee44" containerName="main"
Jul 30 23:31:01.317264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.317076    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="deb3735c-872d-42d7-a94e-62867dbdee44" containerName="main"
Jul 30 23:31:01.317264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.317141    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="deb3735c-872d-42d7-a94e-62867dbdee44" containerName="main"
Jul 30 23:31:01.317264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.317152    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f87cb6a-2c19-4b13-8f01-9d2cfc9a35f9" containerName="main"
Jul 30 23:31:01.320160 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.320141    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"
Jul 30 23:31:01.322654 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.322628    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\""
Jul 30 23:31:01.322802 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.322629    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:31:01.326836 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.326803    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"]
Jul 30 23:31:01.447527 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.447487    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f5ef76-1390-47cf-b722-1b28da093dee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl\" (UID: \"c2f5ef76-1390-47cf-b722-1b28da093dee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"
Jul 30 23:31:01.548289 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.548243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f5ef76-1390-47cf-b722-1b28da093dee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl\" (UID: \"c2f5ef76-1390-47cf-b722-1b28da093dee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"
Jul 30 23:31:01.548847 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.548825    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f5ef76-1390-47cf-b722-1b28da093dee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl\" (UID: \"c2f5ef76-1390-47cf-b722-1b28da093dee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"
Jul 30 23:31:01.632078 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.631973    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"
Jul 30 23:31:01.770262 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.770191    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"]
Jul 30 23:31:01.772640 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:31:01.772603    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f5ef76_1390_47cf_b722_1b28da093dee.slice/crio-9cc3254de88bc0c8c976f570f5c6b9f68e5c5cc1d76b6dfd873892892fa67009 WatchSource:0}: Error finding container 9cc3254de88bc0c8c976f570f5c6b9f68e5c5cc1d76b6dfd873892892fa67009: Status 404 returned error can't find the container with id 9cc3254de88bc0c8c976f570f5c6b9f68e5c5cc1d76b6dfd873892892fa67009
Jul 30 23:31:01.774706 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:01.774689    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:31:02.565876 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:02.565830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl" event={"ID":"c2f5ef76-1390-47cf-b722-1b28da093dee","Type":"ContainerStarted","Data":"9cc3254de88bc0c8c976f570f5c6b9f68e5c5cc1d76b6dfd873892892fa67009"}
Jul 30 23:31:04.577847 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:04.577739    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl" event={"ID":"c2f5ef76-1390-47cf-b722-1b28da093dee","Type":"ContainerStarted","Data":"811ef6158e411148fe922c21576ab6edf998cc5a748b9e3c44c20c51c0c72bb3"}
Jul 30 23:31:04.594169 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:04.594110    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl" podStartSLOduration=1.30812463 podStartE2EDuration="3.594092303s" totalImagesPullingTime="2.285967673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:31:04.592766032 +0000 UTC m=+2588.323911194" watchObservedRunningTime="2026-07-30 23:31:04.594092303 +0000 UTC m=+2588.325237500"
Jul 30 23:31:05.583718 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:05.583682    2561 generic.go:356] "Generic (PLEG): container finished" podID="c2f5ef76-1390-47cf-b722-1b28da093dee" containerID="811ef6158e411148fe922c21576ab6edf998cc5a748b9e3c44c20c51c0c72bb3" exitCode=0
Jul 30 23:31:05.584151 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:05.583767    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl" event={"ID":"c2f5ef76-1390-47cf-b722-1b28da093dee","Type":"ContainerDied","Data":"811ef6158e411148fe922c21576ab6edf998cc5a748b9e3c44c20c51c0c72bb3"}
Jul 30 23:31:06.719870 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:06.719840    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"
Jul 30 23:31:06.794798 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:06.794759    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f5ef76-1390-47cf-b722-1b28da093dee-maas-api-service-ca\") pod \"c2f5ef76-1390-47cf-b722-1b28da093dee\" (UID: \"c2f5ef76-1390-47cf-b722-1b28da093dee\") "
Jul 30 23:31:06.795108 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:06.795085    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2f5ef76-1390-47cf-b722-1b28da093dee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c2f5ef76-1390-47cf-b722-1b28da093dee" (UID: "c2f5ef76-1390-47cf-b722-1b28da093dee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:31:06.896427 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:06.896349    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2f5ef76-1390-47cf-b722-1b28da093dee-maas-api-service-ca\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:31:07.594887 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:07.594851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl" event={"ID":"c2f5ef76-1390-47cf-b722-1b28da093dee","Type":"ContainerDied","Data":"9cc3254de88bc0c8c976f570f5c6b9f68e5c5cc1d76b6dfd873892892fa67009"}
Jul 30 23:31:07.594887 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:07.594874    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"
Jul 30 23:31:07.595100 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:07.594902    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9cc3254de88bc0c8c976f570f5c6b9f68e5c5cc1d76b6dfd873892892fa67009"
Jul 30 23:31:16.778305 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:16.778246    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:16.841819 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:16.841781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:16.931173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:16.931135    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"]
Jul 30 23:31:16.933733 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:16.933708    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-0ff11c-hcfdl"]
Jul 30 23:31:16.951946 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:16.951914    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:17.026775 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:17.026733    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:17.312709 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:17.312673    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:18.697225 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:18.697104    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2f5ef76-1390-47cf-b722-1b28da093dee" path="/var/lib/kubelet/pods/c2f5ef76-1390-47cf-b722-1b28da093dee/volumes"
Jul 30 23:31:19.454823 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:19.454787    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:31:23.222305 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:23.222173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:23.282240 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:23.282206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:23.479510 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:23.479415    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:23.703524 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:23.703485    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:39.281407 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:39.281363    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:40.588080 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:40.588046    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:41.497400 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:41.497367    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:31:44.951507 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:44.951465    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:45.595305 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:45.595275    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:45.696891 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:45.696862    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:45.856872 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:45.856781    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:46.074822 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:46.074785    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:46.408847 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:46.408814    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:46.709334 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:46.709225    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:47.082916 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:47.082878    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:49.915766 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:49.915731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:50.012473 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:50.012437    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:51.199291 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:51.199253    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:51.615823 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:51.615790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:51.799869 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:51.799834    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:51.866400 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:51.866314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:53.760207 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:53.760158    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:31:55.754511 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:55.754474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:31:55.854352 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:31:55.854315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:20.055053 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:20.055013    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:20.403213 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:20.403111    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:20.706024 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:20.705932    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:20.879656 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:20.879622    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:24.107271 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:24.107238    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:24.208136 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:24.208105    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:25.377403 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:25.377361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:25.677623 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:25.677530    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:25.843416 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:25.843372    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:25.937232 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:25.937140    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:27.863760 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:27.863725    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:32:38.174903 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:38.174864    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:49.068681 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:49.068577    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:58.239641 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.239600    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"]
Jul 30 23:32:58.240188 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.240074    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2f5ef76-1390-47cf-b722-1b28da093dee" containerName="revoke-keys"
Jul 30 23:32:58.240188 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.240090    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2f5ef76-1390-47cf-b722-1b28da093dee" containerName="revoke-keys"
Jul 30 23:32:58.240188 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.240166    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2f5ef76-1390-47cf-b722-1b28da093dee" containerName="revoke-keys"
Jul 30 23:32:58.242051 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.242033    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.246240 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.246215    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"default-dockercfg-plrdn\""
Jul 30 23:32:58.246367 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.246240    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"kube-root-ca.crt\""
Jul 30 23:32:58.246367 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.246218    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"openshift-service-ca.crt\""
Jul 30 23:32:58.246367 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.246223    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"auth-test-model-5049e4-kserve-self-signed-certs\""
Jul 30 23:32:58.251038 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.251018    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"]
Jul 30 23:32:58.263841 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.263805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:32:58.409809 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.409765    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tls-certs\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.409809 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.409810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-model-cache\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.410067 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.409875    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-home\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.410067 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.409910    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-dshm\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.410067 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.409969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tmp-dir\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.410067 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.410027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ts7lv\" (UniqueName: \"kubernetes.io/projected/0f915fc3-7f71-4b67-baa8-655f384ebb5b-kube-api-access-ts7lv\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.510671 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.510632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tmp-dir\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.510865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.510695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ts7lv\" (UniqueName: \"kubernetes.io/projected/0f915fc3-7f71-4b67-baa8-655f384ebb5b-kube-api-access-ts7lv\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.510865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.510773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tls-certs\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.510865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.510799    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-model-cache\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.510865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.510828    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-home\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.510865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.510851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-dshm\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.511159 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.511135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tmp-dir\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.511266 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.511243    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-home\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.511309 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.511266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-model-cache\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.513162 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.513132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-dshm\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.513361 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.513347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tls-certs\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.518630 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.518608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ts7lv\" (UniqueName: \"kubernetes.io/projected/0f915fc3-7f71-4b67-baa8-655f384ebb5b-kube-api-access-ts7lv\") pod \"auth-test-model-5049e4-kserve-9596697d7-dc9zf\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") " pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.554063 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.554030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:32:58.687477 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:58.687304    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"]
Jul 30 23:32:58.690531 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:32:58.690499    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0f915fc3_7f71_4b67_baa8_655f384ebb5b.slice/crio-3212eae29c76d9e34ff1ffa24e751e2c94fbbe83a307fe8c26f313b6fe6bafcc WatchSource:0}: Error finding container 3212eae29c76d9e34ff1ffa24e751e2c94fbbe83a307fe8c26f313b6fe6bafcc: Status 404 returned error can't find the container with id 3212eae29c76d9e34ff1ffa24e751e2c94fbbe83a307fe8c26f313b6fe6bafcc
Jul 30 23:32:59.101467 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:59.101431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf" event={"ID":"0f915fc3-7f71-4b67-baa8-655f384ebb5b","Type":"ContainerStarted","Data":"617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96"}
Jul 30 23:32:59.101467 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:59.101476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf" event={"ID":"0f915fc3-7f71-4b67-baa8-655f384ebb5b","Type":"ContainerStarted","Data":"3212eae29c76d9e34ff1ffa24e751e2c94fbbe83a307fe8c26f313b6fe6bafcc"}
Jul 30 23:32:59.118919 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:32:59.118862    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf" podStartSLOduration=1.118846021 podStartE2EDuration="1.118846021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:32:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:32:59.117310933 +0000 UTC m=+2702.848456106" watchObservedRunningTime="2026-07-30 23:32:59.118846021 +0000 UTC m=+2702.849991181"
Jul 30 23:33:00.760937 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:00.760898    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:33:08.554708 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:08.554678    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:33:08.555121 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:08.554727    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:33:08.567075 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:08.567051    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:33:09.157646 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:09.157606    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:33:24.954029 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:24.953991    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"]
Jul 30 23:33:24.957898 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:24.957865    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:24.961858 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:24.961829    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"openshift-service-ca.crt\""
Jul 30 23:33:24.962019 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:24.961833    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"auth-test-model-f6f660-kserve-self-signed-certs\""
Jul 30 23:33:24.962019 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:24.961874    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"kube-root-ca.crt\""
Jul 30 23:33:24.962019 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:24.961973    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"default-dockercfg-tk592\""
Jul 30 23:33:24.966661 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:24.966633    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"]
Jul 30 23:33:24.988621 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:24.988586    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:33:25.036654 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.036618    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-dshm\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.036861 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.036677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tls-certs\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.036861 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.036713    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2xpf\" (UniqueName: \"kubernetes.io/projected/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-kube-api-access-b2xpf\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.036861 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.036811    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tmp-dir\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.036861 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.036858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-home\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.037048 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.036920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-model-cache\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.137598 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.137552    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-model-cache\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.137807 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.137711    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-dshm\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.137807 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.137761    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tls-certs\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.137807 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.137784    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2xpf\" (UniqueName: \"kubernetes.io/projected/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-kube-api-access-b2xpf\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.137987 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.137825    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tmp-dir\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.137987 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.137853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-home\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.138089 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.137996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-model-cache\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.138197 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.138140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tmp-dir\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.138297 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.138277    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-home\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.140001 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.139978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-dshm\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.140412 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.140393    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tls-certs\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.145860 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.145842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2xpf\" (UniqueName: \"kubernetes.io/projected/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-kube-api-access-b2xpf\") pod \"auth-test-model-f6f660-kserve-7f45c48459-rkl25\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") " pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.268758 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.268715    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:25.410774 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:25.410731    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"]
Jul 30 23:33:25.413772 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:33:25.413742    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5267fa6_9b0b_4866_823b_5be9dcf7ea7f.slice/crio-2696271cc1fe0d30ca6f9ef33acee050a8cb6fc1c1ea6699c42da02bf06950ce WatchSource:0}: Error finding container 2696271cc1fe0d30ca6f9ef33acee050a8cb6fc1c1ea6699c42da02bf06950ce: Status 404 returned error can't find the container with id 2696271cc1fe0d30ca6f9ef33acee050a8cb6fc1c1ea6699c42da02bf06950ce
Jul 30 23:33:26.227842 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:26.227801    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25" event={"ID":"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f","Type":"ContainerStarted","Data":"9cdd9af323c56d5ff11090531591720ff26fb14d0e5edf1c7222acdd222cd39a"}
Jul 30 23:33:26.228363 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:26.227853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25" event={"ID":"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f","Type":"ContainerStarted","Data":"2696271cc1fe0d30ca6f9ef33acee050a8cb6fc1c1ea6699c42da02bf06950ce"}
Jul 30 23:33:26.245515 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:26.245459    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25" podStartSLOduration=2.245442156 podStartE2EDuration="2.245442156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:33:26.243549737 +0000 UTC m=+2729.974694892" watchObservedRunningTime="2026-07-30 23:33:26.245442156 +0000 UTC m=+2729.976587316"
Jul 30 23:33:27.660276 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:27.660235    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:33:35.268871 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:35.268838    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:35.269509 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:35.268889    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:35.282003 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:35.281975    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:36.285563 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:36.285529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:33:54.457799 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:33:54.457764    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:34:09.863828 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:34:09.863785    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:34:22.062857 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:34:22.062777    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:34:36.465618 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:34:36.465578    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:34:48.066090 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:34:48.066047    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:35:02.968379 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:35:02.968342    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:35:13.762163 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:35:13.762127    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:35:29.169307 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:35:29.169275    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:35:40.266389 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:35:40.266352    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:35:55.370238 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:35:55.370145    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:36:05.954775 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:05.954736    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:36:13.758962 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:13.758924    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:36:27.064015 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:27.063973    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:36:31.096982 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:31.096945    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"]
Jul 30 23:36:31.146495 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:31.146457    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:31.971280 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:31.971243    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"]
Jul 30 23:36:31.989273 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:31.989229    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:36.868338 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:36.868301    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:36:46.117698 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.117652    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf" podUID="0f915fc3-7f71-4b67-baa8-655f384ebb5b" containerName="main" containerID="cri-o://617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96" gracePeriod=45
Jul 30 23:36:46.366658 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.366632    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:36:46.447905 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.447795    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tls-certs\") pod \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") "
Jul 30 23:36:46.447905 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.447847    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tmp-dir\") pod \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") "
Jul 30 23:36:46.447905 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.447876    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-home\") pod \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") "
Jul 30 23:36:46.448204 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.447937    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ts7lv\" (UniqueName: \"kubernetes.io/projected/0f915fc3-7f71-4b67-baa8-655f384ebb5b-kube-api-access-ts7lv\") pod \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") "
Jul 30 23:36:46.448204 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.448000    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-model-cache\") pod \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") "
Jul 30 23:36:46.448204 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.448035    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-dshm\") pod \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\" (UID: \"0f915fc3-7f71-4b67-baa8-655f384ebb5b\") "
Jul 30 23:36:46.448204 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.448102    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0f915fc3-7f71-4b67-baa8-655f384ebb5b" (UID: "0f915fc3-7f71-4b67-baa8-655f384ebb5b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:36:46.448423 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.448218    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-home" (OuterVolumeSpecName: "home") pod "0f915fc3-7f71-4b67-baa8-655f384ebb5b" (UID: "0f915fc3-7f71-4b67-baa8-655f384ebb5b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:36:46.448423 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.448331    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-model-cache" (OuterVolumeSpecName: "model-cache") pod "0f915fc3-7f71-4b67-baa8-655f384ebb5b" (UID: "0f915fc3-7f71-4b67-baa8-655f384ebb5b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:36:46.448423 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.448395    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:46.448423 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.448413    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:46.450158 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.450138    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-dshm" (OuterVolumeSpecName: "dshm") pod "0f915fc3-7f71-4b67-baa8-655f384ebb5b" (UID: "0f915fc3-7f71-4b67-baa8-655f384ebb5b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:36:46.450229 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.450214    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f915fc3-7f71-4b67-baa8-655f384ebb5b-kube-api-access-ts7lv" (OuterVolumeSpecName: "kube-api-access-ts7lv") pod "0f915fc3-7f71-4b67-baa8-655f384ebb5b" (UID: "0f915fc3-7f71-4b67-baa8-655f384ebb5b"). InnerVolumeSpecName "kube-api-access-ts7lv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:36:46.450304 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.450288    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0f915fc3-7f71-4b67-baa8-655f384ebb5b" (UID: "0f915fc3-7f71-4b67-baa8-655f384ebb5b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:36:46.549805 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.549765    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:46.549805 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.549797    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0f915fc3-7f71-4b67-baa8-655f384ebb5b-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:46.549805 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.549807    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0f915fc3-7f71-4b67-baa8-655f384ebb5b-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:46.549805 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.549816    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ts7lv\" (UniqueName: \"kubernetes.io/projected/0f915fc3-7f71-4b67-baa8-655f384ebb5b-kube-api-access-ts7lv\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:46.991524 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:46.991436    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25" podUID="c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" containerName="main" containerID="cri-o://9cdd9af323c56d5ff11090531591720ff26fb14d0e5edf1c7222acdd222cd39a" gracePeriod=45
Jul 30 23:36:47.186265 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.186231    2561 generic.go:356] "Generic (PLEG): container finished" podID="0f915fc3-7f71-4b67-baa8-655f384ebb5b" containerID="617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96" exitCode=0
Jul 30 23:36:47.186725 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.186302    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"
Jul 30 23:36:47.186725 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.186321    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf" event={"ID":"0f915fc3-7f71-4b67-baa8-655f384ebb5b","Type":"ContainerDied","Data":"617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96"}
Jul 30 23:36:47.186725 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.186376    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf" event={"ID":"0f915fc3-7f71-4b67-baa8-655f384ebb5b","Type":"ContainerDied","Data":"3212eae29c76d9e34ff1ffa24e751e2c94fbbe83a307fe8c26f313b6fe6bafcc"}
Jul 30 23:36:47.186725 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.186407    2561 scope.go:117] "RemoveContainer" containerID="617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96"
Jul 30 23:36:47.188476 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.188449    2561 generic.go:356] "Generic (PLEG): container finished" podID="c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" containerID="9cdd9af323c56d5ff11090531591720ff26fb14d0e5edf1c7222acdd222cd39a" exitCode=0
Jul 30 23:36:47.188669 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.188627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25" event={"ID":"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f","Type":"ContainerDied","Data":"9cdd9af323c56d5ff11090531591720ff26fb14d0e5edf1c7222acdd222cd39a"}
Jul 30 23:36:47.196748 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.196732    2561 scope.go:117] "RemoveContainer" containerID="617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96"
Jul 30 23:36:47.197027 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:36:47.197008    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96\": container with ID starting with 617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96 not found: ID does not exist" containerID="617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96"
Jul 30 23:36:47.197132 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.197037    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96"} err="failed to get container status \"617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96\": rpc error: code = NotFound desc = could not find container \"617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96\": container with ID starting with 617916ebd1c08f58405bf1eb01fc5fbfa1b335b5814fd87c74b5cd0142fe4c96 not found: ID does not exist"
Jul 30 23:36:47.202125 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.202102    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"]
Jul 30 23:36:47.205625 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.205601    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/auth-test-model-5049e4-kserve-9596697d7-dc9zf"]
Jul 30 23:36:47.242980 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.242911    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:36:47.356550 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356510    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tls-certs\") pod \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") "
Jul 30 23:36:47.356750 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356564    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2xpf\" (UniqueName: \"kubernetes.io/projected/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-kube-api-access-b2xpf\") pod \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") "
Jul 30 23:36:47.356750 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356587    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-model-cache\") pod \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") "
Jul 30 23:36:47.356750 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356617    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tmp-dir\") pod \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") "
Jul 30 23:36:47.356750 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356658    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-home\") pod \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") "
Jul 30 23:36:47.356750 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356737    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-dshm\") pod \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\" (UID: \"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f\") "
Jul 30 23:36:47.356999 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356897    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" (UID: "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:36:47.356999 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356970    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-home" (OuterVolumeSpecName: "home") pod "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" (UID: "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:36:47.357098 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.356925    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-model-cache" (OuterVolumeSpecName: "model-cache") pod "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" (UID: "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:36:47.357098 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.357085    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:47.357220 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.357106    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:47.357220 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.357118    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:47.358809 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.358785    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" (UID: "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:36:47.358984 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.358966    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-dshm" (OuterVolumeSpecName: "dshm") pod "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" (UID: "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:36:47.358984 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.358977    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-kube-api-access-b2xpf" (OuterVolumeSpecName: "kube-api-access-b2xpf") pod "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" (UID: "c5267fa6-9b0b-4866-823b-5be9dcf7ea7f"). InnerVolumeSpecName "kube-api-access-b2xpf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:36:47.458633 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.458589    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2xpf\" (UniqueName: \"kubernetes.io/projected/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-kube-api-access-b2xpf\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:47.458633 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.458621    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:47.458633 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:47.458632    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:36:48.194598 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.194569    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"
Jul 30 23:36:48.194598 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.194578    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25" event={"ID":"c5267fa6-9b0b-4866-823b-5be9dcf7ea7f","Type":"ContainerDied","Data":"2696271cc1fe0d30ca6f9ef33acee050a8cb6fc1c1ea6699c42da02bf06950ce"}
Jul 30 23:36:48.195171 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.194621    2561 scope.go:117] "RemoveContainer" containerID="9cdd9af323c56d5ff11090531591720ff26fb14d0e5edf1c7222acdd222cd39a"
Jul 30 23:36:48.215105 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.215077    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"]
Jul 30 23:36:48.223994 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.223963    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/auth-test-model-f6f660-kserve-7f45c48459-rkl25"]
Jul 30 23:36:48.254142 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.254111    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"]
Jul 30 23:36:48.254498 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.254483    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" containerName="main"
Jul 30 23:36:48.254563 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.254499    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" containerName="main"
Jul 30 23:36:48.254563 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.254514    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f915fc3-7f71-4b67-baa8-655f384ebb5b" containerName="main"
Jul 30 23:36:48.254563 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.254519    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f915fc3-7f71-4b67-baa8-655f384ebb5b" containerName="main"
Jul 30 23:36:48.254657 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.254584    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" containerName="main"
Jul 30 23:36:48.254657 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.254594    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f915fc3-7f71-4b67-baa8-655f384ebb5b" containerName="main"
Jul 30 23:36:48.258938 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.258917    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.261396 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.261369    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"kube-root-ca.crt\""
Jul 30 23:36:48.261539 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.261469    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"default-dockercfg-plrdn\""
Jul 30 23:36:48.261642 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.261546    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"sub-test-model-5049e4-kserve-self-signed-certs\""
Jul 30 23:36:48.261642 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.261590    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"openshift-service-ca.crt\""
Jul 30 23:36:48.267345 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.267323    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"]
Jul 30 23:36:48.278090 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.278054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:48.366663 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.366623    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tls-certs\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.366663 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.366668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-home\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.366884 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.366707    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tmp-dir\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.366884 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.366788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cd2sg\" (UniqueName: \"kubernetes.io/projected/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-kube-api-access-cd2sg\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.366884 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.366815    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-dshm\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.366983 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.366923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-model-cache\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.468542 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.468449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-model-cache\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.468542 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.468502    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tls-certs\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.468542 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.468530    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-home\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.468843 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.468553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tmp-dir\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.468843 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.468620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cd2sg\" (UniqueName: \"kubernetes.io/projected/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-kube-api-access-cd2sg\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.468843 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.468650    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-dshm\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.469007 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.468945    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-model-cache\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.469007 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.468993    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-home\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.469085 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.469019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tmp-dir\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.470798 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.470778    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-dshm\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.471059 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.471040    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tls-certs\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.481007 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.480974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cd2sg\" (UniqueName: \"kubernetes.io/projected/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-kube-api-access-cd2sg\") pod \"sub-test-model-5049e4-kserve-78c4d87445-m62l8\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") " pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.568529 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.568491    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:48.696584 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.696552    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f915fc3-7f71-4b67-baa8-655f384ebb5b" path="/var/lib/kubelet/pods/0f915fc3-7f71-4b67-baa8-655f384ebb5b/volumes"
Jul 30 23:36:48.696986 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.696972    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5267fa6-9b0b-4866-823b-5be9dcf7ea7f" path="/var/lib/kubelet/pods/c5267fa6-9b0b-4866-823b-5be9dcf7ea7f/volumes"
Jul 30 23:36:48.711870 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:48.711517    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"]
Jul 30 23:36:48.714071 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:36:48.714040    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a5ba9f1_3cb7_43cf_a653_3e62faa53c23.slice/crio-cdbe0da04fbe93142c496931ac203f15164e69311ae1e155be599a546fa42a96 WatchSource:0}: Error finding container cdbe0da04fbe93142c496931ac203f15164e69311ae1e155be599a546fa42a96: Status 404 returned error can't find the container with id cdbe0da04fbe93142c496931ac203f15164e69311ae1e155be599a546fa42a96
Jul 30 23:36:49.202632 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:49.202592    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8" event={"ID":"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23","Type":"ContainerStarted","Data":"a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f"}
Jul 30 23:36:49.203064 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:49.202639    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8" event={"ID":"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23","Type":"ContainerStarted","Data":"cdbe0da04fbe93142c496931ac203f15164e69311ae1e155be599a546fa42a96"}
Jul 30 23:36:49.223363 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:49.223308    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8" podStartSLOduration=1.223290665 podStartE2EDuration="1.223290665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:36:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:36:49.221664962 +0000 UTC m=+2932.952810125" watchObservedRunningTime="2026-07-30 23:36:49.223290665 +0000 UTC m=+2932.954435826"
Jul 30 23:36:49.619794 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:49.619750    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:36:50.563313 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:50.563275    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:36:58.568678 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:58.568634    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:58.569101 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:58.568701    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:58.581300 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:58.581271    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:59.268677 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:59.268640    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:36:59.830588 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:36:59.830551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:13.670115 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.670073    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"]
Jul 30 23:37:13.678648 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.678612    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.683054 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.683029    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"default-dockercfg-tk592\""
Jul 30 23:37:13.683295 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.683029    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"kube-root-ca.crt\""
Jul 30 23:37:13.683295 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.683030    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"sub-test-model-f6f660-kserve-self-signed-certs\""
Jul 30 23:37:13.683454 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.683437    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"openshift-service-ca.crt\""
Jul 30 23:37:13.697641 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.697605    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-model-cache\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.697641 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.697647    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-home\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.697855 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.697664    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-tmp-dir\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.697855 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.697753    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdwv6\" (UniqueName: \"kubernetes.io/projected/a53e99fa-5fec-4cf1-8a80-f31749252352-kube-api-access-zdwv6\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.697855 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.697818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-dshm\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.697855 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.697838    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53e99fa-5fec-4cf1-8a80-f31749252352-tls-certs\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.709031 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.709000    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"]
Jul 30 23:37:13.731375 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.731337    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:13.798723 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.798691    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-model-cache\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.798912 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.798732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-home\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.798912 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.798751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-tmp-dir\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.798912 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.798777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdwv6\" (UniqueName: \"kubernetes.io/projected/a53e99fa-5fec-4cf1-8a80-f31749252352-kube-api-access-zdwv6\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.798912 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.798823    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-dshm\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.798912 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.798852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53e99fa-5fec-4cf1-8a80-f31749252352-tls-certs\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.799233 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.799208    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-home\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.799291 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.799245    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-model-cache\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.799291 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.799283    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-tmp-dir\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.801215 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.801172    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-dshm\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.801417 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.801400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53e99fa-5fec-4cf1-8a80-f31749252352-tls-certs\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.812228 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.812173    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdwv6\" (UniqueName: \"kubernetes.io/projected/a53e99fa-5fec-4cf1-8a80-f31749252352-kube-api-access-zdwv6\") pod \"sub-test-model-f6f660-kserve-7ff575976c-g9sbp\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") " pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:13.988520 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:13.988425    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:14.123125 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:14.123096    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"]
Jul 30 23:37:14.125708 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:37:14.125683    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda53e99fa_5fec_4cf1_8a80_f31749252352.slice/crio-d7ae51b77e86dfba593d28538b3bc002ccd79b0b849040c1cf78159c59d55469 WatchSource:0}: Error finding container d7ae51b77e86dfba593d28538b3bc002ccd79b0b849040c1cf78159c59d55469: Status 404 returned error can't find the container with id d7ae51b77e86dfba593d28538b3bc002ccd79b0b849040c1cf78159c59d55469
Jul 30 23:37:14.331373 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:14.331336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp" event={"ID":"a53e99fa-5fec-4cf1-8a80-f31749252352","Type":"ContainerStarted","Data":"a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429"}
Jul 30 23:37:14.331373 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:14.331379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp" event={"ID":"a53e99fa-5fec-4cf1-8a80-f31749252352","Type":"ContainerStarted","Data":"d7ae51b77e86dfba593d28538b3bc002ccd79b0b849040c1cf78159c59d55469"}
Jul 30 23:37:14.349312 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:14.349256    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp" podStartSLOduration=1.349238647 podStartE2EDuration="1.349238647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:37:14.348027202 +0000 UTC m=+2958.079172366" watchObservedRunningTime="2026-07-30 23:37:14.349238647 +0000 UTC m=+2958.080383807"
Jul 30 23:37:16.558758 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:16.558717    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:37:16.566124 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:16.566091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:37:23.988673 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:23.988589    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:23.988673 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:23.988649    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:24.000914 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:24.000884    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:24.389456 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:24.389429    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:37:56.943480 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:37:56.943449    2561 scope.go:117] "RemoveContainer" containerID="811ef6158e411148fe922c21576ab6edf998cc5a748b9e3c44c20c51c0c72bb3"
Jul 30 23:38:04.668564 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:04.668525    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:38:16.564471 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:16.564434    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:38:29.455323 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:29.455281    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:38:34.875927 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:34.875887    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"]
Jul 30 23:38:34.900196 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:34.900115    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:35.762987 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:35.762953    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"]
Jul 30 23:38:35.776752 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:35.776720    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:38.358628 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:38.358588    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:38:40.629252 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.629203    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"]
Jul 30 23:38:40.632604 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.632586    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.635493 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.635469    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5049e4\"/\"rate-test-model-5049e4-kserve-self-signed-certs\""
Jul 30 23:38:40.641254 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.641224    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"]
Jul 30 23:38:40.710743 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.710705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tls-certs\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.710959 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.710768    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-home\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.710959 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.710818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-dshm\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.710959 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.710851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tmp-dir\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.710959 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.710884    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-model-cache\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.710959 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.710958    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crz42\" (UniqueName: \"kubernetes.io/projected/e9c60d37-9c2c-42f5-91c2-518a6e11868b-kube-api-access-crz42\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.811778 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.811741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tls-certs\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.812001 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.811804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-home\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.812001 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.811824    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-dshm\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.812001 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.811849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tmp-dir\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.812001 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.811876    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-model-cache\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.812001 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.811927    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crz42\" (UniqueName: \"kubernetes.io/projected/e9c60d37-9c2c-42f5-91c2-518a6e11868b-kube-api-access-crz42\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.812319 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.812299    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-home\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.812379 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.812350    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tmp-dir\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.812379 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.812368    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-model-cache\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.814327 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.814296    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-dshm\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.814451 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.814423    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tls-certs\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.820978 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.820952    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crz42\" (UniqueName: \"kubernetes.io/projected/e9c60d37-9c2c-42f5-91c2-518a6e11868b-kube-api-access-crz42\") pod \"rate-test-model-5049e4-kserve-75c75967f9-jlh96\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") " pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:40.936514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.936435    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:40.942425 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:40.942394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:41.083583 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:41.083537    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"]
Jul 30 23:38:41.085930 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:38:41.085899    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9c60d37_9c2c_42f5_91c2_518a6e11868b.slice/crio-4c2b05b120277312b219ebccad7b77a0133ad5867b585188839d7a394efc4d64 WatchSource:0}: Error finding container 4c2b05b120277312b219ebccad7b77a0133ad5867b585188839d7a394efc4d64: Status 404 returned error can't find the container with id 4c2b05b120277312b219ebccad7b77a0133ad5867b585188839d7a394efc4d64
Jul 30 23:38:41.745376 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:41.745335    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96" event={"ID":"e9c60d37-9c2c-42f5-91c2-518a6e11868b","Type":"ContainerStarted","Data":"84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08"}
Jul 30 23:38:41.745376 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:41.745379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96" event={"ID":"e9c60d37-9c2c-42f5-91c2-518a6e11868b","Type":"ContainerStarted","Data":"4c2b05b120277312b219ebccad7b77a0133ad5867b585188839d7a394efc4d64"}
Jul 30 23:38:41.765011 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:41.764946    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96" podStartSLOduration=1.764926333 podStartE2EDuration="1.764926333s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:38:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:38:41.763263658 +0000 UTC m=+3045.494408819" watchObservedRunningTime="2026-07-30 23:38:41.764926333 +0000 UTC m=+3045.496071496"
Jul 30 23:38:44.514393 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:44.514348    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:38:47.271626 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:47.271581    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:38:49.894848 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:49.894730    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8" podUID="8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" containerName="main" containerID="cri-o://a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f" gracePeriod=45
Jul 30 23:38:50.151212 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.151138    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:38:50.200579 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200541    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-home\") pod \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") "
Jul 30 23:38:50.200579 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200576    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tmp-dir\") pod \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") "
Jul 30 23:38:50.200820 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200600    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-model-cache\") pod \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") "
Jul 30 23:38:50.200820 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200647    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tls-certs\") pod \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") "
Jul 30 23:38:50.200820 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200711    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cd2sg\" (UniqueName: \"kubernetes.io/projected/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-kube-api-access-cd2sg\") pod \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") "
Jul 30 23:38:50.200820 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200783    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-dshm\") pod \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\" (UID: \"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23\") "
Jul 30 23:38:50.201042 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200849    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" (UID: "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:50.201042 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200867    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-home" (OuterVolumeSpecName: "home") pod "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" (UID: "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:50.201042 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.200927    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-model-cache" (OuterVolumeSpecName: "model-cache") pod "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" (UID: "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:50.201217 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.201069    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:50.201217 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.201083    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:50.201217 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.201094    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:50.202906 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.202884    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-dshm" (OuterVolumeSpecName: "dshm") pod "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" (UID: "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:50.203004 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.202932    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" (UID: "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:38:50.203168 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.203147    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-kube-api-access-cd2sg" (OuterVolumeSpecName: "kube-api-access-cd2sg") pod "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" (UID: "8a5ba9f1-3cb7-43cf-a653-3e62faa53c23"). InnerVolumeSpecName "kube-api-access-cd2sg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:50.301843 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.301798    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:50.301843 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.301842    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:50.302054 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.301857    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cd2sg\" (UniqueName: \"kubernetes.io/projected/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23-kube-api-access-cd2sg\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:50.782168 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.782126    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp" podUID="a53e99fa-5fec-4cf1-8a80-f31749252352" containerName="main" containerID="cri-o://a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429" gracePeriod=45
Jul 30 23:38:50.787941 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.787912    2561 generic.go:356] "Generic (PLEG): container finished" podID="8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" containerID="a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f" exitCode=0
Jul 30 23:38:50.788072 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.787975    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"
Jul 30 23:38:50.788072 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.787995    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8" event={"ID":"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23","Type":"ContainerDied","Data":"a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f"}
Jul 30 23:38:50.788072 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.788054    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8" event={"ID":"8a5ba9f1-3cb7-43cf-a653-3e62faa53c23","Type":"ContainerDied","Data":"cdbe0da04fbe93142c496931ac203f15164e69311ae1e155be599a546fa42a96"}
Jul 30 23:38:50.788269 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.788076    2561 scope.go:117] "RemoveContainer" containerID="a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f"
Jul 30 23:38:50.805465 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.805439    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"]
Jul 30 23:38:50.810564 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.810535    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/sub-test-model-5049e4-kserve-78c4d87445-m62l8"]
Jul 30 23:38:50.893431 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.893410    2561 scope.go:117] "RemoveContainer" containerID="a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f"
Jul 30 23:38:50.893799 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:38:50.893776    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f\": container with ID starting with a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f not found: ID does not exist" containerID="a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f"
Jul 30 23:38:50.893888 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.893808    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f"} err="failed to get container status \"a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f\": rpc error: code = NotFound desc = could not find container \"a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f\": container with ID starting with a5cdedd64237b6f0d1dfc93f208c90879ff33ee06e078fb1a9c6f9373aaa7b1f not found: ID does not exist"
Jul 30 23:38:50.942526 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.942492    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:50.943003 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.942573    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:50.955806 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:50.955741    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:51.029111 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.029087    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:38:51.109344 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109310    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-dshm\") pod \"a53e99fa-5fec-4cf1-8a80-f31749252352\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") "
Jul 30 23:38:51.109508 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109357    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-model-cache\") pod \"a53e99fa-5fec-4cf1-8a80-f31749252352\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") "
Jul 30 23:38:51.109508 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109380    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53e99fa-5fec-4cf1-8a80-f31749252352-tls-certs\") pod \"a53e99fa-5fec-4cf1-8a80-f31749252352\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") "
Jul 30 23:38:51.109508 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109440    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdwv6\" (UniqueName: \"kubernetes.io/projected/a53e99fa-5fec-4cf1-8a80-f31749252352-kube-api-access-zdwv6\") pod \"a53e99fa-5fec-4cf1-8a80-f31749252352\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") "
Jul 30 23:38:51.109508 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109502    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-home\") pod \"a53e99fa-5fec-4cf1-8a80-f31749252352\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") "
Jul 30 23:38:51.109760 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109557    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-tmp-dir\") pod \"a53e99fa-5fec-4cf1-8a80-f31749252352\" (UID: \"a53e99fa-5fec-4cf1-8a80-f31749252352\") "
Jul 30 23:38:51.109760 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109628    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-model-cache" (OuterVolumeSpecName: "model-cache") pod "a53e99fa-5fec-4cf1-8a80-f31749252352" (UID: "a53e99fa-5fec-4cf1-8a80-f31749252352"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:51.109884 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109852    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-home" (OuterVolumeSpecName: "home") pod "a53e99fa-5fec-4cf1-8a80-f31749252352" (UID: "a53e99fa-5fec-4cf1-8a80-f31749252352"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:51.109947 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109867    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a53e99fa-5fec-4cf1-8a80-f31749252352" (UID: "a53e99fa-5fec-4cf1-8a80-f31749252352"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:51.109947 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.109883    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:51.111553 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.111527    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-dshm" (OuterVolumeSpecName: "dshm") pod "a53e99fa-5fec-4cf1-8a80-f31749252352" (UID: "a53e99fa-5fec-4cf1-8a80-f31749252352"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:38:51.111672 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.111658    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a53e99fa-5fec-4cf1-8a80-f31749252352-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a53e99fa-5fec-4cf1-8a80-f31749252352" (UID: "a53e99fa-5fec-4cf1-8a80-f31749252352"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:38:51.111754 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.111736    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a53e99fa-5fec-4cf1-8a80-f31749252352-kube-api-access-zdwv6" (OuterVolumeSpecName: "kube-api-access-zdwv6") pod "a53e99fa-5fec-4cf1-8a80-f31749252352" (UID: "a53e99fa-5fec-4cf1-8a80-f31749252352"). InnerVolumeSpecName "kube-api-access-zdwv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:38:51.211333 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.211243    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdwv6\" (UniqueName: \"kubernetes.io/projected/a53e99fa-5fec-4cf1-8a80-f31749252352-kube-api-access-zdwv6\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:51.211333 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.211276    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:51.211333 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.211287    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:51.211333 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.211295    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a53e99fa-5fec-4cf1-8a80-f31749252352-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:51.211333 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.211302    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a53e99fa-5fec-4cf1-8a80-f31749252352-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:38:51.794774 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.794736    2561 generic.go:356] "Generic (PLEG): container finished" podID="a53e99fa-5fec-4cf1-8a80-f31749252352" containerID="a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429" exitCode=0
Jul 30 23:38:51.794984 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.794784    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"
Jul 30 23:38:51.794984 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.794820    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp" event={"ID":"a53e99fa-5fec-4cf1-8a80-f31749252352","Type":"ContainerDied","Data":"a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429"}
Jul 30 23:38:51.794984 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.794864    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp" event={"ID":"a53e99fa-5fec-4cf1-8a80-f31749252352","Type":"ContainerDied","Data":"d7ae51b77e86dfba593d28538b3bc002ccd79b0b849040c1cf78159c59d55469"}
Jul 30 23:38:51.794984 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.794882    2561 scope.go:117] "RemoveContainer" containerID="a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429"
Jul 30 23:38:51.805425 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.805400    2561 scope.go:117] "RemoveContainer" containerID="a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429"
Jul 30 23:38:51.805731 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:38:51.805707    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429\": container with ID starting with a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429 not found: ID does not exist" containerID="a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429"
Jul 30 23:38:51.805801 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.805741    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429"} err="failed to get container status \"a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429\": rpc error: code = NotFound desc = could not find container \"a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429\": container with ID starting with a2a014516d08070b4e519903390e30c4b59ebd41d86485da579c99dfdc131429 not found: ID does not exist"
Jul 30 23:38:51.808780 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.808760    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:38:51.816489 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.816465    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"]
Jul 30 23:38:51.820522 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:51.820496    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/sub-test-model-f6f660-kserve-7ff575976c-g9sbp"]
Jul 30 23:38:52.697326 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:52.697292    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" path="/var/lib/kubelet/pods/8a5ba9f1-3cb7-43cf-a653-3e62faa53c23/volumes"
Jul 30 23:38:52.697723 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:38:52.697680    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a53e99fa-5fec-4cf1-8a80-f31749252352" path="/var/lib/kubelet/pods/a53e99fa-5fec-4cf1-8a80-f31749252352/volumes"
Jul 30 23:39:00.651068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.651032    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"]
Jul 30 23:39:00.651575 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.651376    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" containerName="main"
Jul 30 23:39:00.651575 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.651386    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" containerName="main"
Jul 30 23:39:00.651575 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.651398    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a53e99fa-5fec-4cf1-8a80-f31749252352" containerName="main"
Jul 30 23:39:00.651575 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.651404    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a53e99fa-5fec-4cf1-8a80-f31749252352" containerName="main"
Jul 30 23:39:00.651575 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.651474    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a5ba9f1-3cb7-43cf-a653-3e62faa53c23" containerName="main"
Jul 30 23:39:00.651575 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.651480    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a53e99fa-5fec-4cf1-8a80-f31749252352" containerName="main"
Jul 30 23:39:00.655455 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.655436    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.659070 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.659043    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"rate-test-model-f6f660-kserve-self-signed-certs\""
Jul 30 23:39:00.659214 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.659107    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"kube-root-ca.crt\""
Jul 30 23:39:00.659214 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.659049    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"openshift-service-ca.crt\""
Jul 30 23:39:00.659358 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.659344    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f6f660\"/\"default-dockercfg-tk592\""
Jul 30 23:39:00.663017 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.662987    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"]
Jul 30 23:39:00.738945 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.738910    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:00.796947 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.796903    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-home\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.796947 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.796954    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-dshm\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.797228 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.797109    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tmp-dir\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.797228 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.797148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-model-cache\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.797228 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.797170    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tls-certs\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.797353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.797238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz5z2\" (UniqueName: \"kubernetes.io/projected/fce63a81-ef7c-4aa7-8436-e536daf70fe7-kube-api-access-nz5z2\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.897968 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.897925    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-dshm\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.898146 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.898036    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tmp-dir\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.898146 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.898064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-model-cache\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.898146 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.898083    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tls-certs\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.898146 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.898116    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz5z2\" (UniqueName: \"kubernetes.io/projected/fce63a81-ef7c-4aa7-8436-e536daf70fe7-kube-api-access-nz5z2\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.898360 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.898203    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-home\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.898514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.898495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tmp-dir\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.898592 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.898528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-home\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.898592 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.898562    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-model-cache\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.900429 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.900400    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-dshm\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.900622 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.900606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tls-certs\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.908791 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.908713    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz5z2\" (UniqueName: \"kubernetes.io/projected/fce63a81-ef7c-4aa7-8436-e536daf70fe7-kube-api-access-nz5z2\") pod \"rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") " pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:00.965891 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:00.965851    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:01.098591 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:01.098571    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"]
Jul 30 23:39:01.101171 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:39:01.101148    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfce63a81_ef7c_4aa7_8436_e536daf70fe7.slice/crio-b54c581c2641e51e579f2987a5acc1fcb8ee8abd71564aba58b7f1292cb74175 WatchSource:0}: Error finding container b54c581c2641e51e579f2987a5acc1fcb8ee8abd71564aba58b7f1292cb74175: Status 404 returned error can't find the container with id b54c581c2641e51e579f2987a5acc1fcb8ee8abd71564aba58b7f1292cb74175
Jul 30 23:39:01.845790 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:01.845754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h" event={"ID":"fce63a81-ef7c-4aa7-8436-e536daf70fe7","Type":"ContainerStarted","Data":"aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf"}
Jul 30 23:39:01.846306 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:01.845803    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h" event={"ID":"fce63a81-ef7c-4aa7-8436-e536daf70fe7","Type":"ContainerStarted","Data":"b54c581c2641e51e579f2987a5acc1fcb8ee8abd71564aba58b7f1292cb74175"}
Jul 30 23:39:01.863994 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:01.863932    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h" podStartSLOduration=1.8639126689999999 podStartE2EDuration="1.863912669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:39:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:39:01.86249474 +0000 UTC m=+3065.593639905" watchObservedRunningTime="2026-07-30 23:39:01.863912669 +0000 UTC m=+3065.595057830"
Jul 30 23:39:03.262672 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:03.262635    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:39:10.966360 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:10.966323    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:10.968703 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:10.966377    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:10.978684 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:10.978655    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:11.902161 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:11.902123    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:39:37.956393 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:37.956351    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:39:50.674900 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:50.674865    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:39:54.893879 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:54.893842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:39:54.992752 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:39:54.992711    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:02.159980 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:02.159933    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:40:07.442215 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:07.442155    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"]
Jul 30 23:40:07.469336 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:07.469301    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:08.443070 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:08.438643    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"]
Jul 30 23:40:08.457475 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:08.457436    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:09.438633 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.438597    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7723-140570356706352"]
Jul 30 23:40:09.441568 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.441549    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356706352"
Jul 30 23:40:09.443961 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.443937    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qc2pz\""
Jul 30 23:40:09.449340 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.449316    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356706352"]
Jul 30 23:40:09.530803 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.530762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82bn8\" (UniqueName: \"kubernetes.io/projected/1b30dd5d-f970-45cd-93c9-5deffec68f64-kube-api-access-82bn8\") pod \"test-curl-7723-140570356706352\" (UID: \"1b30dd5d-f970-45cd-93c9-5deffec68f64\") " pod="opendatahub/test-curl-7723-140570356706352"
Jul 30 23:40:09.631997 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.631960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82bn8\" (UniqueName: \"kubernetes.io/projected/1b30dd5d-f970-45cd-93c9-5deffec68f64-kube-api-access-82bn8\") pod \"test-curl-7723-140570356706352\" (UID: \"1b30dd5d-f970-45cd-93c9-5deffec68f64\") " pod="opendatahub/test-curl-7723-140570356706352"
Jul 30 23:40:09.640712 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.640685    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82bn8\" (UniqueName: \"kubernetes.io/projected/1b30dd5d-f970-45cd-93c9-5deffec68f64-kube-api-access-82bn8\") pod \"test-curl-7723-140570356706352\" (UID: \"1b30dd5d-f970-45cd-93c9-5deffec68f64\") " pod="opendatahub/test-curl-7723-140570356706352"
Jul 30 23:40:09.752122 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.752095    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356706352"
Jul 30 23:40:09.885658 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.885626    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356706352"]
Jul 30 23:40:09.887845 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:40:09.887816    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b30dd5d_f970_45cd_93c9_5deffec68f64.slice/crio-ecc78c63bbc993ed569ed2c1115b015d0953b972d81bd054b42a1a6ac16bf704 WatchSource:0}: Error finding container ecc78c63bbc993ed569ed2c1115b015d0953b972d81bd054b42a1a6ac16bf704: Status 404 returned error can't find the container with id ecc78c63bbc993ed569ed2c1115b015d0953b972d81bd054b42a1a6ac16bf704
Jul 30 23:40:09.889699 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:09.889677    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 23:40:10.160901 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:10.160812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356706352" event={"ID":"1b30dd5d-f970-45cd-93c9-5deffec68f64","Type":"ContainerStarted","Data":"ecc78c63bbc993ed569ed2c1115b015d0953b972d81bd054b42a1a6ac16bf704"}
Jul 30 23:40:11.167304 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:11.167271    2561 generic.go:356] "Generic (PLEG): container finished" podID="1b30dd5d-f970-45cd-93c9-5deffec68f64" containerID="4842ae38be7d9e5d3cffabb78aecefd49ebd97899fe67189d17e6e0b33c6b9e7" exitCode=0
Jul 30 23:40:11.167705 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:11.167360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356706352" event={"ID":"1b30dd5d-f970-45cd-93c9-5deffec68f64","Type":"ContainerDied","Data":"4842ae38be7d9e5d3cffabb78aecefd49ebd97899fe67189d17e6e0b33c6b9e7"}
Jul 30 23:40:11.354055 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:11.354016    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:40:12.315289 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.315263    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356706352"
Jul 30 23:40:12.343831 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.343799    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7723-140570356706352_1b30dd5d-f970-45cd-93c9-5deffec68f64/test-curl-7723-140570356706352/0.log"
Jul 30 23:40:12.359208 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.359143    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82bn8\" (UniqueName: \"kubernetes.io/projected/1b30dd5d-f970-45cd-93c9-5deffec68f64-kube-api-access-82bn8\") pod \"1b30dd5d-f970-45cd-93c9-5deffec68f64\" (UID: \"1b30dd5d-f970-45cd-93c9-5deffec68f64\") "
Jul 30 23:40:12.361423 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.361387    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b30dd5d-f970-45cd-93c9-5deffec68f64-kube-api-access-82bn8" (OuterVolumeSpecName: "kube-api-access-82bn8") pod "1b30dd5d-f970-45cd-93c9-5deffec68f64" (UID: "1b30dd5d-f970-45cd-93c9-5deffec68f64"). InnerVolumeSpecName "kube-api-access-82bn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:40:12.365077 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.365050    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7723-140570356706352"]
Jul 30 23:40:12.368256 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.368234    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7723-140570356706352"]
Jul 30 23:40:12.459910 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.459819    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82bn8\" (UniqueName: \"kubernetes.io/projected/1b30dd5d-f970-45cd-93c9-5deffec68f64-kube-api-access-82bn8\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:12.489585 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.489551    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7723-140570356609712"]
Jul 30 23:40:12.489972 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.489956    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b30dd5d-f970-45cd-93c9-5deffec68f64" containerName="test-curl-7723-140570356706352"
Jul 30 23:40:12.490023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.489973    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b30dd5d-f970-45cd-93c9-5deffec68f64" containerName="test-curl-7723-140570356706352"
Jul 30 23:40:12.490061 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.490039    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b30dd5d-f970-45cd-93c9-5deffec68f64" containerName="test-curl-7723-140570356706352"
Jul 30 23:40:12.493013 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.492996    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:12.498905 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.498878    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356609712"]
Jul 30 23:40:12.560780 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.560737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxl9\" (UniqueName: \"kubernetes.io/projected/64e1d791-0fe3-4c03-a029-b003d4f03cfc-kube-api-access-9xxl9\") pod \"test-curl-7723-140570356609712\" (UID: \"64e1d791-0fe3-4c03-a029-b003d4f03cfc\") " pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:12.661536 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.661485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxl9\" (UniqueName: \"kubernetes.io/projected/64e1d791-0fe3-4c03-a029-b003d4f03cfc-kube-api-access-9xxl9\") pod \"test-curl-7723-140570356609712\" (UID: \"64e1d791-0fe3-4c03-a029-b003d4f03cfc\") " pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:12.669744 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.669701    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxl9\" (UniqueName: \"kubernetes.io/projected/64e1d791-0fe3-4c03-a029-b003d4f03cfc-kube-api-access-9xxl9\") pod \"test-curl-7723-140570356609712\" (UID: \"64e1d791-0fe3-4c03-a029-b003d4f03cfc\") " pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:12.697136 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.697097    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b30dd5d-f970-45cd-93c9-5deffec68f64" path="/var/lib/kubelet/pods/1b30dd5d-f970-45cd-93c9-5deffec68f64/volumes"
Jul 30 23:40:12.803953 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.803915    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:12.935682 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:12.935653    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356609712"]
Jul 30 23:40:12.938118 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:40:12.938082    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64e1d791_0fe3_4c03_a029_b003d4f03cfc.slice/crio-f04a229d038332c633422074fdc880a251304a110c5e9ba10955896a67775544 WatchSource:0}: Error finding container f04a229d038332c633422074fdc880a251304a110c5e9ba10955896a67775544: Status 404 returned error can't find the container with id f04a229d038332c633422074fdc880a251304a110c5e9ba10955896a67775544
Jul 30 23:40:13.177001 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:13.176909    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356706352"
Jul 30 23:40:13.177001 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:13.176915    2561 scope.go:117] "RemoveContainer" containerID="4842ae38be7d9e5d3cffabb78aecefd49ebd97899fe67189d17e6e0b33c6b9e7"
Jul 30 23:40:13.178173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:13.178093    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356609712" event={"ID":"64e1d791-0fe3-4c03-a029-b003d4f03cfc","Type":"ContainerStarted","Data":"f04a229d038332c633422074fdc880a251304a110c5e9ba10955896a67775544"}
Jul 30 23:40:14.185377 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:14.185343    2561 generic.go:356] "Generic (PLEG): container finished" podID="64e1d791-0fe3-4c03-a029-b003d4f03cfc" containerID="b5bffce87d9f342fc345aa3d59032d082747e20cbb1b9dd975d9739d10731583" exitCode=0
Jul 30 23:40:14.185768 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:14.185399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356609712" event={"ID":"64e1d791-0fe3-4c03-a029-b003d4f03cfc","Type":"ContainerDied","Data":"b5bffce87d9f342fc345aa3d59032d082747e20cbb1b9dd975d9739d10731583"}
Jul 30 23:40:15.329745 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.329719    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:15.349532 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.349503    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7723-140570356609712_64e1d791-0fe3-4c03-a029-b003d4f03cfc/test-curl-7723-140570356609712/0.log"
Jul 30 23:40:15.375505 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.375463    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7723-140570356609712"]
Jul 30 23:40:15.379036 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.379001    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7723-140570356609712"]
Jul 30 23:40:15.390400 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.390364    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xxl9\" (UniqueName: \"kubernetes.io/projected/64e1d791-0fe3-4c03-a029-b003d4f03cfc-kube-api-access-9xxl9\") pod \"64e1d791-0fe3-4c03-a029-b003d4f03cfc\" (UID: \"64e1d791-0fe3-4c03-a029-b003d4f03cfc\") "
Jul 30 23:40:15.392451 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.392423    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64e1d791-0fe3-4c03-a029-b003d4f03cfc-kube-api-access-9xxl9" (OuterVolumeSpecName: "kube-api-access-9xxl9") pod "64e1d791-0fe3-4c03-a029-b003d4f03cfc" (UID: "64e1d791-0fe3-4c03-a029-b003d4f03cfc"). InnerVolumeSpecName "kube-api-access-9xxl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:40:15.491131 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.491034    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xxl9\" (UniqueName: \"kubernetes.io/projected/64e1d791-0fe3-4c03-a029-b003d4f03cfc-kube-api-access-9xxl9\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:15.550607 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.550568    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:15.550953 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.550939    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64e1d791-0fe3-4c03-a029-b003d4f03cfc" containerName="test-curl-7723-140570356609712"
Jul 30 23:40:15.550998 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.550955    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="64e1d791-0fe3-4c03-a029-b003d4f03cfc" containerName="test-curl-7723-140570356609712"
Jul 30 23:40:15.551032 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.551025    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="64e1d791-0fe3-4c03-a029-b003d4f03cfc" containerName="test-curl-7723-140570356609712"
Jul 30 23:40:15.554109 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.554089    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:15.559679 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.559600    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:15.592134 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.592095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj5kd\" (UniqueName: \"kubernetes.io/projected/7b979849-2d1d-47fc-944d-ba6f8ca932f3-kube-api-access-rj5kd\") pod \"test-curl-7723-140570356599952\" (UID: \"7b979849-2d1d-47fc-944d-ba6f8ca932f3\") " pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:15.693129 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.693079    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj5kd\" (UniqueName: \"kubernetes.io/projected/7b979849-2d1d-47fc-944d-ba6f8ca932f3-kube-api-access-rj5kd\") pod \"test-curl-7723-140570356599952\" (UID: \"7b979849-2d1d-47fc-944d-ba6f8ca932f3\") " pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:15.703784 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.703752    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj5kd\" (UniqueName: \"kubernetes.io/projected/7b979849-2d1d-47fc-944d-ba6f8ca932f3-kube-api-access-rj5kd\") pod \"test-curl-7723-140570356599952\" (UID: \"7b979849-2d1d-47fc-944d-ba6f8ca932f3\") " pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:15.865527 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:15.865490    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:16.004253 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:16.004216    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:16.007128 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:40:16.007099    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b979849_2d1d_47fc_944d_ba6f8ca932f3.slice/crio-b21b0c300902662c713448f4fb61c27ac48450a294c26ba013defb4d0d2296ba WatchSource:0}: Error finding container b21b0c300902662c713448f4fb61c27ac48450a294c26ba013defb4d0d2296ba: Status 404 returned error can't find the container with id b21b0c300902662c713448f4fb61c27ac48450a294c26ba013defb4d0d2296ba
Jul 30 23:40:16.196922 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:16.196834    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:16.196922 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:16.196861    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f04a229d038332c633422074fdc880a251304a110c5e9ba10955896a67775544"
Jul 30 23:40:16.198065 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:16.198037    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356599952" event={"ID":"7b979849-2d1d-47fc-944d-ba6f8ca932f3","Type":"ContainerStarted","Data":"b21b0c300902662c713448f4fb61c27ac48450a294c26ba013defb4d0d2296ba"}
Jul 30 23:40:16.207892 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:40:16.207849    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7723-140570356609712\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="64e1d791-0fe3-4c03-a029-b003d4f03cfc" pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:16.696030 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:40:16.695993    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7723-140570356609712\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="64e1d791-0fe3-4c03-a029-b003d4f03cfc" pod="opendatahub/test-curl-7723-140570356609712"
Jul 30 23:40:16.697596 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:16.697573    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64e1d791-0fe3-4c03-a029-b003d4f03cfc" path="/var/lib/kubelet/pods/64e1d791-0fe3-4c03-a029-b003d4f03cfc/volumes"
Jul 30 23:40:17.204800 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:17.204765    2561 generic.go:356] "Generic (PLEG): container finished" podID="7b979849-2d1d-47fc-944d-ba6f8ca932f3" containerID="cd8059fb3efd9ae39b979b0fea4b8f2ff3d52d570c3dc95b7169ca746a8f0e71" exitCode=0
Jul 30 23:40:17.205026 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:17.204826    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356599952" event={"ID":"7b979849-2d1d-47fc-944d-ba6f8ca932f3","Type":"ContainerDied","Data":"cd8059fb3efd9ae39b979b0fea4b8f2ff3d52d570c3dc95b7169ca746a8f0e71"}
Jul 30 23:40:18.345937 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.345894    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:18.365682 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.365654    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7723-140570356599952_7b979849-2d1d-47fc-944d-ba6f8ca932f3/test-curl-7723-140570356599952/0.log"
Jul 30 23:40:18.386206 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.386157    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:18.389855 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.389809    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:18.420665 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.420629    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rj5kd\" (UniqueName: \"kubernetes.io/projected/7b979849-2d1d-47fc-944d-ba6f8ca932f3-kube-api-access-rj5kd\") pod \"7b979849-2d1d-47fc-944d-ba6f8ca932f3\" (UID: \"7b979849-2d1d-47fc-944d-ba6f8ca932f3\") "
Jul 30 23:40:18.422823 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.422783    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b979849-2d1d-47fc-944d-ba6f8ca932f3-kube-api-access-rj5kd" (OuterVolumeSpecName: "kube-api-access-rj5kd") pod "7b979849-2d1d-47fc-944d-ba6f8ca932f3" (UID: "7b979849-2d1d-47fc-944d-ba6f8ca932f3"). InnerVolumeSpecName "kube-api-access-rj5kd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:40:18.506921 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.506876    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:18.507346 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.507328    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b979849-2d1d-47fc-944d-ba6f8ca932f3" containerName="test-curl-7723-140570356599952"
Jul 30 23:40:18.507433 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.507348    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b979849-2d1d-47fc-944d-ba6f8ca932f3" containerName="test-curl-7723-140570356599952"
Jul 30 23:40:18.507503 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.507433    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b979849-2d1d-47fc-944d-ba6f8ca932f3" containerName="test-curl-7723-140570356599952"
Jul 30 23:40:18.510495 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.510473    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:18.516223 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.516166    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:18.522199 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.522161    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rj5kd\" (UniqueName: \"kubernetes.io/projected/7b979849-2d1d-47fc-944d-ba6f8ca932f3-kube-api-access-rj5kd\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:18.622991 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.622949    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr9hb\" (UniqueName: \"kubernetes.io/projected/05ffdf7d-99af-4f11-9d35-9b4994e8acdf-kube-api-access-zr9hb\") pod \"test-curl-7723-140570356599952\" (UID: \"05ffdf7d-99af-4f11-9d35-9b4994e8acdf\") " pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:18.696728 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.696692    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b979849-2d1d-47fc-944d-ba6f8ca932f3" path="/var/lib/kubelet/pods/7b979849-2d1d-47fc-944d-ba6f8ca932f3/volumes"
Jul 30 23:40:18.723593 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.723544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr9hb\" (UniqueName: \"kubernetes.io/projected/05ffdf7d-99af-4f11-9d35-9b4994e8acdf-kube-api-access-zr9hb\") pod \"test-curl-7723-140570356599952\" (UID: \"05ffdf7d-99af-4f11-9d35-9b4994e8acdf\") " pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:18.732844 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.732815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr9hb\" (UniqueName: \"kubernetes.io/projected/05ffdf7d-99af-4f11-9d35-9b4994e8acdf-kube-api-access-zr9hb\") pod \"test-curl-7723-140570356599952\" (UID: \"05ffdf7d-99af-4f11-9d35-9b4994e8acdf\") " pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:18.821167 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.821082    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:18.958153 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:18.958131    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:18.960332 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:40:18.960305    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod05ffdf7d_99af_4f11_9d35_9b4994e8acdf.slice/crio-1eec3530b35b1b855c42c57ff2746fce06b7c2a47ca18824f18d3b69c5ad1c39 WatchSource:0}: Error finding container 1eec3530b35b1b855c42c57ff2746fce06b7c2a47ca18824f18d3b69c5ad1c39: Status 404 returned error can't find the container with id 1eec3530b35b1b855c42c57ff2746fce06b7c2a47ca18824f18d3b69c5ad1c39
Jul 30 23:40:19.216294 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:19.216208    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356599952" event={"ID":"05ffdf7d-99af-4f11-9d35-9b4994e8acdf","Type":"ContainerStarted","Data":"1eec3530b35b1b855c42c57ff2746fce06b7c2a47ca18824f18d3b69c5ad1c39"}
Jul 30 23:40:19.217378 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:19.217358    2561 scope.go:117] "RemoveContainer" containerID="cd8059fb3efd9ae39b979b0fea4b8f2ff3d52d570c3dc95b7169ca746a8f0e71"
Jul 30 23:40:19.217509 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:19.217389    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:20.223714 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:20.223679    2561 generic.go:356] "Generic (PLEG): container finished" podID="05ffdf7d-99af-4f11-9d35-9b4994e8acdf" containerID="dde579da16633ae368454d0401224a40dcd3abe94508db2a55d7d3e75d24faca" exitCode=0
Jul 30 23:40:20.224170 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:20.223773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356599952" event={"ID":"05ffdf7d-99af-4f11-9d35-9b4994e8acdf","Type":"ContainerDied","Data":"dde579da16633ae368454d0401224a40dcd3abe94508db2a55d7d3e75d24faca"}
Jul 30 23:40:21.366468 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.366443    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:21.387229 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.387198    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7723-140570356599952_05ffdf7d-99af-4f11-9d35-9b4994e8acdf/test-curl-7723-140570356599952/0.log"
Jul 30 23:40:21.406394 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.406337    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:21.408896 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.408868    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7723-140570356599952"]
Jul 30 23:40:21.450346 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.450306    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zr9hb\" (UniqueName: \"kubernetes.io/projected/05ffdf7d-99af-4f11-9d35-9b4994e8acdf-kube-api-access-zr9hb\") pod \"05ffdf7d-99af-4f11-9d35-9b4994e8acdf\" (UID: \"05ffdf7d-99af-4f11-9d35-9b4994e8acdf\") "
Jul 30 23:40:21.452453 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.452425    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ffdf7d-99af-4f11-9d35-9b4994e8acdf-kube-api-access-zr9hb" (OuterVolumeSpecName: "kube-api-access-zr9hb") pod "05ffdf7d-99af-4f11-9d35-9b4994e8acdf" (UID: "05ffdf7d-99af-4f11-9d35-9b4994e8acdf"). InnerVolumeSpecName "kube-api-access-zr9hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:40:21.536267 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.536234    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:21.536623 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.536609    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ffdf7d-99af-4f11-9d35-9b4994e8acdf" containerName="test-curl-7723-140570356599952"
Jul 30 23:40:21.536670 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.536624    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ffdf7d-99af-4f11-9d35-9b4994e8acdf" containerName="test-curl-7723-140570356599952"
Jul 30 23:40:21.536705 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.536693    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ffdf7d-99af-4f11-9d35-9b4994e8acdf" containerName="test-curl-7723-140570356599952"
Jul 30 23:40:21.539722 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.539705    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:21.544043 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.544017    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:21.551096 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.551071    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zr9hb\" (UniqueName: \"kubernetes.io/projected/05ffdf7d-99af-4f11-9d35-9b4994e8acdf-kube-api-access-zr9hb\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:21.652488 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.652443    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf9qn\" (UniqueName: \"kubernetes.io/projected/1ab7243b-bde6-4c9a-96bf-84b50e45fcef-kube-api-access-nf9qn\") pod \"test-curl-7723-140570356543536\" (UID: \"1ab7243b-bde6-4c9a-96bf-84b50e45fcef\") " pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:21.754026 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.753991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf9qn\" (UniqueName: \"kubernetes.io/projected/1ab7243b-bde6-4c9a-96bf-84b50e45fcef-kube-api-access-nf9qn\") pod \"test-curl-7723-140570356543536\" (UID: \"1ab7243b-bde6-4c9a-96bf-84b50e45fcef\") " pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:21.762097 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.762069    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf9qn\" (UniqueName: \"kubernetes.io/projected/1ab7243b-bde6-4c9a-96bf-84b50e45fcef-kube-api-access-nf9qn\") pod \"test-curl-7723-140570356543536\" (UID: \"1ab7243b-bde6-4c9a-96bf-84b50e45fcef\") " pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:21.850253 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.850131    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:21.985105 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:21.985069    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:21.988267 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:40:21.988239    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ab7243b_bde6_4c9a_96bf_84b50e45fcef.slice/crio-d50900217d6b95ac89f72b9353f88293481376575aadf1a68bb89e521d7f0fe3 WatchSource:0}: Error finding container d50900217d6b95ac89f72b9353f88293481376575aadf1a68bb89e521d7f0fe3: Status 404 returned error can't find the container with id d50900217d6b95ac89f72b9353f88293481376575aadf1a68bb89e521d7f0fe3
Jul 30 23:40:22.234499 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.234427    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:22.234499 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.234468    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1eec3530b35b1b855c42c57ff2746fce06b7c2a47ca18824f18d3b69c5ad1c39"
Jul 30 23:40:22.235513 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.235488    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356543536" event={"ID":"1ab7243b-bde6-4c9a-96bf-84b50e45fcef","Type":"ContainerStarted","Data":"d50900217d6b95ac89f72b9353f88293481376575aadf1a68bb89e521d7f0fe3"}
Jul 30 23:40:22.245440 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:40:22.245398    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7723-140570356599952\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="05ffdf7d-99af-4f11-9d35-9b4994e8acdf" pod="opendatahub/test-curl-7723-140570356599952"
Jul 30 23:40:22.461707 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.461651    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96" podUID="e9c60d37-9c2c-42f5-91c2-518a6e11868b" containerName="main" containerID="cri-o://84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08" gracePeriod=45
Jul 30 23:40:22.698663 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.698623    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ffdf7d-99af-4f11-9d35-9b4994e8acdf" path="/var/lib/kubelet/pods/05ffdf7d-99af-4f11-9d35-9b4994e8acdf/volumes"
Jul 30 23:40:22.715075 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.715048    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:40:22.763935 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.763894    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-model-cache\") pod \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") "
Jul 30 23:40:22.764110 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.763983    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tls-certs\") pod \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") "
Jul 30 23:40:22.764110 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764010    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crz42\" (UniqueName: \"kubernetes.io/projected/e9c60d37-9c2c-42f5-91c2-518a6e11868b-kube-api-access-crz42\") pod \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") "
Jul 30 23:40:22.764110 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-dshm\") pod \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") "
Jul 30 23:40:22.764110 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764070    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-home\") pod \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") "
Jul 30 23:40:22.764366 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764151    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tmp-dir\") pod \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\" (UID: \"e9c60d37-9c2c-42f5-91c2-518a6e11868b\") "
Jul 30 23:40:22.764366 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764156    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-model-cache" (OuterVolumeSpecName: "model-cache") pod "e9c60d37-9c2c-42f5-91c2-518a6e11868b" (UID: "e9c60d37-9c2c-42f5-91c2-518a6e11868b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:40:22.764461 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764397    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e9c60d37-9c2c-42f5-91c2-518a6e11868b" (UID: "e9c60d37-9c2c-42f5-91c2-518a6e11868b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:40:22.764461 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764419    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-home" (OuterVolumeSpecName: "home") pod "e9c60d37-9c2c-42f5-91c2-518a6e11868b" (UID: "e9c60d37-9c2c-42f5-91c2-518a6e11868b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:40:22.764569 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764540    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:22.764569 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764558    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:22.764635 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.764569    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:22.766257 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.766225    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-dshm" (OuterVolumeSpecName: "dshm") pod "e9c60d37-9c2c-42f5-91c2-518a6e11868b" (UID: "e9c60d37-9c2c-42f5-91c2-518a6e11868b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:40:22.766372 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.766300    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e9c60d37-9c2c-42f5-91c2-518a6e11868b" (UID: "e9c60d37-9c2c-42f5-91c2-518a6e11868b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:40:22.766372 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.766362    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9c60d37-9c2c-42f5-91c2-518a6e11868b-kube-api-access-crz42" (OuterVolumeSpecName: "kube-api-access-crz42") pod "e9c60d37-9c2c-42f5-91c2-518a6e11868b" (UID: "e9c60d37-9c2c-42f5-91c2-518a6e11868b"). InnerVolumeSpecName "kube-api-access-crz42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:40:22.865695 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.865608    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9c60d37-9c2c-42f5-91c2-518a6e11868b-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:22.865695 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.865640    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crz42\" (UniqueName: \"kubernetes.io/projected/e9c60d37-9c2c-42f5-91c2-518a6e11868b-kube-api-access-crz42\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:22.865695 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:22.865649    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9c60d37-9c2c-42f5-91c2-518a6e11868b-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:23.242322 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.242234    2561 generic.go:356] "Generic (PLEG): container finished" podID="e9c60d37-9c2c-42f5-91c2-518a6e11868b" containerID="84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08" exitCode=0
Jul 30 23:40:23.242322 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.242289    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"
Jul 30 23:40:23.242539 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.242328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96" event={"ID":"e9c60d37-9c2c-42f5-91c2-518a6e11868b","Type":"ContainerDied","Data":"84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08"}
Jul 30 23:40:23.242539 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.242382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96" event={"ID":"e9c60d37-9c2c-42f5-91c2-518a6e11868b","Type":"ContainerDied","Data":"4c2b05b120277312b219ebccad7b77a0133ad5867b585188839d7a394efc4d64"}
Jul 30 23:40:23.242539 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.242408    2561 scope.go:117] "RemoveContainer" containerID="84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08"
Jul 30 23:40:23.244011 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.243984    2561 generic.go:356] "Generic (PLEG): container finished" podID="1ab7243b-bde6-4c9a-96bf-84b50e45fcef" containerID="49e071a837ce58842dc0d6b8212188dbdb2af5ef554c9498c53e2852bc36442a" exitCode=0
Jul 30 23:40:23.244152 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.244070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356543536" event={"ID":"1ab7243b-bde6-4c9a-96bf-84b50e45fcef","Type":"ContainerDied","Data":"49e071a837ce58842dc0d6b8212188dbdb2af5ef554c9498c53e2852bc36442a"}
Jul 30 23:40:23.252313 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.252145    2561 scope.go:117] "RemoveContainer" containerID="84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08"
Jul 30 23:40:23.252534 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:40:23.252514    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08\": container with ID starting with 84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08 not found: ID does not exist" containerID="84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08"
Jul 30 23:40:23.252647 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.252544    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08"} err="failed to get container status \"84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08\": rpc error: code = NotFound desc = could not find container \"84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08\": container with ID starting with 84af3ff7bc94feb5f20db0ecb29e6d3c1ddb3f73ebc2dd8b05e945b821644f08 not found: ID does not exist"
Jul 30 23:40:23.270448 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.270412    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"]
Jul 30 23:40:23.274321 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.274290    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5049e4/rate-test-model-5049e4-kserve-75c75967f9-jlh96"]
Jul 30 23:40:23.461646 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.461604    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h" podUID="fce63a81-ef7c-4aa7-8436-e536daf70fe7" containerName="main" containerID="cri-o://aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf" gracePeriod=45
Jul 30 23:40:23.727751 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.727712    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:40:23.774013 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.773979    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-model-cache\") pod \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") "
Jul 30 23:40:23.774173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.774025    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-dshm\") pod \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") "
Jul 30 23:40:23.774173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.774066    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-home\") pod \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") "
Jul 30 23:40:23.774173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.774102    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nz5z2\" (UniqueName: \"kubernetes.io/projected/fce63a81-ef7c-4aa7-8436-e536daf70fe7-kube-api-access-nz5z2\") pod \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") "
Jul 30 23:40:23.774173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.774123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tmp-dir\") pod \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") "
Jul 30 23:40:23.774173 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.774137    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tls-certs\") pod \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\" (UID: \"fce63a81-ef7c-4aa7-8436-e536daf70fe7\") "
Jul 30 23:40:23.774470 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.774318    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-model-cache" (OuterVolumeSpecName: "model-cache") pod "fce63a81-ef7c-4aa7-8436-e536daf70fe7" (UID: "fce63a81-ef7c-4aa7-8436-e536daf70fe7"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:40:23.774470 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.774443    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-home" (OuterVolumeSpecName: "home") pod "fce63a81-ef7c-4aa7-8436-e536daf70fe7" (UID: "fce63a81-ef7c-4aa7-8436-e536daf70fe7"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:40:23.774575 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.774466    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fce63a81-ef7c-4aa7-8436-e536daf70fe7" (UID: "fce63a81-ef7c-4aa7-8436-e536daf70fe7"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:40:23.776353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.776329    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fce63a81-ef7c-4aa7-8436-e536daf70fe7" (UID: "fce63a81-ef7c-4aa7-8436-e536daf70fe7"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:40:23.776353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.776343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-dshm" (OuterVolumeSpecName: "dshm") pod "fce63a81-ef7c-4aa7-8436-e536daf70fe7" (UID: "fce63a81-ef7c-4aa7-8436-e536daf70fe7"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:40:23.776353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.776328    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce63a81-ef7c-4aa7-8436-e536daf70fe7-kube-api-access-nz5z2" (OuterVolumeSpecName: "kube-api-access-nz5z2") pod "fce63a81-ef7c-4aa7-8436-e536daf70fe7" (UID: "fce63a81-ef7c-4aa7-8436-e536daf70fe7"). InnerVolumeSpecName "kube-api-access-nz5z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:40:23.875827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.875742    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:23.875827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.875773    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nz5z2\" (UniqueName: \"kubernetes.io/projected/fce63a81-ef7c-4aa7-8436-e536daf70fe7-kube-api-access-nz5z2\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:23.875827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.875805    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:23.875827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.875815    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce63a81-ef7c-4aa7-8436-e536daf70fe7-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:23.875827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.875823    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:23.875827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:23.875830    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce63a81-ef7c-4aa7-8436-e536daf70fe7-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:24.250918 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.250889    2561 generic.go:356] "Generic (PLEG): container finished" podID="fce63a81-ef7c-4aa7-8436-e536daf70fe7" containerID="aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf" exitCode=0
Jul 30 23:40:24.251113 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.250932    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"
Jul 30 23:40:24.251113 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.250984    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h" event={"ID":"fce63a81-ef7c-4aa7-8436-e536daf70fe7","Type":"ContainerDied","Data":"aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf"}
Jul 30 23:40:24.251113 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.251031    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h" event={"ID":"fce63a81-ef7c-4aa7-8436-e536daf70fe7","Type":"ContainerDied","Data":"b54c581c2641e51e579f2987a5acc1fcb8ee8abd71564aba58b7f1292cb74175"}
Jul 30 23:40:24.251113 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.251055    2561 scope.go:117] "RemoveContainer" containerID="aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf"
Jul 30 23:40:24.260661 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.260642    2561 scope.go:117] "RemoveContainer" containerID="aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf"
Jul 30 23:40:24.260984 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:40:24.260962    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf\": container with ID starting with aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf not found: ID does not exist" containerID="aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf"
Jul 30 23:40:24.261051 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.260993    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf"} err="failed to get container status \"aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf\": rpc error: code = NotFound desc = could not find container \"aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf\": container with ID starting with aee77f58b9a9137c24c2254977e2e69c0f2dcaa29c99e067b73371c820d2bfdf not found: ID does not exist"
Jul 30 23:40:24.272821 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.272787    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"]
Jul 30 23:40:24.276567 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.276533    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f6f660/rate-test-model-f6f660-kserve-7cfc5cb59-m2x4h"]
Jul 30 23:40:24.377937 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.377898    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:24.396644 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.396618    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7723-140570356543536_1ab7243b-bde6-4c9a-96bf-84b50e45fcef/test-curl-7723-140570356543536/0.log"
Jul 30 23:40:24.416878 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.416839    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:24.420437 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.420408    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:24.482320 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.482282    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nf9qn\" (UniqueName: \"kubernetes.io/projected/1ab7243b-bde6-4c9a-96bf-84b50e45fcef-kube-api-access-nf9qn\") pod \"1ab7243b-bde6-4c9a-96bf-84b50e45fcef\" (UID: \"1ab7243b-bde6-4c9a-96bf-84b50e45fcef\") "
Jul 30 23:40:24.484412 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.484387    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ab7243b-bde6-4c9a-96bf-84b50e45fcef-kube-api-access-nf9qn" (OuterVolumeSpecName: "kube-api-access-nf9qn") pod "1ab7243b-bde6-4c9a-96bf-84b50e45fcef" (UID: "1ab7243b-bde6-4c9a-96bf-84b50e45fcef"). InnerVolumeSpecName "kube-api-access-nf9qn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:40:24.544578 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544494    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:24.544873 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544861    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce63a81-ef7c-4aa7-8436-e536daf70fe7" containerName="main"
Jul 30 23:40:24.544915 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544875    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce63a81-ef7c-4aa7-8436-e536daf70fe7" containerName="main"
Jul 30 23:40:24.544915 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544882    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ab7243b-bde6-4c9a-96bf-84b50e45fcef" containerName="test-curl-7723-140570356543536"
Jul 30 23:40:24.544915 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544890    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ab7243b-bde6-4c9a-96bf-84b50e45fcef" containerName="test-curl-7723-140570356543536"
Jul 30 23:40:24.544915 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544899    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9c60d37-9c2c-42f5-91c2-518a6e11868b" containerName="main"
Jul 30 23:40:24.544915 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544904    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9c60d37-9c2c-42f5-91c2-518a6e11868b" containerName="main"
Jul 30 23:40:24.545061 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544963    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ab7243b-bde6-4c9a-96bf-84b50e45fcef" containerName="test-curl-7723-140570356543536"
Jul 30 23:40:24.545061 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544972    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce63a81-ef7c-4aa7-8436-e536daf70fe7" containerName="main"
Jul 30 23:40:24.545061 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.544978    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9c60d37-9c2c-42f5-91c2-518a6e11868b" containerName="main"
Jul 30 23:40:24.547900 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.547878    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:24.554646 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.554617    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:24.583207 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.583159    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nf9qn\" (UniqueName: \"kubernetes.io/projected/1ab7243b-bde6-4c9a-96bf-84b50e45fcef-kube-api-access-nf9qn\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:24.684469 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.684434    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grsz5\" (UniqueName: \"kubernetes.io/projected/8507ef36-34b6-4ec0-9586-68eb2fca0a8b-kube-api-access-grsz5\") pod \"test-curl-7723-140570356543536\" (UID: \"8507ef36-34b6-4ec0-9586-68eb2fca0a8b\") " pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:24.696759 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.696729    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ab7243b-bde6-4c9a-96bf-84b50e45fcef" path="/var/lib/kubelet/pods/1ab7243b-bde6-4c9a-96bf-84b50e45fcef/volumes"
Jul 30 23:40:24.697110 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.697098    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9c60d37-9c2c-42f5-91c2-518a6e11868b" path="/var/lib/kubelet/pods/e9c60d37-9c2c-42f5-91c2-518a6e11868b/volumes"
Jul 30 23:40:24.697470 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.697456    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce63a81-ef7c-4aa7-8436-e536daf70fe7" path="/var/lib/kubelet/pods/fce63a81-ef7c-4aa7-8436-e536daf70fe7/volumes"
Jul 30 23:40:24.785589 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.785551    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grsz5\" (UniqueName: \"kubernetes.io/projected/8507ef36-34b6-4ec0-9586-68eb2fca0a8b-kube-api-access-grsz5\") pod \"test-curl-7723-140570356543536\" (UID: \"8507ef36-34b6-4ec0-9586-68eb2fca0a8b\") " pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:24.793509 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.793483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grsz5\" (UniqueName: \"kubernetes.io/projected/8507ef36-34b6-4ec0-9586-68eb2fca0a8b-kube-api-access-grsz5\") pod \"test-curl-7723-140570356543536\" (UID: \"8507ef36-34b6-4ec0-9586-68eb2fca0a8b\") " pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:24.859317 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.859214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:24.995784 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:24.995744    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:24.997231 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:40:24.997199    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8507ef36_34b6_4ec0_9586_68eb2fca0a8b.slice/crio-f3b75d839e483dfab85aeed74b4ba152e4ea71f40e878a907ad75c607063c42e WatchSource:0}: Error finding container f3b75d839e483dfab85aeed74b4ba152e4ea71f40e878a907ad75c607063c42e: Status 404 returned error can't find the container with id f3b75d839e483dfab85aeed74b4ba152e4ea71f40e878a907ad75c607063c42e
Jul 30 23:40:25.257060 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:25.257026    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:25.257268 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:25.257073    2561 scope.go:117] "RemoveContainer" containerID="49e071a837ce58842dc0d6b8212188dbdb2af5ef554c9498c53e2852bc36442a"
Jul 30 23:40:25.258446 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:25.258308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356543536" event={"ID":"8507ef36-34b6-4ec0-9586-68eb2fca0a8b","Type":"ContainerStarted","Data":"f3b75d839e483dfab85aeed74b4ba152e4ea71f40e878a907ad75c607063c42e"}
Jul 30 23:40:26.265764 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:26.265727    2561 generic.go:356] "Generic (PLEG): container finished" podID="8507ef36-34b6-4ec0-9586-68eb2fca0a8b" containerID="ebd49cb2e13e1f35c9764be4dbeb209bc7c02f55cf512056f86c004f70babb07" exitCode=0
Jul 30 23:40:26.266223 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:26.265814    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7723-140570356543536" event={"ID":"8507ef36-34b6-4ec0-9586-68eb2fca0a8b","Type":"ContainerDied","Data":"ebd49cb2e13e1f35c9764be4dbeb209bc7c02f55cf512056f86c004f70babb07"}
Jul 30 23:40:27.405305 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:27.405274    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:27.425360 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:27.425297    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7723-140570356543536_8507ef36-34b6-4ec0-9586-68eb2fca0a8b/test-curl-7723-140570356543536/0.log"
Jul 30 23:40:27.450789 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:27.450753    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:27.454712 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:27.454682    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7723-140570356543536"]
Jul 30 23:40:27.512266 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:27.512226    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-grsz5\" (UniqueName: \"kubernetes.io/projected/8507ef36-34b6-4ec0-9586-68eb2fca0a8b-kube-api-access-grsz5\") pod \"8507ef36-34b6-4ec0-9586-68eb2fca0a8b\" (UID: \"8507ef36-34b6-4ec0-9586-68eb2fca0a8b\") "
Jul 30 23:40:27.514324 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:27.514299    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8507ef36-34b6-4ec0-9586-68eb2fca0a8b-kube-api-access-grsz5" (OuterVolumeSpecName: "kube-api-access-grsz5") pod "8507ef36-34b6-4ec0-9586-68eb2fca0a8b" (UID: "8507ef36-34b6-4ec0-9586-68eb2fca0a8b"). InnerVolumeSpecName "kube-api-access-grsz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:40:27.613850 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:27.613758    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-grsz5\" (UniqueName: \"kubernetes.io/projected/8507ef36-34b6-4ec0-9586-68eb2fca0a8b-kube-api-access-grsz5\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:40:27.961743 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:27.961650    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:28.278222 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:28.278167    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:28.278222 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:28.278215    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f3b75d839e483dfab85aeed74b4ba152e4ea71f40e878a907ad75c607063c42e"
Jul 30 23:40:28.289205 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:40:28.289156    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7723-140570356543536\" is forbidden: User \"system:node:ip-10-0-135-246.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-246.ec2.internal' and this object" podUID="8507ef36-34b6-4ec0-9586-68eb2fca0a8b" pod="opendatahub/test-curl-7723-140570356543536"
Jul 30 23:40:28.372950 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:28.372907    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:28.598133 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:28.598043    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:28.697857 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:28.697825    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8507ef36-34b6-4ec0-9586-68eb2fca0a8b" path="/var/lib/kubelet/pods/8507ef36-34b6-4ec0-9586-68eb2fca0a8b/volumes"
Jul 30 23:40:31.872646 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:31.872607    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:31.966406 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:31.966368    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:33.079685 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.079651    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:33.543744 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.543712    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:33.643801 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.643768    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:33.716658 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.716624    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"]
Jul 30 23:40:33.716970 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.716958    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8507ef36-34b6-4ec0-9586-68eb2fca0a8b" containerName="test-curl-7723-140570356543536"
Jul 30 23:40:33.717033 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.716972    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8507ef36-34b6-4ec0-9586-68eb2fca0a8b" containerName="test-curl-7723-140570356543536"
Jul 30 23:40:33.717071 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.717040    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8507ef36-34b6-4ec0-9586-68eb2fca0a8b" containerName="test-curl-7723-140570356543536"
Jul 30 23:40:33.720093 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.720075    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:33.722586 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.722565    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-05d70d-dockercfg-5f5xs\""
Jul 30 23:40:33.722694 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.722606    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-05d70d\""
Jul 30 23:40:33.728291 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.728268    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"]
Jul 30 23:40:33.869136 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.869041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095b05fa-3218-4524-acaa-eb517fe2bebb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs\" (UID: \"095b05fa-3218-4524-acaa-eb517fe2bebb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:33.869136 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.869079    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcbgv\" (UniqueName: \"kubernetes.io/projected/095b05fa-3218-4524-acaa-eb517fe2bebb-kube-api-access-rcbgv\") pod \"payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs\" (UID: \"095b05fa-3218-4524-acaa-eb517fe2bebb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:33.970453 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.970412    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095b05fa-3218-4524-acaa-eb517fe2bebb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs\" (UID: \"095b05fa-3218-4524-acaa-eb517fe2bebb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:33.970453 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.970453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcbgv\" (UniqueName: \"kubernetes.io/projected/095b05fa-3218-4524-acaa-eb517fe2bebb-kube-api-access-rcbgv\") pod \"payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs\" (UID: \"095b05fa-3218-4524-acaa-eb517fe2bebb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:33.971254 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.971235    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095b05fa-3218-4524-acaa-eb517fe2bebb-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs\" (UID: \"095b05fa-3218-4524-acaa-eb517fe2bebb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:33.978646 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:33.978612    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcbgv\" (UniqueName: \"kubernetes.io/projected/095b05fa-3218-4524-acaa-eb517fe2bebb-kube-api-access-rcbgv\") pod \"payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs\" (UID: \"095b05fa-3218-4524-acaa-eb517fe2bebb\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:34.032711 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:34.032673    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:34.187138 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:34.187112    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"]
Jul 30 23:40:34.189625 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:40:34.189594    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod095b05fa_3218_4524_acaa_eb517fe2bebb.slice/crio-66d000e3b75057b97bb190c8aca75eb3a590fd97719b7e1b4e07afe6aaad5ab1 WatchSource:0}: Error finding container 66d000e3b75057b97bb190c8aca75eb3a590fd97719b7e1b4e07afe6aaad5ab1: Status 404 returned error can't find the container with id 66d000e3b75057b97bb190c8aca75eb3a590fd97719b7e1b4e07afe6aaad5ab1
Jul 30 23:40:34.312230 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:34.312167    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs" event={"ID":"095b05fa-3218-4524-acaa-eb517fe2bebb","Type":"ContainerStarted","Data":"66d000e3b75057b97bb190c8aca75eb3a590fd97719b7e1b4e07afe6aaad5ab1"}
Jul 30 23:40:35.958764 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:35.958713    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:40:36.323660 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:36.323626    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs" event={"ID":"095b05fa-3218-4524-acaa-eb517fe2bebb","Type":"ContainerStarted","Data":"970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c"}
Jul 30 23:40:36.323827 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:36.323744    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:36.341171 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:36.341121    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs" podStartSLOduration=1.407697379 podStartE2EDuration="3.341102554s" totalImagesPullingTime="1.933405175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:40:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:40:36.340269558 +0000 UTC m=+3160.071414735" watchObservedRunningTime="2026-07-30 23:40:36.341102554 +0000 UTC m=+3160.072247717"
Jul 30 23:40:47.333643 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:47.333612    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:40:56.752306 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:56.752265    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:57.396365 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.396275    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:57.667715 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.667635    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"]
Jul 30 23:40:57.673053 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.673030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.675480 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.675455    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 23:40:57.675613 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.675512    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-25ff25-openshift-default-dockercfg-mhf86\""
Jul 30 23:40:57.680848 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.680414    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"]
Jul 30 23:40:57.681397 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-data\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.681511 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914cd676-195d-4879-a42d-927807da3b6f-istio-podinfo\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.681511 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-socket\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.681648 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681521    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914cd676-195d-4879-a42d-927807da3b6f-istiod-ca-cert\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.681648 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681575    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-credential-socket\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.681762 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681661    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-envoy\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.681762 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-certs\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.681850 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlzkg\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-kube-api-access-wlzkg\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.681850 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.681807    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-istio-token\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.701517 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.701486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:57.782669 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.782633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-certs\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.782675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlzkg\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-kube-api-access-wlzkg\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.782698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-istio-token\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.782729    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-data\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.782883    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914cd676-195d-4879-a42d-927807da3b6f-istio-podinfo\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.782924    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-socket\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.782962    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914cd676-195d-4879-a42d-927807da3b6f-istiod-ca-cert\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.783005    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-credential-socket\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.783050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-data\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783536 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.783109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-certs\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783536 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.783115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-envoy\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783536 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.783353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-credential-socket\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783536 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.783388    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-socket\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.783779 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.783754    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914cd676-195d-4879-a42d-927807da3b6f-istiod-ca-cert\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.785253 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.785230    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-envoy\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.785453 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.785436    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914cd676-195d-4879-a42d-927807da3b6f-istio-podinfo\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.790667 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.790643    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-istio-token\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.790762 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.790717    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlzkg\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-kube-api-access-wlzkg\") pod \"e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") " pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:57.908067 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.908027    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:40:57.985266 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:57.985155    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:40:58.124934 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:58.124904    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"]
Jul 30 23:40:58.430669 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:40:58.430627    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" event={"ID":"914cd676-195d-4879-a42d-927807da3b6f","Type":"ContainerStarted","Data":"c71a18234a3383a39ec7b3f736a97ba0918a7903d75d6b92ba476498cd1e0fb1"}
Jul 30 23:41:01.057538 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:01.057503    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:41:01.057783 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:01.057577    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:41:01.057783 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:01.057605    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:41:01.447490 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:01.447391    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" event={"ID":"914cd676-195d-4879-a42d-927807da3b6f","Type":"ContainerStarted","Data":"6a6a008e1276b06d2af04642ed61f7ed52c53c11c5eb663d2dc5de8eeb5e82bf"}
Jul 30 23:41:01.468698 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:01.468633    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" podStartSLOduration=1.543568904 podStartE2EDuration="4.468612848s" totalImagesPullingTime="2.925043944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:40:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:41:01.467954646 +0000 UTC m=+3185.199099820" watchObservedRunningTime="2026-07-30 23:41:01.468612848 +0000 UTC m=+3185.199758010"
Jul 30 23:41:01.986132 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:01.986098    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:02.991363 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:02.991322    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:03.365521 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:03.365486    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:41:03.458002 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:03.457959    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:03.459002 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:03.458982    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:03.465638 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:03.465610    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:41:04.501829 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:04.501788    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:41:04.847574 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:04.847493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:41:04.991567 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:04.991527    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:41:05.090660 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.090620    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:41:05.094652 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.094624    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"]
Jul 30 23:41:05.098118 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.098072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:05.103123 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.103101    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-25ff25\""
Jul 30 23:41:05.103264 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.103105    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-25ff25-dockercfg-c4zq9\""
Jul 30 23:41:05.113953 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.113920    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"]
Jul 30 23:41:05.129919 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.129888    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"]
Jul 30 23:41:05.133321 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.133300    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:05.150431 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.150391    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1510864b-78fc-4958-9dca-cbf772200bae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz\" (UID: \"1510864b-78fc-4958-9dca-cbf772200bae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:05.150600 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.150470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8n4j\" (UniqueName: \"kubernetes.io/projected/1510864b-78fc-4958-9dca-cbf772200bae-kube-api-access-d8n4j\") pod \"payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz\" (UID: \"1510864b-78fc-4958-9dca-cbf772200bae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:05.150782 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.150762    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"]
Jul 30 23:41:05.251124 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.251087    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eda15bc-1f2e-474d-9e48-41561a52ac00-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8\" (UID: \"0eda15bc-1f2e-474d-9e48-41561a52ac00\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:05.251341 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.251134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8n4j\" (UniqueName: \"kubernetes.io/projected/1510864b-78fc-4958-9dca-cbf772200bae-kube-api-access-d8n4j\") pod \"payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz\" (UID: \"1510864b-78fc-4958-9dca-cbf772200bae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:05.251341 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.251278    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd6mw\" (UniqueName: \"kubernetes.io/projected/0eda15bc-1f2e-474d-9e48-41561a52ac00-kube-api-access-zd6mw\") pod \"payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8\" (UID: \"0eda15bc-1f2e-474d-9e48-41561a52ac00\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:05.251421 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.251343    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1510864b-78fc-4958-9dca-cbf772200bae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz\" (UID: \"1510864b-78fc-4958-9dca-cbf772200bae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:05.252113 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.252080    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1510864b-78fc-4958-9dca-cbf772200bae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz\" (UID: \"1510864b-78fc-4958-9dca-cbf772200bae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:05.259769 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.259734    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8n4j\" (UniqueName: \"kubernetes.io/projected/1510864b-78fc-4958-9dca-cbf772200bae-kube-api-access-d8n4j\") pod \"payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz\" (UID: \"1510864b-78fc-4958-9dca-cbf772200bae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:05.352886 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.352790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd6mw\" (UniqueName: \"kubernetes.io/projected/0eda15bc-1f2e-474d-9e48-41561a52ac00-kube-api-access-zd6mw\") pod \"payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8\" (UID: \"0eda15bc-1f2e-474d-9e48-41561a52ac00\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:05.352886 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.352859    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eda15bc-1f2e-474d-9e48-41561a52ac00-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8\" (UID: \"0eda15bc-1f2e-474d-9e48-41561a52ac00\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:05.353618 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.353599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eda15bc-1f2e-474d-9e48-41561a52ac00-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8\" (UID: \"0eda15bc-1f2e-474d-9e48-41561a52ac00\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:05.361418 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.361387    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd6mw\" (UniqueName: \"kubernetes.io/projected/0eda15bc-1f2e-474d-9e48-41561a52ac00-kube-api-access-zd6mw\") pod \"payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8\" (UID: \"0eda15bc-1f2e-474d-9e48-41561a52ac00\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:05.408841 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.408806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:05.447422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.447389    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:05.556304 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.556227    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"]
Jul 30 23:41:05.558211 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:41:05.558164    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1510864b_78fc_4958_9dca_cbf772200bae.slice/crio-4465b656f157400098b78114185fcc644e53c551b7ddc80067615406f2ff101f WatchSource:0}: Error finding container 4465b656f157400098b78114185fcc644e53c551b7ddc80067615406f2ff101f: Status 404 returned error can't find the container with id 4465b656f157400098b78114185fcc644e53c551b7ddc80067615406f2ff101f
Jul 30 23:41:05.598877 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:05.598850    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"]
Jul 30 23:41:05.601784 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:41:05.601753    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eda15bc_1f2e_474d_9e48_41561a52ac00.slice/crio-f5d0cc81de5b00d339c0ac5babd79d07a26807be8e4b107255ff98cceef30965 WatchSource:0}: Error finding container f5d0cc81de5b00d339c0ac5babd79d07a26807be8e4b107255ff98cceef30965: Status 404 returned error can't find the container with id f5d0cc81de5b00d339c0ac5babd79d07a26807be8e4b107255ff98cceef30965
Jul 30 23:41:06.475812 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:06.475768    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz" event={"ID":"1510864b-78fc-4958-9dca-cbf772200bae","Type":"ContainerStarted","Data":"839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb"}
Jul 30 23:41:06.476023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:06.475839    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz" event={"ID":"1510864b-78fc-4958-9dca-cbf772200bae","Type":"ContainerStarted","Data":"4465b656f157400098b78114185fcc644e53c551b7ddc80067615406f2ff101f"}
Jul 30 23:41:06.476023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:06.475868    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:06.477149 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:06.477125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8" event={"ID":"0eda15bc-1f2e-474d-9e48-41561a52ac00","Type":"ContainerStarted","Data":"6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f"}
Jul 30 23:41:06.477281 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:06.477165    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8" event={"ID":"0eda15bc-1f2e-474d-9e48-41561a52ac00","Type":"ContainerStarted","Data":"f5d0cc81de5b00d339c0ac5babd79d07a26807be8e4b107255ff98cceef30965"}
Jul 30 23:41:06.477281 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:06.477199    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:06.494255 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:06.494199    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz" podStartSLOduration=1.494163291 podStartE2EDuration="1.494163291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:41:06.492368544 +0000 UTC m=+3190.223513706" watchObservedRunningTime="2026-07-30 23:41:06.494163291 +0000 UTC m=+3190.225308501"
Jul 30 23:41:06.509994 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:06.509924    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8" podStartSLOduration=1.509901057 podStartE2EDuration="1.509901057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:41:06.507403931 +0000 UTC m=+3190.238549113" watchObservedRunningTime="2026-07-30 23:41:06.509901057 +0000 UTC m=+3190.241046220"
Jul 30 23:41:07.308888 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:07.308844    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:41:17.483408 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:17.483367    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:41:17.483935 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:17.483456    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:41:17.540645 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:17.540560    2561 generic.go:356] "Generic (PLEG): container finished" podID="914cd676-195d-4879-a42d-927807da3b6f" containerID="6a6a008e1276b06d2af04642ed61f7ed52c53c11c5eb663d2dc5de8eeb5e82bf" exitCode=0
Jul 30 23:41:17.540645 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:17.540625    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" event={"ID":"914cd676-195d-4879-a42d-927807da3b6f","Type":"ContainerDied","Data":"6a6a008e1276b06d2af04642ed61f7ed52c53c11c5eb663d2dc5de8eeb5e82bf"}
Jul 30 23:41:17.541170 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:17.541151    2561 scope.go:117] "RemoveContainer" containerID="6a6a008e1276b06d2af04642ed61f7ed52c53c11c5eb663d2dc5de8eeb5e82bf"
Jul 30 23:41:17.543953 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:17.543920    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:41:17.544095 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:17.544026    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:41:17.544095 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:17.544065    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:41:18.458399 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:18.458346    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:18.548494 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:18.548455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" event={"ID":"914cd676-195d-4879-a42d-927807da3b6f","Type":"ContainerStarted","Data":"599f4c980d656994564b5b16e8ae620774bc276860064e6a345aa9def2bd7f7b"}
Jul 30 23:41:18.986059 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:18.986018    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:18.987274 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:18.987249    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:41:18.987344 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:18.987313    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 30 23:41:19.985904 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:19.985867    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:41:19.986341 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:19.985933    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 30 23:41:20.986422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:20.986384    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:41:20.986825 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:20.986449    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 30 23:41:21.986294 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:21.986254    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:41:21.986487 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:21.986311    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 30 23:41:22.985625 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:22.985589    2561 patch_prober.go:28] interesting pod/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Jul 30 23:41:22.985817 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:22.985644    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Jul 30 23:41:23.989948 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:23.989916    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:23.990363 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:23.990282    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:23.991097 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:23.991079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:41:28.332480 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:28.332439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:41:35.334046 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:35.334011    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8_0eda15bc-1f2e-474d-9e48-41561a52ac00/payload-processing/0.log"
Jul 30 23:41:46.538946 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.538910    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"]
Jul 30 23:41:46.542342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.542321    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.545297 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.545275    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-05d70d\"/\"kube-root-ca.crt\""
Jul 30 23:41:46.545441 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.545276    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-05d70d\"/\"default-dockercfg-w85b5\""
Jul 30 23:41:46.546402 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.546383    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-05d70d\"/\"ipp-route-05d70d-kserve-self-signed-certs\""
Jul 30 23:41:46.546495 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.546401    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-05d70d\"/\"openshift-service-ca.crt\""
Jul 30 23:41:46.551598 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.551575    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"]
Jul 30 23:41:46.569139 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.569109    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:41:46.671252 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.671210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72c74788-dfac-4298-be21-563ef29d4f5b-tls-certs\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.671252 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.671258    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw8rm\" (UniqueName: \"kubernetes.io/projected/72c74788-dfac-4298-be21-563ef29d4f5b-kube-api-access-fw8rm\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.671481 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.671300    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-dshm\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.671481 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.671317    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-tmp-dir\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.671481 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.671467    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-home\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.671579 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.671494    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-model-cache\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.772719 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.772684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-home\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.772719 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.772723    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-model-cache\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.772985 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.772742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72c74788-dfac-4298-be21-563ef29d4f5b-tls-certs\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.772985 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.772769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw8rm\" (UniqueName: \"kubernetes.io/projected/72c74788-dfac-4298-be21-563ef29d4f5b-kube-api-access-fw8rm\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.772985 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.772804    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-dshm\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.772985 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.772819    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-tmp-dir\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.773273 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.773240    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-model-cache\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.773327 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.773266    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-home\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.773327 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.773302    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-tmp-dir\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.775057 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.775021    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-dshm\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.775480 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.775464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72c74788-dfac-4298-be21-563ef29d4f5b-tls-certs\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.781628 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.781602    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw8rm\" (UniqueName: \"kubernetes.io/projected/72c74788-dfac-4298-be21-563ef29d4f5b-kube-api-access-fw8rm\") pod \"ipp-route-05d70d-kserve-9c5cd86c-w7z7q\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") " pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.852627 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.852525    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:46.988929 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:46.988901    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"]
Jul 30 23:41:46.991152 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:41:46.991124    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72c74788_dfac_4298_be21_563ef29d4f5b.slice/crio-307367600cde61d2def709e007809647706f2d50dc2f23f0b14f398470934b19 WatchSource:0}: Error finding container 307367600cde61d2def709e007809647706f2d50dc2f23f0b14f398470934b19: Status 404 returned error can't find the container with id 307367600cde61d2def709e007809647706f2d50dc2f23f0b14f398470934b19
Jul 30 23:41:47.687244 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:47.687204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q" event={"ID":"72c74788-dfac-4298-be21-563ef29d4f5b","Type":"ContainerStarted","Data":"c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801"}
Jul 30 23:41:47.687780 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:47.687250    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q" event={"ID":"72c74788-dfac-4298-be21-563ef29d4f5b","Type":"ContainerStarted","Data":"307367600cde61d2def709e007809647706f2d50dc2f23f0b14f398470934b19"}
Jul 30 23:41:47.705739 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:47.705681    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q" podStartSLOduration=1.705663998 podStartE2EDuration="1.705663998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:41:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:41:47.703530482 +0000 UTC m=+3231.434675645" watchObservedRunningTime="2026-07-30 23:41:47.705663998 +0000 UTC m=+3231.436809150"
Jul 30 23:41:49.368509 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:49.368424    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:41:56.852780 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:56.852740    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:56.852780 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:56.852790    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:56.865474 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:56.865446    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:41:57.744256 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:41:57.744228    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:42:14.067846 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:14.067806    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:42:25.359250 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:25.359218    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8_0eda15bc-1f2e-474d-9e48-41561a52ac00/payload-processing/0.log"
Jul 30 23:42:25.902634 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:25.902592    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"]
Jul 30 23:42:25.906978 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:25.906953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:25.910015 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:25.909960    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-07db9c-openshift-default-dockercfg-64tth\""
Jul 30 23:42:25.919845 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:25.919814    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"]
Jul 30 23:42:26.041940 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.041898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-credential-socket\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.041940 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.041947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-socket\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.042225 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.042006    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6pkl\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-kube-api-access-t6pkl\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.042225 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.042055    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-data\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.042225 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.042098    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-envoy\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.042225 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.042134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-podinfo\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.042361 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.042251    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.042361 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.042287    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-token\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.042429 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.042366    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-certs\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143483 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-token\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143681 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-certs\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143681 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-credential-socket\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143681 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-socket\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143681 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6pkl\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-kube-api-access-t6pkl\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143681 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-data\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143942 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143697    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-envoy\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143942 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-podinfo\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.143942 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.144104 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-certs\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.144104 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.143985    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-credential-socket\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.144104 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.144046    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-data\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.144274 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.144109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-socket\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.144483 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.144454    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.146129 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.146097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-envoy\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.146248 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.146211    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-podinfo\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.151391 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.151369    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-token\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.151911 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.151889    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6pkl\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-kube-api-access-t6pkl\") pod \"e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") " pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.218290 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.218166    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:26.364738 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.364603    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"]
Jul 30 23:42:26.367516 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:42:26.367487    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d308bdf_de99_40bb_8df4_9bdc8ab3671b.slice/crio-5646d9519c55e7ab6a79fe34dd02d54eecd41b626c5f9df942b214cbf52beefe WatchSource:0}: Error finding container 5646d9519c55e7ab6a79fe34dd02d54eecd41b626c5f9df942b214cbf52beefe: Status 404 returned error can't find the container with id 5646d9519c55e7ab6a79fe34dd02d54eecd41b626c5f9df942b214cbf52beefe
Jul 30 23:42:26.369667 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.369635    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:42:26.369743 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.369700    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:42:26.369743 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.369730    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:42:26.418049 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.418017    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:42:26.882942 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.882900    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" event={"ID":"9d308bdf-de99-40bb-8df4-9bdc8ab3671b","Type":"ContainerStarted","Data":"4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0"}
Jul 30 23:42:26.883129 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.882965    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" event={"ID":"9d308bdf-de99-40bb-8df4-9bdc8ab3671b","Type":"ContainerStarted","Data":"5646d9519c55e7ab6a79fe34dd02d54eecd41b626c5f9df942b214cbf52beefe"}
Jul 30 23:42:26.903762 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:26.903704    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" podStartSLOduration=1.903686513 podStartE2EDuration="1.903686513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:42:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:42:26.901216235 +0000 UTC m=+3270.632361425" watchObservedRunningTime="2026-07-30 23:42:26.903686513 +0000 UTC m=+3270.634831668"
Jul 30 23:42:27.219342 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:27.219250    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:27.224638 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:27.224613    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:27.541206 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:27.541149    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:42:27.887461 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:27.887375    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:27.888290 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:27.888270    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:28.882013 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:28.881976    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:42:28.981354 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:28.981315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:42:30.009550 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.009516    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:42:30.387538 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.387455    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:42:30.501681 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.501653    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:42:30.596812 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.596775    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:42:30.602280 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.602250    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"]
Jul 30 23:42:30.605852 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.605834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:30.609452 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.609421    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-07db9c\""
Jul 30 23:42:30.609560 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.609424    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-07db9c-dockercfg-7ps4j\""
Jul 30 23:42:30.617509 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.617486    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"]
Jul 30 23:42:30.639298 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.639222    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"]
Jul 30 23:42:30.642843 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.642816    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:30.653769 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.653743    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"]
Jul 30 23:42:30.690056 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.690012    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrfjr\" (UniqueName: \"kubernetes.io/projected/f753632f-2622-4f4f-9632-c4bb5678a8b5-kube-api-access-zrfjr\") pod \"payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8\" (UID: \"f753632f-2622-4f4f-9632-c4bb5678a8b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:30.690056 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.690057    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f753632f-2622-4f4f-9632-c4bb5678a8b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8\" (UID: \"f753632f-2622-4f4f-9632-c4bb5678a8b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:30.791293 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.791259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f753632f-2622-4f4f-9632-c4bb5678a8b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8\" (UID: \"f753632f-2622-4f4f-9632-c4bb5678a8b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:30.791484 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.791371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr\" (UID: \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:30.791484 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.791433    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wxkt\" (UniqueName: \"kubernetes.io/projected/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-kube-api-access-4wxkt\") pod \"payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr\" (UID: \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:30.791584 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.791514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrfjr\" (UniqueName: \"kubernetes.io/projected/f753632f-2622-4f4f-9632-c4bb5678a8b5-kube-api-access-zrfjr\") pod \"payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8\" (UID: \"f753632f-2622-4f4f-9632-c4bb5678a8b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:30.792084 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.792066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f753632f-2622-4f4f-9632-c4bb5678a8b5-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8\" (UID: \"f753632f-2622-4f4f-9632-c4bb5678a8b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:30.800068 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.800045    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrfjr\" (UniqueName: \"kubernetes.io/projected/f753632f-2622-4f4f-9632-c4bb5678a8b5-kube-api-access-zrfjr\") pod \"payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8\" (UID: \"f753632f-2622-4f4f-9632-c4bb5678a8b5\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:30.892157 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.892063    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr\" (UID: \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:30.892157 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.892127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wxkt\" (UniqueName: \"kubernetes.io/projected/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-kube-api-access-4wxkt\") pod \"payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr\" (UID: \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:30.892814 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.892791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr\" (UID: \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:30.899977 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.899955    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wxkt\" (UniqueName: \"kubernetes.io/projected/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-kube-api-access-4wxkt\") pod \"payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr\" (UID: \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:30.919481 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.919447    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:30.954601 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:30.954566    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:31.071304 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.071272    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"]
Jul 30 23:42:31.073864 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:42:31.073829    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf753632f_2622_4f4f_9632_c4bb5678a8b5.slice/crio-201dfd419dc622da4e08f94a46d02b663e1685b2e7254bd3f3ab9fce10e73585 WatchSource:0}: Error finding container 201dfd419dc622da4e08f94a46d02b663e1685b2e7254bd3f3ab9fce10e73585: Status 404 returned error can't find the container with id 201dfd419dc622da4e08f94a46d02b663e1685b2e7254bd3f3ab9fce10e73585
Jul 30 23:42:31.108948 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.108918    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"]
Jul 30 23:42:31.111610 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:42:31.111581    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8439e151_54d2_4bb1_b84c_7f61dbdbc5f1.slice/crio-e4d23ff9f70cccd9ba334a6135924d3fae53c8be12041facbaba2e9271020eee WatchSource:0}: Error finding container e4d23ff9f70cccd9ba334a6135924d3fae53c8be12041facbaba2e9271020eee: Status 404 returned error can't find the container with id e4d23ff9f70cccd9ba334a6135924d3fae53c8be12041facbaba2e9271020eee
Jul 30 23:42:31.912728 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.912684    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8" event={"ID":"f753632f-2622-4f4f-9632-c4bb5678a8b5","Type":"ContainerStarted","Data":"90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa"}
Jul 30 23:42:31.912933 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.912762    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:31.912933 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.912789    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8" event={"ID":"f753632f-2622-4f4f-9632-c4bb5678a8b5","Type":"ContainerStarted","Data":"201dfd419dc622da4e08f94a46d02b663e1685b2e7254bd3f3ab9fce10e73585"}
Jul 30 23:42:31.914216 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.914172    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr" event={"ID":"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1","Type":"ContainerStarted","Data":"bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e"}
Jul 30 23:42:31.914351 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.914233    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr" event={"ID":"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1","Type":"ContainerStarted","Data":"e4d23ff9f70cccd9ba334a6135924d3fae53c8be12041facbaba2e9271020eee"}
Jul 30 23:42:31.914351 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.914322    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:31.928188 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.928137    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8" podStartSLOduration=1.9281197799999998 podStartE2EDuration="1.92811978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:42:31.927665486 +0000 UTC m=+3275.658810668" watchObservedRunningTime="2026-07-30 23:42:31.92811978 +0000 UTC m=+3275.659264941"
Jul 30 23:42:31.943368 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:31.943311    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr" podStartSLOduration=1.943295199 podStartE2EDuration="1.943295199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:42:31.942425907 +0000 UTC m=+3275.673571092" watchObservedRunningTime="2026-07-30 23:42:31.943295199 +0000 UTC m=+3275.674440359"
Jul 30 23:42:35.862693 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:35.862660    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:42:42.921226 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:42.921166    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:42:42.921674 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:42.921272    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:42:43.929393 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:43.929348    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 30 23:42:43.929814 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:43.929426    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 30 23:42:45.987871 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:45.987785    2561 generic.go:356] "Generic (PLEG): container finished" podID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerID="4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0" exitCode=0
Jul 30 23:42:45.988308 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:45.987860    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" event={"ID":"9d308bdf-de99-40bb-8df4-9bdc8ab3671b","Type":"ContainerDied","Data":"4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0"}
Jul 30 23:42:45.988308 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:45.988261    2561 scope.go:117] "RemoveContainer" containerID="4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0"
Jul 30 23:42:45.989426 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:45.989403    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:42:45.989495 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:45.989462    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:42:45.989538 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:45.989498    2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 30 23:42:46.996375 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:46.996340    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" event={"ID":"9d308bdf-de99-40bb-8df4-9bdc8ab3671b","Type":"ContainerStarted","Data":"9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a"}
Jul 30 23:42:47.218604 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:47.218561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:47.219016 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:47.218984    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 30 23:42:47.219227 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:47.219200    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 30 23:42:48.219655 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:48.219604    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 30 23:42:48.220207 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:48.219678    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 30 23:42:49.219694 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:49.219656    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 30 23:42:49.220331 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:49.220299    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 30 23:42:50.219243 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:50.219196    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 30 23:42:50.219471 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:50.219266    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 30 23:42:51.219301 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:51.219252    2561 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Jul 30 23:42:51.219927 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:51.219888    2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Jul 30 23:42:52.222557 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:52.222527    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:52.222971 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:52.222906    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:52.223657 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:52.223636    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:42:53.769594 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:42:53.769560    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:00.623441 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.623394    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:00.659865 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.659826    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"]
Jul 30 23:43:00.660095 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.660069    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr" podUID="8439e151-54d2-4bb1-b84c-7f61dbdbc5f1" containerName="payload-processing" containerID="cri-o://bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e" gracePeriod=30
Jul 30 23:43:00.667842 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.667803    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"]
Jul 30 23:43:00.670024 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.668146    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8" podUID="f753632f-2622-4f4f-9632-c4bb5678a8b5" containerName="payload-pre-processing" containerID="cri-o://90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa" gracePeriod=30
Jul 30 23:43:00.697413 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.697344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:00.799041 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.798956    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:00.878593 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.878468    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:00.930950 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.930926    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:43:00.975467 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.975435    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:43:00.991833 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.991803    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-plugins-config-volume\") pod \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\" (UID: \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\") "
Jul 30 23:43:00.992026 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.991868    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wxkt\" (UniqueName: \"kubernetes.io/projected/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-kube-api-access-4wxkt\") pod \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\" (UID: \"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1\") "
Jul 30 23:43:00.992268 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.992244    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8439e151-54d2-4bb1-b84c-7f61dbdbc5f1" (UID: "8439e151-54d2-4bb1-b84c-7f61dbdbc5f1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:43:00.994041 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:00.994022    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-kube-api-access-4wxkt" (OuterVolumeSpecName: "kube-api-access-4wxkt") pod "8439e151-54d2-4bb1-b84c-7f61dbdbc5f1" (UID: "8439e151-54d2-4bb1-b84c-7f61dbdbc5f1"). InnerVolumeSpecName "kube-api-access-4wxkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:43:01.077565 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.077525    2561 generic.go:356] "Generic (PLEG): container finished" podID="8439e151-54d2-4bb1-b84c-7f61dbdbc5f1" containerID="bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e" exitCode=0
Jul 30 23:43:01.077760 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.077577    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"
Jul 30 23:43:01.077760 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.077609    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr" event={"ID":"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1","Type":"ContainerDied","Data":"bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e"}
Jul 30 23:43:01.077760 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.077656    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr" event={"ID":"8439e151-54d2-4bb1-b84c-7f61dbdbc5f1","Type":"ContainerDied","Data":"e4d23ff9f70cccd9ba334a6135924d3fae53c8be12041facbaba2e9271020eee"}
Jul 30 23:43:01.077760 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.077684    2561 scope.go:117] "RemoveContainer" containerID="bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e"
Jul 30 23:43:01.078953 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.078931    2561 generic.go:356] "Generic (PLEG): container finished" podID="f753632f-2622-4f4f-9632-c4bb5678a8b5" containerID="90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa" exitCode=0
Jul 30 23:43:01.079030 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.078973    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8" event={"ID":"f753632f-2622-4f4f-9632-c4bb5678a8b5","Type":"ContainerDied","Data":"90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa"}
Jul 30 23:43:01.079030 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.078980    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"
Jul 30 23:43:01.079030 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.079008    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8" event={"ID":"f753632f-2622-4f4f-9632-c4bb5678a8b5","Type":"ContainerDied","Data":"201dfd419dc622da4e08f94a46d02b663e1685b2e7254bd3f3ab9fce10e73585"}
Jul 30 23:43:01.086933 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.086915    2561 scope.go:117] "RemoveContainer" containerID="bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e"
Jul 30 23:43:01.087320 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:43:01.087299    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e\": container with ID starting with bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e not found: ID does not exist" containerID="bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e"
Jul 30 23:43:01.087422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.087335    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e"} err="failed to get container status \"bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e\": rpc error: code = NotFound desc = could not find container \"bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e\": container with ID starting with bf477619336bfaabc8b9ddcbad224b6059634a1c41f68fb0436c8805444d409e not found: ID does not exist"
Jul 30 23:43:01.087422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.087358    2561 scope.go:117] "RemoveContainer" containerID="90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa"
Jul 30 23:43:01.093277 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.093256    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrfjr\" (UniqueName: \"kubernetes.io/projected/f753632f-2622-4f4f-9632-c4bb5678a8b5-kube-api-access-zrfjr\") pod \"f753632f-2622-4f4f-9632-c4bb5678a8b5\" (UID: \"f753632f-2622-4f4f-9632-c4bb5678a8b5\") "
Jul 30 23:43:01.093390 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.093300    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f753632f-2622-4f4f-9632-c4bb5678a8b5-plugins-config-volume\") pod \"f753632f-2622-4f4f-9632-c4bb5678a8b5\" (UID: \"f753632f-2622-4f4f-9632-c4bb5678a8b5\") "
Jul 30 23:43:01.093534 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.093519    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-plugins-config-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:01.093596 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.093571    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wxkt\" (UniqueName: \"kubernetes.io/projected/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1-kube-api-access-4wxkt\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:01.093748 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.093723    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f753632f-2622-4f4f-9632-c4bb5678a8b5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f753632f-2622-4f4f-9632-c4bb5678a8b5" (UID: "f753632f-2622-4f4f-9632-c4bb5678a8b5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:43:01.095242 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.095220    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f753632f-2622-4f4f-9632-c4bb5678a8b5-kube-api-access-zrfjr" (OuterVolumeSpecName: "kube-api-access-zrfjr") pod "f753632f-2622-4f4f-9632-c4bb5678a8b5" (UID: "f753632f-2622-4f4f-9632-c4bb5678a8b5"). InnerVolumeSpecName "kube-api-access-zrfjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:43:01.095559 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.095544    2561 scope.go:117] "RemoveContainer" containerID="90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa"
Jul 30 23:43:01.095809 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:43:01.095790    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa\": container with ID starting with 90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa not found: ID does not exist" containerID="90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa"
Jul 30 23:43:01.095857 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.095816    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa"} err="failed to get container status \"90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa\": rpc error: code = NotFound desc = could not find container \"90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa\": container with ID starting with 90a6acf8066d7b96dd73145362f8e89550be4ef54ec061a3c5d25a30cbfd88fa not found: ID does not exist"
Jul 30 23:43:01.099049 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.099013    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"]
Jul 30 23:43:01.101765 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.101744    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-07db9c-8458559d98-87dpr"]
Jul 30 23:43:01.193543 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.193449    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:01.194633 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.194611    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrfjr\" (UniqueName: \"kubernetes.io/projected/f753632f-2622-4f4f-9632-c4bb5678a8b5-kube-api-access-zrfjr\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:01.194699 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.194640    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f753632f-2622-4f4f-9632-c4bb5678a8b5-plugins-config-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:01.401318 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.401284    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"]
Jul 30 23:43:01.405390 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:01.405362    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-07db9c-54f4b9f668-5cql8"]
Jul 30 23:43:02.697776 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:02.697741    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8439e151-54d2-4bb1-b84c-7f61dbdbc5f1" path="/var/lib/kubelet/pods/8439e151-54d2-4bb1-b84c-7f61dbdbc5f1/volumes"
Jul 30 23:43:02.698236 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:02.698167    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f753632f-2622-4f4f-9632-c4bb5678a8b5" path="/var/lib/kubelet/pods/f753632f-2622-4f4f-9632-c4bb5678a8b5/volumes"
Jul 30 23:43:03.656033 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:03.655994    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:43:05.891014 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:05.890979    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:05.947239 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:05.947206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:07.053653 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:07.053618    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:07.116441 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:07.116407    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:07.303257 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:07.303215    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"]
Jul 30 23:43:07.303500 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:07.303475    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy" containerID="cri-o://9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a" gracePeriod=30
Jul 30 23:43:07.317148 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:07.317113    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:07.539404 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:07.539373    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:12.563562 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.563533    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:43:12.707805 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.707719    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t6pkl\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-kube-api-access-t6pkl\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.707805 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.707790    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istiod-ca-cert\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.708012 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.707819    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-token\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.708012 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.707889    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-podinfo\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.708012 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.707917    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-data\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.708012 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.707952    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-envoy\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.708012 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.707983    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-socket\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.708293 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708065    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-credential-socket\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.708293 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708114    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-certs\") pod \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\" (UID: \"9d308bdf-de99-40bb-8df4-9bdc8ab3671b\") "
Jul 30 23:43:12.708410 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708279    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:43:12.708410 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708286    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-data" (OuterVolumeSpecName: "istio-data") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:12.708518 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708412    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:12.708518 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708494    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-data\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:12.708518 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708503    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:12.708518 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708513    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istiod-ca-cert\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:12.708711 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.708514    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:12.710361 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.710317    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-kube-api-access-t6pkl" (OuterVolumeSpecName: "kube-api-access-t6pkl") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "kube-api-access-t6pkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:43:12.710487 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.710386    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:12.710557 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.710512    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:43:12.710615 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.710596    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-token" (OuterVolumeSpecName: "istio-token") pod "9d308bdf-de99-40bb-8df4-9bdc8ab3671b" (UID: "9d308bdf-de99-40bb-8df4-9bdc8ab3671b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:43:12.809926 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.809890    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-podinfo\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:12.809926 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.809922    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-envoy\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:12.809926 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.809932    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-socket\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:12.810221 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.809940    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-credential-socket\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:12.810221 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.809948    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-workload-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:12.810221 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.809957    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t6pkl\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-kube-api-access-t6pkl\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:12.810221 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:12.809965    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9d308bdf-de99-40bb-8df4-9bdc8ab3671b-istio-token\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:13.150697 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.150661    2561 generic.go:356] "Generic (PLEG): container finished" podID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerID="9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a" exitCode=0
Jul 30 23:43:13.150871 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.150705    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"
Jul 30 23:43:13.150871 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.150748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" event={"ID":"9d308bdf-de99-40bb-8df4-9bdc8ab3671b","Type":"ContainerDied","Data":"9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a"}
Jul 30 23:43:13.150871 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.150804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw" event={"ID":"9d308bdf-de99-40bb-8df4-9bdc8ab3671b","Type":"ContainerDied","Data":"5646d9519c55e7ab6a79fe34dd02d54eecd41b626c5f9df942b214cbf52beefe"}
Jul 30 23:43:13.150871 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.150827    2561 scope.go:117] "RemoveContainer" containerID="9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a"
Jul 30 23:43:13.159802 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.159780    2561 scope.go:117] "RemoveContainer" containerID="4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0"
Jul 30 23:43:13.173193 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.173149    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"]
Jul 30 23:43:13.173549 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.173534    2561 scope.go:117] "RemoveContainer" containerID="9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a"
Jul 30 23:43:13.173840 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:43:13.173820    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a\": container with ID starting with 9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a not found: ID does not exist" containerID="9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a"
Jul 30 23:43:13.173885 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.173850    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a"} err="failed to get container status \"9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a\": rpc error: code = NotFound desc = could not find container \"9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a\": container with ID starting with 9feec4052a714c9bbf080c0ee3f85384741b1546a4dc8e254724821c9a4d488a not found: ID does not exist"
Jul 30 23:43:13.173885 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.173871    2561 scope.go:117] "RemoveContainer" containerID="4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0"
Jul 30 23:43:13.174128 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:43:13.174114    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0\": container with ID starting with 4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0 not found: ID does not exist" containerID="4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0"
Jul 30 23:43:13.174168 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.174131    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0"} err="failed to get container status \"4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0\": rpc error: code = NotFound desc = could not find container \"4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0\": container with ID starting with 4b33286202db8cf8ea45c8ed29310b83363455049974a909207c07595c4661f0 not found: ID does not exist"
Jul 30 23:43:13.177037 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:13.177012    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-07db9c-openshift-default-69b8986566-bbxnw"]
Jul 30 23:43:14.698163 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:14.698127    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" path="/var/lib/kubelet/pods/9d308bdf-de99-40bb-8df4-9bdc8ab3671b/volumes"
Jul 30 23:43:24.758584 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:24.758490    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:43:26.405255 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.405216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:26.444348 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.444306    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"]
Jul 30 23:43:26.444656 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.444624    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs" podUID="095b05fa-3218-4524-acaa-eb517fe2bebb" containerName="payload-pre-processing" containerID="cri-o://970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c" gracePeriod=30
Jul 30 23:43:26.467665 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.467634    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:26.524899 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.524853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:26.597159 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.597126    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:26.699436 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.699411    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:43:26.736144 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.736113    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcbgv\" (UniqueName: \"kubernetes.io/projected/095b05fa-3218-4524-acaa-eb517fe2bebb-kube-api-access-rcbgv\") pod \"095b05fa-3218-4524-acaa-eb517fe2bebb\" (UID: \"095b05fa-3218-4524-acaa-eb517fe2bebb\") "
Jul 30 23:43:26.736333 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.736171    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095b05fa-3218-4524-acaa-eb517fe2bebb-plugins-config-volume\") pod \"095b05fa-3218-4524-acaa-eb517fe2bebb\" (UID: \"095b05fa-3218-4524-acaa-eb517fe2bebb\") "
Jul 30 23:43:26.736666 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.736634    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/095b05fa-3218-4524-acaa-eb517fe2bebb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "095b05fa-3218-4524-acaa-eb517fe2bebb" (UID: "095b05fa-3218-4524-acaa-eb517fe2bebb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:43:26.738207 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.738165    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/095b05fa-3218-4524-acaa-eb517fe2bebb-kube-api-access-rcbgv" (OuterVolumeSpecName: "kube-api-access-rcbgv") pod "095b05fa-3218-4524-acaa-eb517fe2bebb" (UID: "095b05fa-3218-4524-acaa-eb517fe2bebb"). InnerVolumeSpecName "kube-api-access-rcbgv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:43:26.837886 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.837830    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcbgv\" (UniqueName: \"kubernetes.io/projected/095b05fa-3218-4524-acaa-eb517fe2bebb-kube-api-access-rcbgv\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:26.837886 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.837879    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/095b05fa-3218-4524-acaa-eb517fe2bebb-plugins-config-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:26.952668 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:26.952592    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:27.222023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.221923    2561 generic.go:356] "Generic (PLEG): container finished" podID="095b05fa-3218-4524-acaa-eb517fe2bebb" containerID="970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c" exitCode=0
Jul 30 23:43:27.222023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.221962    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs" event={"ID":"095b05fa-3218-4524-acaa-eb517fe2bebb","Type":"ContainerDied","Data":"970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c"}
Jul 30 23:43:27.222023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.221964    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"
Jul 30 23:43:27.222023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.222012    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs" event={"ID":"095b05fa-3218-4524-acaa-eb517fe2bebb","Type":"ContainerDied","Data":"66d000e3b75057b97bb190c8aca75eb3a590fd97719b7e1b4e07afe6aaad5ab1"}
Jul 30 23:43:27.222377 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.222033    2561 scope.go:117] "RemoveContainer" containerID="970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c"
Jul 30 23:43:27.232313 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.232295    2561 scope.go:117] "RemoveContainer" containerID="970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c"
Jul 30 23:43:27.232569 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:43:27.232549    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c\": container with ID starting with 970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c not found: ID does not exist" containerID="970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c"
Jul 30 23:43:27.232628 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.232582    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c"} err="failed to get container status \"970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c\": rpc error: code = NotFound desc = could not find container \"970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c\": container with ID starting with 970aeeae40f88373e725764f36b733213e7413b7e97579983d54696fcfcbf10c not found: ID does not exist"
Jul 30 23:43:27.244647 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.244613    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"]
Jul 30 23:43:27.248192 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:27.248160    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-05d70d-6569574988-q22gs"]
Jul 30 23:43:28.697777 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:28.697746    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="095b05fa-3218-4524-acaa-eb517fe2bebb" path="/var/lib/kubelet/pods/095b05fa-3218-4524-acaa-eb517fe2bebb/volumes"
Jul 30 23:43:31.934118 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:31.934063    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"]
Jul 30 23:43:31.973837 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:31.973803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:33.652650 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:33.652615    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:43:46.953572 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:46.953530    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q" podUID="72c74788-dfac-4298-be21-563ef29d4f5b" containerName="main" containerID="cri-o://c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801" gracePeriod=45
Jul 30 23:43:47.202519 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.202488    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:43:47.320852 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.320814    2561 generic.go:356] "Generic (PLEG): container finished" podID="72c74788-dfac-4298-be21-563ef29d4f5b" containerID="c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801" exitCode=0
Jul 30 23:43:47.321027 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.320859    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"
Jul 30 23:43:47.321027 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.320901    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q" event={"ID":"72c74788-dfac-4298-be21-563ef29d4f5b","Type":"ContainerDied","Data":"c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801"}
Jul 30 23:43:47.321027 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.320946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q" event={"ID":"72c74788-dfac-4298-be21-563ef29d4f5b","Type":"ContainerDied","Data":"307367600cde61d2def709e007809647706f2d50dc2f23f0b14f398470934b19"}
Jul 30 23:43:47.321027 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.320964    2561 scope.go:117] "RemoveContainer" containerID="c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801"
Jul 30 23:43:47.330283 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.330263    2561 scope.go:117] "RemoveContainer" containerID="c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801"
Jul 30 23:43:47.330595 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:43:47.330574    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801\": container with ID starting with c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801 not found: ID does not exist" containerID="c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801"
Jul 30 23:43:47.330661 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.330606    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801"} err="failed to get container status \"c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801\": rpc error: code = NotFound desc = could not find container \"c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801\": container with ID starting with c8b2616255ebe5a23d39a9352ea98be39a44ca00265db8316ccb2a60602bc801 not found: ID does not exist"
Jul 30 23:43:47.332907 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.332886    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72c74788-dfac-4298-be21-563ef29d4f5b-tls-certs\") pod \"72c74788-dfac-4298-be21-563ef29d4f5b\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") "
Jul 30 23:43:47.333029 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.332929    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-tmp-dir\") pod \"72c74788-dfac-4298-be21-563ef29d4f5b\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") "
Jul 30 23:43:47.333029 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.332967    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fw8rm\" (UniqueName: \"kubernetes.io/projected/72c74788-dfac-4298-be21-563ef29d4f5b-kube-api-access-fw8rm\") pod \"72c74788-dfac-4298-be21-563ef29d4f5b\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") "
Jul 30 23:43:47.333029 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.332999    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-home\") pod \"72c74788-dfac-4298-be21-563ef29d4f5b\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") "
Jul 30 23:43:47.333226 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.333043    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-dshm\") pod \"72c74788-dfac-4298-be21-563ef29d4f5b\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") "
Jul 30 23:43:47.333226 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.333142    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-model-cache\") pod \"72c74788-dfac-4298-be21-563ef29d4f5b\" (UID: \"72c74788-dfac-4298-be21-563ef29d4f5b\") "
Jul 30 23:43:47.333335 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.333231    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "72c74788-dfac-4298-be21-563ef29d4f5b" (UID: "72c74788-dfac-4298-be21-563ef29d4f5b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:47.333387 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.333346    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-home" (OuterVolumeSpecName: "home") pod "72c74788-dfac-4298-be21-563ef29d4f5b" (UID: "72c74788-dfac-4298-be21-563ef29d4f5b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:47.333455 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.333431    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-model-cache" (OuterVolumeSpecName: "model-cache") pod "72c74788-dfac-4298-be21-563ef29d4f5b" (UID: "72c74788-dfac-4298-be21-563ef29d4f5b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:47.333573 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.333556    2561 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-model-cache\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:47.333647 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.333579    2561 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-tmp-dir\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:47.333647 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.333591    2561 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-home\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:47.335543 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.335518    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c74788-dfac-4298-be21-563ef29d4f5b-kube-api-access-fw8rm" (OuterVolumeSpecName: "kube-api-access-fw8rm") pod "72c74788-dfac-4298-be21-563ef29d4f5b" (UID: "72c74788-dfac-4298-be21-563ef29d4f5b"). InnerVolumeSpecName "kube-api-access-fw8rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:43:47.335719 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.335694    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-dshm" (OuterVolumeSpecName: "dshm") pod "72c74788-dfac-4298-be21-563ef29d4f5b" (UID: "72c74788-dfac-4298-be21-563ef29d4f5b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:43:47.335783 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.335697    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72c74788-dfac-4298-be21-563ef29d4f5b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "72c74788-dfac-4298-be21-563ef29d4f5b" (UID: "72c74788-dfac-4298-be21-563ef29d4f5b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 23:43:47.434938 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.434906    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw8rm\" (UniqueName: \"kubernetes.io/projected/72c74788-dfac-4298-be21-563ef29d4f5b-kube-api-access-fw8rm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:47.434938 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.434936    2561 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72c74788-dfac-4298-be21-563ef29d4f5b-dshm\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:47.434938 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.434946    2561 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72c74788-dfac-4298-be21-563ef29d4f5b-tls-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:47.643061 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.643023    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"]
Jul 30 23:43:47.644690 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.644667    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-05d70d/ipp-route-05d70d-kserve-9c5cd86c-w7z7q"]
Jul 30 23:43:47.646427 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:47.646400    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:48.003389 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:48.003357    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:48.696680 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:48.696646    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c74788-dfac-4298-be21-563ef29d4f5b" path="/var/lib/kubelet/pods/72c74788-dfac-4298-be21-563ef29d4f5b/volumes"
Jul 30 23:43:49.039443 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:49.039411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:54.652256 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:54.652218    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:54.752187 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:54.752133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:54.931504 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:54.931412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:55.161212 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.161167    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:43:55.278967 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.278920    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"]
Jul 30 23:43:55.279389 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279370    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279391    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279419    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8439e151-54d2-4bb1-b84c-7f61dbdbc5f1" containerName="payload-processing"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279427    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8439e151-54d2-4bb1-b84c-7f61dbdbc5f1" containerName="payload-processing"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279440    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="095b05fa-3218-4524-acaa-eb517fe2bebb" containerName="payload-pre-processing"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279448    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="095b05fa-3218-4524-acaa-eb517fe2bebb" containerName="payload-pre-processing"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279458    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f753632f-2622-4f4f-9632-c4bb5678a8b5" containerName="payload-pre-processing"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279467    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f753632f-2622-4f4f-9632-c4bb5678a8b5" containerName="payload-pre-processing"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279490    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c74788-dfac-4298-be21-563ef29d4f5b" containerName="main"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279498    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c74788-dfac-4298-be21-563ef29d4f5b" containerName="main"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279507    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy"
Jul 30 23:43:55.279514 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279515    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy"
Jul 30 23:43:55.280021 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279626    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c74788-dfac-4298-be21-563ef29d4f5b" containerName="main"
Jul 30 23:43:55.280021 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279639    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy"
Jul 30 23:43:55.280021 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279649    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8439e151-54d2-4bb1-b84c-7f61dbdbc5f1" containerName="payload-processing"
Jul 30 23:43:55.280021 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279659    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f753632f-2622-4f4f-9632-c4bb5678a8b5" containerName="payload-pre-processing"
Jul 30 23:43:55.280021 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279667    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d308bdf-de99-40bb-8df4-9bdc8ab3671b" containerName="istio-proxy"
Jul 30 23:43:55.280021 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.279675    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="095b05fa-3218-4524-acaa-eb517fe2bebb" containerName="payload-pre-processing"
Jul 30 23:43:55.284219 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.284170    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"
Jul 30 23:43:55.287652 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.287625    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\""
Jul 30 23:43:55.287831 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.287637    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:43:55.288720 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.288698    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"]
Jul 30 23:43:55.411270 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.411223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/782f4f7b-e751-4d6e-9c97-a96db8d431bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv\" (UID: \"782f4f7b-e751-4d6e-9c97-a96db8d431bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"
Jul 30 23:43:55.512736 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.512692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/782f4f7b-e751-4d6e-9c97-a96db8d431bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv\" (UID: \"782f4f7b-e751-4d6e-9c97-a96db8d431bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"
Jul 30 23:43:55.513393 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.513373    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/782f4f7b-e751-4d6e-9c97-a96db8d431bb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv\" (UID: \"782f4f7b-e751-4d6e-9c97-a96db8d431bb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"
Jul 30 23:43:55.596688 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.596599    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"
Jul 30 23:43:55.733541 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:55.733388    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"]
Jul 30 23:43:55.736262 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:43:55.736227    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod782f4f7b_e751_4d6e_9c97_a96db8d431bb.slice/crio-dd3db527e9efd285fd71df8a116bf42da313e071519e5cd4c7c8879c3f4d2440 WatchSource:0}: Error finding container dd3db527e9efd285fd71df8a116bf42da313e071519e5cd4c7c8879c3f4d2440: Status 404 returned error can't find the container with id dd3db527e9efd285fd71df8a116bf42da313e071519e5cd4c7c8879c3f4d2440
Jul 30 23:43:56.365783 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:56.365687    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv" event={"ID":"782f4f7b-e751-4d6e-9c97-a96db8d431bb","Type":"ContainerStarted","Data":"66ccbb722f29c2811e10eab35773d7dc130e2d84ed662ebd512d990024c5355b"}
Jul 30 23:43:56.365783 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:56.365748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv" event={"ID":"782f4f7b-e751-4d6e-9c97-a96db8d431bb","Type":"ContainerStarted","Data":"dd3db527e9efd285fd71df8a116bf42da313e071519e5cd4c7c8879c3f4d2440"}
Jul 30 23:43:56.381825 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:56.381765    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv" podStartSLOduration=1.3817478429999999 podStartE2EDuration="1.381747843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:43:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:43:56.38065578 +0000 UTC m=+3360.111800962" watchObservedRunningTime="2026-07-30 23:43:56.381747843 +0000 UTC m=+3360.112893003"
Jul 30 23:43:57.372250 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:57.372151    2561 generic.go:356] "Generic (PLEG): container finished" podID="782f4f7b-e751-4d6e-9c97-a96db8d431bb" containerID="66ccbb722f29c2811e10eab35773d7dc130e2d84ed662ebd512d990024c5355b" exitCode=0
Jul 30 23:43:57.372250 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:57.372217    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv" event={"ID":"782f4f7b-e751-4d6e-9c97-a96db8d431bb","Type":"ContainerDied","Data":"66ccbb722f29c2811e10eab35773d7dc130e2d84ed662ebd512d990024c5355b"}
Jul 30 23:43:58.516081 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:58.516050    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"
Jul 30 23:43:58.640461 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:58.640356    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/782f4f7b-e751-4d6e-9c97-a96db8d431bb-maas-api-service-ca\") pod \"782f4f7b-e751-4d6e-9c97-a96db8d431bb\" (UID: \"782f4f7b-e751-4d6e-9c97-a96db8d431bb\") "
Jul 30 23:43:58.640789 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:58.640766    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/782f4f7b-e751-4d6e-9c97-a96db8d431bb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "782f4f7b-e751-4d6e-9c97-a96db8d431bb" (UID: "782f4f7b-e751-4d6e-9c97-a96db8d431bb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:43:58.742151 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:58.742112    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/782f4f7b-e751-4d6e-9c97-a96db8d431bb-maas-api-service-ca\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:43:59.383437 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:59.383405    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv" event={"ID":"782f4f7b-e751-4d6e-9c97-a96db8d431bb","Type":"ContainerDied","Data":"dd3db527e9efd285fd71df8a116bf42da313e071519e5cd4c7c8879c3f4d2440"}
Jul 30 23:43:59.383437 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:59.383442    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"
Jul 30 23:43:59.383665 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:43:59.383462    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd3db527e9efd285fd71df8a116bf42da313e071519e5cd4c7c8879c3f4d2440"
Jul 30 23:44:05.886998 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:05.886963    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:05.918720 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:05.918684    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"]
Jul 30 23:44:05.918997 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:05.918968    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8" podUID="0eda15bc-1f2e-474d-9e48-41561a52ac00" containerName="payload-processing" containerID="cri-o://6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f" gracePeriod=30
Jul 30 23:44:05.924333 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:05.924303    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"]
Jul 30 23:44:05.924967 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:05.924600    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz" podUID="1510864b-78fc-4958-9dca-cbf772200bae" containerName="payload-pre-processing" containerID="cri-o://839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb" gracePeriod=30
Jul 30 23:44:05.957931 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:05.957904    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:06.015825 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.015795    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:06.051876 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.051836    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"]
Jul 30 23:44:06.055487 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.055456    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-25ff25-bk6dv"]
Jul 30 23:44:06.075007 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.074972    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:06.208912 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.208479    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:44:06.252357 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.252328    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:44:06.316418 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.316379    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eda15bc-1f2e-474d-9e48-41561a52ac00-plugins-config-volume\") pod \"0eda15bc-1f2e-474d-9e48-41561a52ac00\" (UID: \"0eda15bc-1f2e-474d-9e48-41561a52ac00\") "
Jul 30 23:44:06.316630 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.316432    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd6mw\" (UniqueName: \"kubernetes.io/projected/0eda15bc-1f2e-474d-9e48-41561a52ac00-kube-api-access-zd6mw\") pod \"0eda15bc-1f2e-474d-9e48-41561a52ac00\" (UID: \"0eda15bc-1f2e-474d-9e48-41561a52ac00\") "
Jul 30 23:44:06.316788 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.316761    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eda15bc-1f2e-474d-9e48-41561a52ac00-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0eda15bc-1f2e-474d-9e48-41561a52ac00" (UID: "0eda15bc-1f2e-474d-9e48-41561a52ac00"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:44:06.318541 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.318517    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eda15bc-1f2e-474d-9e48-41561a52ac00-kube-api-access-zd6mw" (OuterVolumeSpecName: "kube-api-access-zd6mw") pod "0eda15bc-1f2e-474d-9e48-41561a52ac00" (UID: "0eda15bc-1f2e-474d-9e48-41561a52ac00"). InnerVolumeSpecName "kube-api-access-zd6mw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:44:06.417101 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.417011    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1510864b-78fc-4958-9dca-cbf772200bae-plugins-config-volume\") pod \"1510864b-78fc-4958-9dca-cbf772200bae\" (UID: \"1510864b-78fc-4958-9dca-cbf772200bae\") "
Jul 30 23:44:06.417284 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.417134    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8n4j\" (UniqueName: \"kubernetes.io/projected/1510864b-78fc-4958-9dca-cbf772200bae-kube-api-access-d8n4j\") pod \"1510864b-78fc-4958-9dca-cbf772200bae\" (UID: \"1510864b-78fc-4958-9dca-cbf772200bae\") "
Jul 30 23:44:06.417401 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.417381    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eda15bc-1f2e-474d-9e48-41561a52ac00-plugins-config-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:06.417439 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.417408    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd6mw\" (UniqueName: \"kubernetes.io/projected/0eda15bc-1f2e-474d-9e48-41561a52ac00-kube-api-access-zd6mw\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:06.417439 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.417412    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1510864b-78fc-4958-9dca-cbf772200bae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1510864b-78fc-4958-9dca-cbf772200bae" (UID: "1510864b-78fc-4958-9dca-cbf772200bae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:44:06.419772 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.419731    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1510864b-78fc-4958-9dca-cbf772200bae-kube-api-access-d8n4j" (OuterVolumeSpecName: "kube-api-access-d8n4j") pod "1510864b-78fc-4958-9dca-cbf772200bae" (UID: "1510864b-78fc-4958-9dca-cbf772200bae"). InnerVolumeSpecName "kube-api-access-d8n4j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:44:06.422576 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.422546    2561 generic.go:356] "Generic (PLEG): container finished" podID="0eda15bc-1f2e-474d-9e48-41561a52ac00" containerID="6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f" exitCode=0
Jul 30 23:44:06.422702 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.422591    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"
Jul 30 23:44:06.422702 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.422633    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8" event={"ID":"0eda15bc-1f2e-474d-9e48-41561a52ac00","Type":"ContainerDied","Data":"6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f"}
Jul 30 23:44:06.422702 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.422691    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8" event={"ID":"0eda15bc-1f2e-474d-9e48-41561a52ac00","Type":"ContainerDied","Data":"f5d0cc81de5b00d339c0ac5babd79d07a26807be8e4b107255ff98cceef30965"}
Jul 30 23:44:06.422838 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.422720    2561 scope.go:117] "RemoveContainer" containerID="6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f"
Jul 30 23:44:06.423942 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.423923    2561 generic.go:356] "Generic (PLEG): container finished" podID="1510864b-78fc-4958-9dca-cbf772200bae" containerID="839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb" exitCode=0
Jul 30 23:44:06.424041 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.423966    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"
Jul 30 23:44:06.424041 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.423996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz" event={"ID":"1510864b-78fc-4958-9dca-cbf772200bae","Type":"ContainerDied","Data":"839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb"}
Jul 30 23:44:06.424041 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.424025    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz" event={"ID":"1510864b-78fc-4958-9dca-cbf772200bae","Type":"ContainerDied","Data":"4465b656f157400098b78114185fcc644e53c551b7ddc80067615406f2ff101f"}
Jul 30 23:44:06.425925 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.425901    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:06.431543 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.431527    2561 scope.go:117] "RemoveContainer" containerID="6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f"
Jul 30 23:44:06.431832 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:44:06.431811    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f\": container with ID starting with 6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f not found: ID does not exist" containerID="6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f"
Jul 30 23:44:06.431909 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.431842    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f"} err="failed to get container status \"6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f\": rpc error: code = NotFound desc = could not find container \"6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f\": container with ID starting with 6559634b737b437844f882789b1c3d802a09f415f83ca9c277624338740e901f not found: ID does not exist"
Jul 30 23:44:06.431909 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.431865    2561 scope.go:117] "RemoveContainer" containerID="839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb"
Jul 30 23:44:06.440344 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.440326    2561 scope.go:117] "RemoveContainer" containerID="839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb"
Jul 30 23:44:06.440596 ip-10-0-135-246 kubenswrapper[2561]: E0730 23:44:06.440578    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb\": container with ID starting with 839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb not found: ID does not exist" containerID="839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb"
Jul 30 23:44:06.440655 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.440605    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb"} err="failed to get container status \"839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb\": rpc error: code = NotFound desc = could not find container \"839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb\": container with ID starting with 839bd68222e3056bb69dd159eb97b5f45f0575fe1fa7c2148b44d1feb55e72fb not found: ID does not exist"
Jul 30 23:44:06.450776 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.450743    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"]
Jul 30 23:44:06.454668 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.454639    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-25ff25-7f79dcdd8-z5jw8"]
Jul 30 23:44:06.465654 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.465625    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"]
Jul 30 23:44:06.469044 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.469021    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-25ff25-64cf6fb88d-ldhvz"]
Jul 30 23:44:06.518208 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.518150    2561 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1510864b-78fc-4958-9dca-cbf772200bae-plugins-config-volume\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:06.518208 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.518196    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8n4j\" (UniqueName: \"kubernetes.io/projected/1510864b-78fc-4958-9dca-cbf772200bae-kube-api-access-d8n4j\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:06.697043 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.696949    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eda15bc-1f2e-474d-9e48-41561a52ac00" path="/var/lib/kubelet/pods/0eda15bc-1f2e-474d-9e48-41561a52ac00/volumes"
Jul 30 23:44:06.697441 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.697421    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1510864b-78fc-4958-9dca-cbf772200bae" path="/var/lib/kubelet/pods/1510864b-78fc-4958-9dca-cbf772200bae/volumes"
Jul 30 23:44:06.697774 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:06.697758    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="782f4f7b-e751-4d6e-9c97-a96db8d431bb" path="/var/lib/kubelet/pods/782f4f7b-e751-4d6e-9c97-a96db8d431bb/volumes"
Jul 30 23:44:07.363422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:07.363389    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:44:12.069585 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.069551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:12.169868 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.169833    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:12.310139 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.310107    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"]
Jul 30 23:44:12.310502 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.310469    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy" containerID="cri-o://599f4c980d656994564b5b16e8ae620774bc276860064e6a345aa9def2bd7f7b" gracePeriod=30
Jul 30 23:44:12.332746 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.332659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:12.550773 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.550737    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:12.688857 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.688764    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"]
Jul 30 23:44:12.689248 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689230    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1510864b-78fc-4958-9dca-cbf772200bae" containerName="payload-pre-processing"
Jul 30 23:44:12.689353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689250    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1510864b-78fc-4958-9dca-cbf772200bae" containerName="payload-pre-processing"
Jul 30 23:44:12.689353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689272    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eda15bc-1f2e-474d-9e48-41561a52ac00" containerName="payload-processing"
Jul 30 23:44:12.689353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689281    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eda15bc-1f2e-474d-9e48-41561a52ac00" containerName="payload-processing"
Jul 30 23:44:12.689353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689299    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="782f4f7b-e751-4d6e-9c97-a96db8d431bb" containerName="revoke-keys"
Jul 30 23:44:12.689353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689308    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="782f4f7b-e751-4d6e-9c97-a96db8d431bb" containerName="revoke-keys"
Jul 30 23:44:12.689602 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689397    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="782f4f7b-e751-4d6e-9c97-a96db8d431bb" containerName="revoke-keys"
Jul 30 23:44:12.689602 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689411    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1510864b-78fc-4958-9dca-cbf772200bae" containerName="payload-pre-processing"
Jul 30 23:44:12.689602 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.689423    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eda15bc-1f2e-474d-9e48-41561a52ac00" containerName="payload-processing"
Jul 30 23:44:12.692528 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.692505    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"
Jul 30 23:44:12.695307 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.695280    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:44:12.695422 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.695340    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\""
Jul 30 23:44:12.698923 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.698895    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"]
Jul 30 23:44:12.774253 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.774218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbc817b-33e6-4181-a9e7-f07959f7244b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g\" (UID: \"fdbc817b-33e6-4181-a9e7-f07959f7244b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"
Jul 30 23:44:12.875791 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.875749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbc817b-33e6-4181-a9e7-f07959f7244b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g\" (UID: \"fdbc817b-33e6-4181-a9e7-f07959f7244b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"
Jul 30 23:44:12.876424 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:12.876403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbc817b-33e6-4181-a9e7-f07959f7244b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g\" (UID: \"fdbc817b-33e6-4181-a9e7-f07959f7244b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"
Jul 30 23:44:13.004872 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:13.004839    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"
Jul 30 23:44:13.138015 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:13.137977    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"]
Jul 30 23:44:13.139901 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:44:13.139859    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbc817b_33e6_4181_a9e7_f07959f7244b.slice/crio-598ae3b66127643411c9444c4ccd509b4ca6a60020f447dcbf08a3429a2e0cba WatchSource:0}: Error finding container 598ae3b66127643411c9444c4ccd509b4ca6a60020f447dcbf08a3429a2e0cba: Status 404 returned error can't find the container with id 598ae3b66127643411c9444c4ccd509b4ca6a60020f447dcbf08a3429a2e0cba
Jul 30 23:44:13.462771 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:13.462732    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g" event={"ID":"fdbc817b-33e6-4181-a9e7-f07959f7244b","Type":"ContainerStarted","Data":"647b52e2e9c7cdd380616088285f2a6cf8c1917f90bd79f29f1af48dcfb42647"}
Jul 30 23:44:13.462967 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:13.462788    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g" event={"ID":"fdbc817b-33e6-4181-a9e7-f07959f7244b","Type":"ContainerStarted","Data":"598ae3b66127643411c9444c4ccd509b4ca6a60020f447dcbf08a3429a2e0cba"}
Jul 30 23:44:13.478740 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:13.478677    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g" podStartSLOduration=1.478659666 podStartE2EDuration="1.478659666s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:44:13.47720456 +0000 UTC m=+3377.208349744" watchObservedRunningTime="2026-07-30 23:44:13.478659666 +0000 UTC m=+3377.209804826"
Jul 30 23:44:14.469003 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:14.468961    2561 generic.go:356] "Generic (PLEG): container finished" podID="fdbc817b-33e6-4181-a9e7-f07959f7244b" containerID="647b52e2e9c7cdd380616088285f2a6cf8c1917f90bd79f29f1af48dcfb42647" exitCode=0
Jul 30 23:44:14.469439 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:14.469047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g" event={"ID":"fdbc817b-33e6-4181-a9e7-f07959f7244b","Type":"ContainerDied","Data":"647b52e2e9c7cdd380616088285f2a6cf8c1917f90bd79f29f1af48dcfb42647"}
Jul 30 23:44:15.608239 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:15.608215    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"
Jul 30 23:44:15.702172 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:15.702135    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbc817b-33e6-4181-a9e7-f07959f7244b-maas-api-service-ca\") pod \"fdbc817b-33e6-4181-a9e7-f07959f7244b\" (UID: \"fdbc817b-33e6-4181-a9e7-f07959f7244b\") "
Jul 30 23:44:15.702548 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:15.702525    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbc817b-33e6-4181-a9e7-f07959f7244b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fdbc817b-33e6-4181-a9e7-f07959f7244b" (UID: "fdbc817b-33e6-4181-a9e7-f07959f7244b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:44:15.803594 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:15.803559    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbc817b-33e6-4181-a9e7-f07959f7244b-maas-api-service-ca\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:16.479396 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:16.479361    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"
Jul 30 23:44:16.479577 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:16.479394    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g" event={"ID":"fdbc817b-33e6-4181-a9e7-f07959f7244b","Type":"ContainerDied","Data":"598ae3b66127643411c9444c4ccd509b4ca6a60020f447dcbf08a3429a2e0cba"}
Jul 30 23:44:16.479577 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:16.479446    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="598ae3b66127643411c9444c4ccd509b4ca6a60020f447dcbf08a3429a2e0cba"
Jul 30 23:44:17.487738 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.487709    2561 generic.go:356] "Generic (PLEG): container finished" podID="914cd676-195d-4879-a42d-927807da3b6f" containerID="599f4c980d656994564b5b16e8ae620774bc276860064e6a345aa9def2bd7f7b" exitCode=0
Jul 30 23:44:17.488219 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.487760    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" event={"ID":"914cd676-195d-4879-a42d-927807da3b6f","Type":"ContainerDied","Data":"599f4c980d656994564b5b16e8ae620774bc276860064e6a345aa9def2bd7f7b"}
Jul 30 23:44:17.488219 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.487812    2561 scope.go:117] "RemoveContainer" containerID="6a6a008e1276b06d2af04642ed61f7ed52c53c11c5eb663d2dc5de8eeb5e82bf"
Jul 30 23:44:17.568381 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.568355    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:44:17.617531 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617441    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-socket\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.617531 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617482    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914cd676-195d-4879-a42d-927807da3b6f-istiod-ca-cert\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.617531 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617500    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-certs\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.617814 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617536    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914cd676-195d-4879-a42d-927807da3b6f-istio-podinfo\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.617814 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617573    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-credential-socket\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.617814 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617758    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-istio-token\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.617814 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617769    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:44:17.617814 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617786    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:44:17.618074 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617819    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlzkg\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-kube-api-access-wlzkg\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.618074 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617823    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:44:17.618074 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617862    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-envoy\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.618074 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617865    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/914cd676-195d-4879-a42d-927807da3b6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:44:17.618074 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.617923    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-data\") pod \"914cd676-195d-4879-a42d-927807da3b6f\" (UID: \"914cd676-195d-4879-a42d-927807da3b6f\") "
Jul 30 23:44:17.618347 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.618230    2561 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-credential-socket\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:17.618347 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.618246    2561 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-socket\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:17.618347 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.618246    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:44:17.618347 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.618262    2561 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/914cd676-195d-4879-a42d-927807da3b6f-istiod-ca-cert\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:17.618347 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.618272    2561 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-workload-certs\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:17.619972 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.619946    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 23:44:17.619972 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.619962    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:44:17.620285 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.620268    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/914cd676-195d-4879-a42d-927807da3b6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 23:44:17.620366 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.620351    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-kube-api-access-wlzkg" (OuterVolumeSpecName: "kube-api-access-wlzkg") pod "914cd676-195d-4879-a42d-927807da3b6f" (UID: "914cd676-195d-4879-a42d-927807da3b6f"). InnerVolumeSpecName "kube-api-access-wlzkg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 23:44:17.718836 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.718801    2561 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-istio-token\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:17.718836 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.718829    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlzkg\" (UniqueName: \"kubernetes.io/projected/914cd676-195d-4879-a42d-927807da3b6f-kube-api-access-wlzkg\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:17.718836 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.718840    2561 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-envoy\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:17.719076 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.718850    2561 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/914cd676-195d-4879-a42d-927807da3b6f-istio-data\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:17.719076 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:17.718859    2561 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/914cd676-195d-4879-a42d-927807da3b6f-istio-podinfo\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:18.493559 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:18.493518    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv" event={"ID":"914cd676-195d-4879-a42d-927807da3b6f","Type":"ContainerDied","Data":"c71a18234a3383a39ec7b3f736a97ba0918a7903d75d6b92ba476498cd1e0fb1"}
Jul 30 23:44:18.493559 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:18.493538    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"
Jul 30 23:44:18.494063 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:18.493585    2561 scope.go:117] "RemoveContainer" containerID="599f4c980d656994564b5b16e8ae620774bc276860064e6a345aa9def2bd7f7b"
Jul 30 23:44:18.514921 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:18.514890    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"]
Jul 30 23:44:18.517059 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:18.517030    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-25ff25-openshift-default-fb5c7cb96-xndpv"]
Jul 30 23:44:18.697308 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:18.697277    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="914cd676-195d-4879-a42d-927807da3b6f" path="/var/lib/kubelet/pods/914cd676-195d-4879-a42d-927807da3b6f/volumes"
Jul 30 23:44:23.159698 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:23.159612    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:23.226737 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:23.226701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:23.282124 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:23.282093    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:23.329646 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:23.329607    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"]
Jul 30 23:44:23.331986 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:23.331961    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5049e4-dd56g"]
Jul 30 23:44:23.344170 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:23.344139    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:23.702675 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:23.702638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:24.696978 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:24.696942    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdbc817b-33e6-4181-a9e7-f07959f7244b" path="/var/lib/kubelet/pods/fdbc817b-33e6-4181-a9e7-f07959f7244b/volumes"
Jul 30 23:44:25.155690 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:25.155653    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:44:29.608606 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:29.608569    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:29.676899 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:29.676867    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:29.861147 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:29.861055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:30.088824 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.088793    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:30.210572 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210483    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"]
Jul 30 23:44:30.210847 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210833    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbc817b-33e6-4181-a9e7-f07959f7244b" containerName="revoke-keys"
Jul 30 23:44:30.210899 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210848    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbc817b-33e6-4181-a9e7-f07959f7244b" containerName="revoke-keys"
Jul 30 23:44:30.210899 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210859    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy"
Jul 30 23:44:30.210899 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210865    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy"
Jul 30 23:44:30.210899 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210883    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy"
Jul 30 23:44:30.210899 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210890    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy"
Jul 30 23:44:30.211073 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210945    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy"
Jul 30 23:44:30.211073 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210955    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="914cd676-195d-4879-a42d-927807da3b6f" containerName="istio-proxy"
Jul 30 23:44:30.211073 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.210960    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdbc817b-33e6-4181-a9e7-f07959f7244b" containerName="revoke-keys"
Jul 30 23:44:30.215372 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.215355    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"
Jul 30 23:44:30.217670 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.217645    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 23:44:30.217795 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.217775    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-52wcc\""
Jul 30 23:44:30.221072 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.221048    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"]
Jul 30 23:44:30.337905 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.337864    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42f6d65-b641-4723-9251-28a6a022a0b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj\" (UID: \"f42f6d65-b641-4723-9251-28a6a022a0b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"
Jul 30 23:44:30.439338 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.439297    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42f6d65-b641-4723-9251-28a6a022a0b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj\" (UID: \"f42f6d65-b641-4723-9251-28a6a022a0b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"
Jul 30 23:44:30.439951 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.439930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42f6d65-b641-4723-9251-28a6a022a0b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj\" (UID: \"f42f6d65-b641-4723-9251-28a6a022a0b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"
Jul 30 23:44:30.527721 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.527690    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"
Jul 30 23:44:30.671732 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:30.671698    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"]
Jul 30 23:44:30.673014 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:44:30.672987    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf42f6d65_b641_4723_9251_28a6a022a0b8.slice/crio-4a94566fb45bbfd500977f6b4a227b2e808dd4ceaad8f5506acac14555a63b51 WatchSource:0}: Error finding container 4a94566fb45bbfd500977f6b4a227b2e808dd4ceaad8f5506acac14555a63b51: Status 404 returned error can't find the container with id 4a94566fb45bbfd500977f6b4a227b2e808dd4ceaad8f5506acac14555a63b51
Jul 30 23:44:31.558519 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:31.558484    2561 generic.go:356] "Generic (PLEG): container finished" podID="f42f6d65-b641-4723-9251-28a6a022a0b8" containerID="e36ada3260a743249939fd597be66bdfc9a52738039b7bfc2e55e7da7becdf0a" exitCode=0
Jul 30 23:44:31.558712 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:31.558535    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj" event={"ID":"f42f6d65-b641-4723-9251-28a6a022a0b8","Type":"ContainerDied","Data":"e36ada3260a743249939fd597be66bdfc9a52738039b7bfc2e55e7da7becdf0a"}
Jul 30 23:44:31.558712 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:31.558581    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj" event={"ID":"f42f6d65-b641-4723-9251-28a6a022a0b8","Type":"ContainerStarted","Data":"4a94566fb45bbfd500977f6b4a227b2e808dd4ceaad8f5506acac14555a63b51"}
Jul 30 23:44:32.690595 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:32.690570    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"
Jul 30 23:44:32.760353 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:32.760319    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42f6d65-b641-4723-9251-28a6a022a0b8-maas-api-service-ca\") pod \"f42f6d65-b641-4723-9251-28a6a022a0b8\" (UID: \"f42f6d65-b641-4723-9251-28a6a022a0b8\") "
Jul 30 23:44:32.760727 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:32.760708    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f42f6d65-b641-4723-9251-28a6a022a0b8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f42f6d65-b641-4723-9251-28a6a022a0b8" (UID: "f42f6d65-b641-4723-9251-28a6a022a0b8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 23:44:32.862103 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:32.862017    2561 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f42f6d65-b641-4723-9251-28a6a022a0b8-maas-api-service-ca\") on node \"ip-10-0-135-246.ec2.internal\" DevicePath \"\""
Jul 30 23:44:33.568700 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:33.568659    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"
Jul 30 23:44:33.568881 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:33.568669    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj" event={"ID":"f42f6d65-b641-4723-9251-28a6a022a0b8","Type":"ContainerDied","Data":"4a94566fb45bbfd500977f6b4a227b2e808dd4ceaad8f5506acac14555a63b51"}
Jul 30 23:44:33.568881 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:33.568785    2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a94566fb45bbfd500977f6b4a227b2e808dd4ceaad8f5506acac14555a63b51"
Jul 30 23:44:40.639619 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:40.639585    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:40.704550 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:40.704513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:40.765820 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:40.765779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:40.817348 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:40.817311    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"]
Jul 30 23:44:40.820639 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:40.820612    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-f6f660-qwfrj"]
Jul 30 23:44:40.820905 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:40.820861    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:41.188241 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:41.188205    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:42.696523 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:42.696491    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f42f6d65-b641-4723-9251-28a6a022a0b8" path="/var/lib/kubelet/pods/f42f6d65-b641-4723-9251-28a6a022a0b8/volumes"
Jul 30 23:44:42.755315 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:42.755282    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-w4m7z"]
Jul 30 23:44:47.564536 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:47.564487    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:47.663848 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:47.663805    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:47.819720 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:47.819606    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:48.034294 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:48.034243    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:44:48.445863 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:48.445790    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7884dc974f-klcfr_a08d9bf9-e198-40e8-9b37-95283eec0279/authorino/0.log"
Jul 30 23:44:54.463776 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:54.463743    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6bb66584-v7lfh_4e52edcd-56c6-4ed8-98ea-012069b23a55/copy-manifests/0.log"
Jul 30 23:44:54.469464 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:54.469441    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6bb66584-v7lfh_4e52edcd-56c6-4ed8-98ea-012069b23a55/manager/0.log"
Jul 30 23:44:56.019000 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:56.018970    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7884dc974f-klcfr_a08d9bf9-e198-40e8-9b37-95283eec0279/authorino/0.log"
Jul 30 23:44:56.465283 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:56.465161    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-8t855_ebc3976b-e4fa-42ee-94a8-7cb17af9645b/manager/0.log"
Jul 30 23:44:56.578404 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:56.578375    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-w4m7z_ba9231cb-ef2d-4115-84be-123e2e8d2502/limitador/0.log"
Jul 30 23:44:57.364267 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:57.364150    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-556f7c5984-n8lxc_dfcd6851-5386-4aeb-a589-be3d16864256/kube-auth-proxy/0.log"
Jul 30 23:44:58.495656 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:58.495623    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f6zpgq_f137d1ab-110d-47be-8c3c-4975f2a496bc/main/0.log"
Jul 30 23:44:58.722195 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:44:58.722149    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-8dcjs_2fa492f5-060b-42b0-84a7-71520def05d3/main/0.log"
Jul 30 23:45:03.851642 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.851602    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b87wl/must-gather-5bq6c"]
Jul 30 23:45:03.852036 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.851933    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f42f6d65-b641-4723-9251-28a6a022a0b8" containerName="revoke-keys"
Jul 30 23:45:03.852036 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.851943    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f42f6d65-b641-4723-9251-28a6a022a0b8" containerName="revoke-keys"
Jul 30 23:45:03.852036 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.852010    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f42f6d65-b641-4723-9251-28a6a022a0b8" containerName="revoke-keys"
Jul 30 23:45:03.856973 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.856949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b87wl/must-gather-5bq6c"
Jul 30 23:45:03.859525 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.859504    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b87wl\"/\"openshift-service-ca.crt\""
Jul 30 23:45:03.859525 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.859515    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b87wl\"/\"kube-root-ca.crt\""
Jul 30 23:45:03.860650 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.860485    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b87wl\"/\"default-dockercfg-m4wrr\""
Jul 30 23:45:03.862683 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.862657    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b87wl/must-gather-5bq6c"]
Jul 30 23:45:03.866713 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.866687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:45:03.955466 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.955428    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92q4c\" (UniqueName: \"kubernetes.io/projected/a38ea702-5550-4f6d-830a-1fbc8e55e57a-kube-api-access-92q4c\") pod \"must-gather-5bq6c\" (UID: \"a38ea702-5550-4f6d-830a-1fbc8e55e57a\") " pod="openshift-must-gather-b87wl/must-gather-5bq6c"
Jul 30 23:45:03.955466 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.955471    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a38ea702-5550-4f6d-830a-1fbc8e55e57a-must-gather-output\") pod \"must-gather-5bq6c\" (UID: \"a38ea702-5550-4f6d-830a-1fbc8e55e57a\") " pod="openshift-must-gather-b87wl/must-gather-5bq6c"
Jul 30 23:45:03.965239 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:03.965205    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:45:04.056615 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:04.056563    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92q4c\" (UniqueName: \"kubernetes.io/projected/a38ea702-5550-4f6d-830a-1fbc8e55e57a-kube-api-access-92q4c\") pod \"must-gather-5bq6c\" (UID: \"a38ea702-5550-4f6d-830a-1fbc8e55e57a\") " pod="openshift-must-gather-b87wl/must-gather-5bq6c"
Jul 30 23:45:04.056615 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:04.056614    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a38ea702-5550-4f6d-830a-1fbc8e55e57a-must-gather-output\") pod \"must-gather-5bq6c\" (UID: \"a38ea702-5550-4f6d-830a-1fbc8e55e57a\") " pod="openshift-must-gather-b87wl/must-gather-5bq6c"
Jul 30 23:45:04.056931 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:04.056916    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a38ea702-5550-4f6d-830a-1fbc8e55e57a-must-gather-output\") pod \"must-gather-5bq6c\" (UID: \"a38ea702-5550-4f6d-830a-1fbc8e55e57a\") " pod="openshift-must-gather-b87wl/must-gather-5bq6c"
Jul 30 23:45:04.065023 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:04.064996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92q4c\" (UniqueName: \"kubernetes.io/projected/a38ea702-5550-4f6d-830a-1fbc8e55e57a-kube-api-access-92q4c\") pod \"must-gather-5bq6c\" (UID: \"a38ea702-5550-4f6d-830a-1fbc8e55e57a\") " pod="openshift-must-gather-b87wl/must-gather-5bq6c"
Jul 30 23:45:04.167445 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:04.167352    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b87wl/must-gather-5bq6c"
Jul 30 23:45:04.303434 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:04.303378    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b87wl/must-gather-5bq6c"]
Jul 30 23:45:04.307837 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:45:04.307747    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda38ea702_5550_4f6d_830a_1fbc8e55e57a.slice/crio-20df3cb58a946f5e7173df5e921141bbdf13302be56f23e0268e07d90a6eb8b4 WatchSource:0}: Error finding container 20df3cb58a946f5e7173df5e921141bbdf13302be56f23e0268e07d90a6eb8b4: Status 404 returned error can't find the container with id 20df3cb58a946f5e7173df5e921141bbdf13302be56f23e0268e07d90a6eb8b4
Jul 30 23:45:04.722667 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:04.722620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b87wl/must-gather-5bq6c" event={"ID":"a38ea702-5550-4f6d-830a-1fbc8e55e57a","Type":"ContainerStarted","Data":"20df3cb58a946f5e7173df5e921141bbdf13302be56f23e0268e07d90a6eb8b4"}
Jul 30 23:45:05.729548 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:05.729512    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b87wl/must-gather-5bq6c" event={"ID":"a38ea702-5550-4f6d-830a-1fbc8e55e57a","Type":"ContainerStarted","Data":"f41926adf8304fd7da8ed639374419267135e2615583a671697d6b32781455d6"}
Jul 30 23:45:05.730047 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:05.729560    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b87wl/must-gather-5bq6c" event={"ID":"a38ea702-5550-4f6d-830a-1fbc8e55e57a","Type":"ContainerStarted","Data":"da38400ef9945c51dbf65f03f99e9e24d782e859fa687e88d9439bc89954a3af"}
Jul 30 23:45:05.746605 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:05.746536    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b87wl/must-gather-5bq6c" podStartSLOduration=1.987683461 podStartE2EDuration="2.746513784s" totalImagesPullingTime="758.830323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 23:45:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:45:05.743727311 +0000 UTC m=+3429.474872473" watchObservedRunningTime="2026-07-30 23:45:05.746513784 +0000 UTC m=+3429.477658947"
Jul 30 23:45:06.609589 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:06.609559    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-d8n59_07fa440e-a582-4b5e-b055-87da66d02efc/global-pull-secret-syncer/0.log"
Jul 30 23:45:06.765064 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:06.765032    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log"
Jul 30 23:45:06.878516 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:06.878435    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-246.ec2.internal_4cfe13614e7c33dd0a3bc6a4f5cae04c/haproxy/0.log"
Jul 30 23:45:12.037197 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:12.029664    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7884dc974f-klcfr_a08d9bf9-e198-40e8-9b37-95283eec0279/authorino/0.log"
Jul 30 23:45:12.208814 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:12.208778    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-68cf589589-8t855_ebc3976b-e4fa-42ee-94a8-7cb17af9645b/manager/0.log"
Jul 30 23:45:12.230852 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:12.230823    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-w4m7z_ba9231cb-ef2d-4115-84be-123e2e8d2502/limitador/0.log"
Jul 30 23:45:13.840662 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:13.840622    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a/alertmanager/0.log"
Jul 30 23:45:13.871413 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:13.871377    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a/config-reloader/0.log"
Jul 30 23:45:13.894344 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:13.894252    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a/kube-rbac-proxy-web/0.log"
Jul 30 23:45:13.915997 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:13.915959    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a/kube-rbac-proxy/0.log"
Jul 30 23:45:13.937686 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:13.937647    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a/kube-rbac-proxy-metric/0.log"
Jul 30 23:45:13.962987 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:13.962961    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a/prom-label-proxy/0.log"
Jul 30 23:45:13.987678 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:13.987543    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dcabf8a9-7f24-4649-a5d2-4b5ebc02df3a/init-config-reloader/0.log"
Jul 30 23:45:14.130383 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.130354    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76bf775fd8-gsjjb_7a06c6d5-5583-4ecc-b05c-f7337e6cbe34/metrics-server/0.log"
Jul 30 23:45:14.157141 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.157028    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-96w28_1fee519c-f0cb-48ae-92cf-df70ccaecc26/monitoring-plugin/0.log"
Jul 30 23:45:14.354910 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.354874    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ws6tv_34dbe537-632e-44b8-ac40-ad575efce976/node-exporter/0.log"
Jul 30 23:45:14.381404 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.381346    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ws6tv_34dbe537-632e-44b8-ac40-ad575efce976/kube-rbac-proxy/0.log"
Jul 30 23:45:14.404915 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.404884    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ws6tv_34dbe537-632e-44b8-ac40-ad575efce976/init-textfile/0.log"
Jul 30 23:45:14.581126 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.581095    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ff33266-c552-463d-9e4d-b1daa1397aa8/prometheus/0.log"
Jul 30 23:45:14.625211 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.625128    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ff33266-c552-463d-9e4d-b1daa1397aa8/config-reloader/0.log"
Jul 30 23:45:14.652936 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.652871    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ff33266-c552-463d-9e4d-b1daa1397aa8/thanos-sidecar/0.log"
Jul 30 23:45:14.690086 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.690033    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ff33266-c552-463d-9e4d-b1daa1397aa8/kube-rbac-proxy-web/0.log"
Jul 30 23:45:14.718739 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.718680    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ff33266-c552-463d-9e4d-b1daa1397aa8/kube-rbac-proxy/0.log"
Jul 30 23:45:14.741163 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.741129    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ff33266-c552-463d-9e4d-b1daa1397aa8/kube-rbac-proxy-thanos/0.log"
Jul 30 23:45:14.769135 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.769107    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_6ff33266-c552-463d-9e4d-b1daa1397aa8/init-config-reloader/0.log"
Jul 30 23:45:14.814580 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.814528    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-8p496_8b8e6550-0ed9-4d1e-868f-e613f41ee798/prometheus-operator/0.log"
Jul 30 23:45:14.835981 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.835861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-8p496_8b8e6550-0ed9-4d1e-868f-e613f41ee798/kube-rbac-proxy/0.log"
Jul 30 23:45:14.994272 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:14.993218    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6858f6cf95-zcnxg_d7294f53-2807-43b3-a24d-99894d2c0688/thanos-query/0.log"
Jul 30 23:45:15.016287 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:15.016255    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6858f6cf95-zcnxg_d7294f53-2807-43b3-a24d-99894d2c0688/kube-rbac-proxy-web/0.log"
Jul 30 23:45:15.040098 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:15.040060    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6858f6cf95-zcnxg_d7294f53-2807-43b3-a24d-99894d2c0688/kube-rbac-proxy/0.log"
Jul 30 23:45:15.060682 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:15.060647    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6858f6cf95-zcnxg_d7294f53-2807-43b3-a24d-99894d2c0688/prom-label-proxy/0.log"
Jul 30 23:45:15.082911 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:15.082876    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6858f6cf95-zcnxg_d7294f53-2807-43b3-a24d-99894d2c0688/kube-rbac-proxy-rules/0.log"
Jul 30 23:45:15.107887 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:15.107782    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6858f6cf95-zcnxg_d7294f53-2807-43b3-a24d-99894d2c0688/kube-rbac-proxy-metrics/0.log"
Jul 30 23:45:17.542794 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.542759    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"]
Jul 30 23:45:17.551849 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.551819    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.567303 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.567206    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"]
Jul 30 23:45:17.708168 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.708131    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-lib-modules\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.708530 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.708505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-proc\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.708685 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.708665    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-sys\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.708826 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.708810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-podres\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.708962 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.708945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gxxs\" (UniqueName: \"kubernetes.io/projected/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-kube-api-access-6gxxs\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810284 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-proc\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810284 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-sys\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810284 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-proc\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810561 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810336    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-sys\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810561 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810349    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-podres\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810561 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810397    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gxxs\" (UniqueName: \"kubernetes.io/projected/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-kube-api-access-6gxxs\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810561 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-lib-modules\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810766 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810547    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-podres\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.810766 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.810601    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-lib-modules\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.831047 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.828579    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gxxs\" (UniqueName: \"kubernetes.io/projected/47c0c55f-bd4b-44fa-a038-0ddd7b83573c-kube-api-access-6gxxs\") pod \"perf-node-gather-daemonset-6hjp2\" (UID: \"47c0c55f-bd4b-44fa-a038-0ddd7b83573c\") " pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:17.874014 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:17.873953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:18.049005 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:18.048872    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"]
Jul 30 23:45:18.053270 ip-10-0-135-246 kubenswrapper[2561]: W0730 23:45:18.053228    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod47c0c55f_bd4b_44fa_a038_0ddd7b83573c.slice/crio-2aa9475bfee5e03dd020e41e431fdf09c0910e9e73b9024d3e735e3915d2a532 WatchSource:0}: Error finding container 2aa9475bfee5e03dd020e41e431fdf09c0910e9e73b9024d3e735e3915d2a532: Status 404 returned error can't find the container with id 2aa9475bfee5e03dd020e41e431fdf09c0910e9e73b9024d3e735e3915d2a532
Jul 30 23:45:18.830047 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:18.830010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2" event={"ID":"47c0c55f-bd4b-44fa-a038-0ddd7b83573c","Type":"ContainerStarted","Data":"7feb0a05a7e46577cd170c8baf4502b3f431bfdb85bbe32537c80f0959ee315e"}
Jul 30 23:45:18.830494 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:18.830070    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2" event={"ID":"47c0c55f-bd4b-44fa-a038-0ddd7b83573c","Type":"ContainerStarted","Data":"2aa9475bfee5e03dd020e41e431fdf09c0910e9e73b9024d3e735e3915d2a532"}
Jul 30 23:45:18.830494 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:18.830211    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:19.624505 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:19.624480    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmxp4_b48d8d89-2612-4fa2-a8a3-cf5ecd277009/dns/0.log"
Jul 30 23:45:19.647548 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:19.647519    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cmxp4_b48d8d89-2612-4fa2-a8a3-cf5ecd277009/kube-rbac-proxy/0.log"
Jul 30 23:45:19.765260 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:19.765229    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sp85s_05200788-aeb2-44d0-b9bc-0f4ad6a3fbf1/dns-node-resolver/0.log"
Jul 30 23:45:20.345046 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:20.345015    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h7x6m_0368f3cc-331e-49ed-8f80-1e7d09393a2a/node-ca/0.log"
Jul 30 23:45:21.502435 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:21.502402    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-556f7c5984-n8lxc_dfcd6851-5386-4aeb-a589-be3d16864256/kube-auth-proxy/0.log"
Jul 30 23:45:22.478311 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:22.478283    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m28hq_b188ffcf-dfa7-4025-ae4f-404a18d62c3e/serve-healthcheck-canary/0.log"
Jul 30 23:45:22.636935 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:22.636893    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7xvpc_f759e4a2-4e9d-4456-b684-9943f027f047/konnectivity-agent/0.log" limit=1024
Jul 30 23:45:23.093875 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:23.093812    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mh4q4_5d615170-dc18-4245-b8d1-0af83fd6e73d/kube-rbac-proxy/0.log"
Jul 30 23:45:23.114274 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:23.114249    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mh4q4_5d615170-dc18-4245-b8d1-0af83fd6e73d/exporter/0.log"
Jul 30 23:45:23.134990 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:23.134958    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mh4q4_5d615170-dc18-4245-b8d1-0af83fd6e73d/extractor/0.log"
Jul 30 23:45:24.854627 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:24.854597    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2"
Jul 30 23:45:24.871833 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:24.871778    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b87wl/perf-node-gather-daemonset-6hjp2" podStartSLOduration=7.871762064 podStartE2EDuration="7.871762064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 23:45:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 23:45:18.847280109 +0000 UTC m=+3442.578425291" watchObservedRunningTime="2026-07-30 23:45:24.871762064 +0000 UTC m=+3448.602907224"
Jul 30 23:45:25.946329 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:25.946299    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6bb66584-v7lfh_4e52edcd-56c6-4ed8-98ea-012069b23a55/manager/0.log"
Jul 30 23:45:25.967507 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:25.967470    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5c6bb66584-v7lfh_4e52edcd-56c6-4ed8-98ea-012069b23a55/copy-manifests/0.log"
Jul 30 23:45:27.369435 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:27.369340    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78d44f567c-fjkh5_b584aecc-b3aa-4cad-81f8-d6ba25e2c39f/manager/0.log"
Jul 30 23:45:28.369360 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:28.369290    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-556f7c5984-n8lxc_dfcd6851-5386-4aeb-a589-be3d16864256/kube-auth-proxy/0.log"
Jul 30 23:45:30.094508 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:30.094478    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-556f7c5984-n8lxc_dfcd6851-5386-4aeb-a589-be3d16864256/kube-auth-proxy/0.log"
Jul 30 23:45:34.009069 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.009043    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkwfs_7f69e055-9413-4d8b-aea3-6789cb4129ff/kube-multus-additional-cni-plugins/0.log"
Jul 30 23:45:34.031579 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.031551    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkwfs_7f69e055-9413-4d8b-aea3-6789cb4129ff/egress-router-binary-copy/0.log"
Jul 30 23:45:34.055748 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.055717    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkwfs_7f69e055-9413-4d8b-aea3-6789cb4129ff/cni-plugins/0.log"
Jul 30 23:45:34.076538 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.076507    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkwfs_7f69e055-9413-4d8b-aea3-6789cb4129ff/bond-cni-plugin/0.log"
Jul 30 23:45:34.098678 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.098637    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkwfs_7f69e055-9413-4d8b-aea3-6789cb4129ff/routeoverride-cni/0.log"
Jul 30 23:45:34.118526 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.118498    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkwfs_7f69e055-9413-4d8b-aea3-6789cb4129ff/whereabouts-cni-bincopy/0.log"
Jul 30 23:45:34.139584 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.139554    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nkwfs_7f69e055-9413-4d8b-aea3-6789cb4129ff/whereabouts-cni/0.log"
Jul 30 23:45:34.403616 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.403535    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-v7q6m_ae0de2f3-ae28-4f2a-86cd-1fe157f3e88b/kube-multus/0.log"
Jul 30 23:45:34.475315 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.475285    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bgxlv_b790639c-32af-4aab-abf8-7a439dc26f30/network-metrics-daemon/0.log"
Jul 30 23:45:34.496543 ip-10-0-135-246 kubenswrapper[2561]: I0730 23:45:34.496516    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bgxlv_b790639c-32af-4aab-abf8-7a439dc26f30/kube-rbac-proxy/0.log"